-- Logs begin at Tue 2022-08-30 00:49:19 UTC, end at Tue 2022-08-30 01:45:57 UTC. -- Aug 30 01:15:09.529543 dv-cinder-819668-6-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 30 01:15:09.541063 dv-cinder-819668-6-smb devstack@keystone.service[81432]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 30 01:15:09.542993 dv-cinder-819668-6-smb devstack@keystone.service[81432]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 30 01:15:09 2022] *** Aug 30 01:15:09.542993 dv-cinder-819668-6-smb devstack@keystone.service[81432]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 30 01:15:09.542993 dv-cinder-819668-6-smb devstack@keystone.service[81432]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 30 01:15:09.542993 dv-cinder-819668-6-smb devstack@keystone.service[81432]: nodename: dv-cinder-819668-6-smb Aug 30 01:15:09.542993 dv-cinder-819668-6-smb devstack@keystone.service[81432]: machine: x86_64 Aug 30 01:15:09.542993 dv-cinder-819668-6-smb devstack@keystone.service[81432]: clock source: unix Aug 30 01:15:09.542993 dv-cinder-819668-6-smb devstack@keystone.service[81432]: pcre jit disabled Aug 30 01:15:09.542993 dv-cinder-819668-6-smb devstack@keystone.service[81432]: detected number of CPU cores: 4 Aug 30 01:15:09.542993 dv-cinder-819668-6-smb devstack@keystone.service[81432]: current working directory: / Aug 30 01:15:09.542993 dv-cinder-819668-6-smb devstack@keystone.service[81432]: detected binary path: /usr/bin/uwsgi-core Aug 30 01:15:09.542993 dv-cinder-819668-6-smb devstack@keystone.service[81432]: your processes number limit is 47680 Aug 30 01:15:09.542993 dv-cinder-819668-6-smb devstack@keystone.service[81432]: your memory page size is 4096 bytes Aug 30 01:15:09.543678 dv-cinder-819668-6-smb devstack@keystone.service[81432]: detected max file descriptor number: 2048 Aug 30 01:15:09.543678 dv-cinder-819668-6-smb devstack@keystone.service[81432]: lock engine: pthread robust mutexes Aug 30 01:15:09.543678 dv-cinder-819668-6-smb devstack@keystone.service[81432]: thunder lock: enabled Aug 30 01:15:09.543678 dv-cinder-819668-6-smb devstack@keystone.service[81432]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 30 01:15:09.543678 dv-cinder-819668-6-smb devstack@keystone.service[81432]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 30 01:15:09.581439 dv-cinder-819668-6-smb devstack@keystone.service[81432]: Python main interpreter initialized at 0x56419e0229c0 Aug 30 01:15:09.581439 dv-cinder-819668-6-smb devstack@keystone.service[81432]: python threads support enabled Aug 30 01:15:09.581439 dv-cinder-819668-6-smb devstack@keystone.service[81432]: your server socket listen backlog is limited to 100 connections Aug 30 01:15:09.581439 dv-cinder-819668-6-smb devstack@keystone.service[81432]: your mercy for graceful operations on workers is 90 seconds Aug 30 01:15:09.581773 dv-cinder-819668-6-smb devstack@keystone.service[81432]: mapped 403077 bytes (393 KB) for 2 cores Aug 30 01:15:09.581851 dv-cinder-819668-6-smb devstack@keystone.service[81432]: *** Operational MODE: preforking *** Aug 30 01:15:09.582123 dv-cinder-819668-6-smb devstack@keystone.service[81432]: *** uWSGI is running in multiple interpreter mode *** Aug 30 01:15:09.582123 dv-cinder-819668-6-smb devstack@keystone.service[81432]: spawned uWSGI master process (pid: 81432) Aug 30 01:15:09.582324 dv-cinder-819668-6-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 30 01:15:09.582932 dv-cinder-819668-6-smb devstack@keystone.service[81432]: spawned uWSGI worker 1 (pid: 81446, cores: 1) Aug 30 01:15:09.583788 dv-cinder-819668-6-smb devstack@keystone.service[81432]: spawned uWSGI worker 2 (pid: 81447, cores: 1) Aug 30 01:15:09.585549 dv-cinder-819668-6-smb devstack@keystone.service[81432]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 30 01:15:13.907152 dv-cinder-819668-6-smb devstack@keystone.service[81447]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 01:15:13.907152 dv-cinder-819668-6-smb devstack@keystone.service[81447]: from cryptography.utils import int_from_bytes Aug 30 01:15:13.907981 dv-cinder-819668-6-smb devstack@keystone.service[81446]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 01:15:13.907981 dv-cinder-819668-6-smb devstack@keystone.service[81446]: from cryptography.utils import int_from_bytes Aug 30 01:15:13.908403 dv-cinder-819668-6-smb devstack@keystone.service[81447]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 01:15:13.908403 dv-cinder-819668-6-smb devstack@keystone.service[81447]: from cryptography.utils import int_from_bytes Aug 30 01:15:13.908516 dv-cinder-819668-6-smb devstack@keystone.service[81446]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 01:15:13.908516 dv-cinder-819668-6-smb devstack@keystone.service[81446]: from cryptography.utils import int_from_bytes Aug 30 01:15:13.957122 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 01:15:13.957300 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 01:15:13.957393 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 01:15:13.957469 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 01:15:13.957548 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] command line args: [] {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 01:15:13.957626 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] command line args: [] {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 01:15:13.957742 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 01:15:13.957832 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 01:15:13.958020 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ================================================================================ {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 01:15:13.958618 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] ================================================================================ {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 01:15:13.958729 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] admin_token = **** {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.958867 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] admin_token = **** {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.958962 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] config_dir = [] {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.959048 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] config_dir = [] {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.959125 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.959204 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.959308 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] config_source = [] {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.959387 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] config_source = [] {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.959497 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] debug = True {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.959574 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] debug = True {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.959701 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.959955 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.960055 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.960117 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.960244 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.960328 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.960455 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.960541 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.960698 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.960779 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.960922 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] list_limit = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.961001 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] list_limit = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.961104 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] log_config_append = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.961184 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] log_config_append = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.961256 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.961317 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.961435 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] log_dir = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.961516 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] log_dir = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.961583 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] log_file = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.961649 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] log_file = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.961809 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.961890 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.962051 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.962137 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.962287 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.962379 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.962526 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.962614 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.962689 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.962765 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.962861 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.962998 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.963118 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.963232 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.963343 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.963480 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.963597 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.963720 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.963848 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.963942 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.964051 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.964172 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.964302 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.964438 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.964786 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.964855 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.965004 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.965092 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.965290 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.965390 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.965770 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.60/identity {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.965879 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.60/identity {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.965956 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] publish_errors = False {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.966018 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] publish_errors = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.966152 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.966240 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.966359 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.966451 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.966513 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.966572 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.966756 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.966866 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.966983 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.967059 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.967213 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] standard_threads = False {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.967303 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] standard_threads = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.967454 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.967554 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.967692 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.967778 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.967858 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.967937 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.968010 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] use_journal = False {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.968136 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] use_journal = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.968211 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] use_json = False {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.968283 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] use_json = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.968354 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] use_stderr = False {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.968432 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] use_stderr = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.968510 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] use_syslog = False {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.968639 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] use_syslog = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.968717 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.968795 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:15:13.968940 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.969020 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.969174 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.969262 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.969428 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.969507 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.969661 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.969741 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.969902 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.969997 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.970133 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.970211 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.970372 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.970452 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.970602 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.970688 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.970841 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.970924 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.971078 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.971164 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.971320 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.971410 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.971561 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.971646 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.971798 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.971878 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.972029 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.972117 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.972267 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.972346 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.972504 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.972583 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.972733 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.972823 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.972978 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.973056 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.973223 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.973307 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.973460 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.973644 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.973722 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.973799 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.973954 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.974033 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.974206 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.974293 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.974453 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.974532 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.974694 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.974773 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.974919 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.974999 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.975142 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.975227 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.975366 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.975496 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.975628 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.975711 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.975848 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.975926 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.976090 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.976167 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.976312 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.976392 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.976537 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.976620 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.976774 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.976851 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.977014 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.977094 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.977473 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.977572 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.977648 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.977856 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.977945 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.978020 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.978092 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.978163 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.978240 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.978313 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.978392 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.978466 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.978577 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.978657 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.978804 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.978883 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.979032 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.979113 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.979248 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.979327 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.979512 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.979594 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.979740 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.979827 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.979970 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.980055 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.980196 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.980280 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.980424 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.980504 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.980654 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.980738 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.980893 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.980970 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.981118 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.981198 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.981351 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.981429 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.981579 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.981671 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.981812 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.981892 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.982043 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.982202 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.982318 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.982427 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.982527 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.982624 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.982722 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.982819 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.982939 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.983055 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.983174 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.983290 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.983388 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.983523 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.983655 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.983746 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.983887 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.983979 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.984114 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.984189 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.984345 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.984429 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.984576 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.984665 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.984838 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.984917 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.985069 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.985189 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.985314 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.985404 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.985551 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.985666 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.985784 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.985912 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.986012 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.986100 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.986243 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.986321 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.986483 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.986565 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.986715 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.986805 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.986995 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.987126 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.987204 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.987265 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.987401 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.987556 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.987667 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.987748 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.987900 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.987981 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.988133 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.988221 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.988361 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.988446 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.988591 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.988670 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.988822 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.988909 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.989078 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.989666 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.989828 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.989907 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.990068 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.990156 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.990305 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.990391 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.990536 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.990616 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.990772 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.990928 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.991005 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.991078 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.991222 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.991311 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.991475 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.991559 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.991698 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.991780 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.991924 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.992002 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.992152 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.992230 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.992380 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.992461 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.992605 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.992685 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.992878 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.993328 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.993432 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.993510 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.993584 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.993662 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.993736 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.993808 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.993944 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.994026 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.994099 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.994172 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.994255 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.994355 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.994462 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] auth.external = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.994580 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] auth.external = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.994693 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.994807 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.994987 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.995097 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.995220 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.995324 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.995464 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] auth.password = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.995571 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] auth.password = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.995699 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] auth.token = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.995796 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] auth.token = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.995937 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.996018 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.996202 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.996342 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.996422 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.996496 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.996631 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.996717 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.996875 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.996959 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.997118 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.997198 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.997342 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.997422 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.997573 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] credential.caching = True {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.997662 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] credential.caching = True {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.997812 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.997893 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.998053 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.998131 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.998294 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.998376 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.998531 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.998612 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.998768 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.998848 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.998997 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.999079 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.999235 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.999316 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.999499 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.999584 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.999732 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.999815 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:13.999979 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.000067 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.000255 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.000345 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.000494 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.000577 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.000749 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.000829 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.000985 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.001065 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.001233 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.001316 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.001462 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] federation.caching = True {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.001544 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] federation.caching = True {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.001692 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.001787 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.001929 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.002012 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.002173 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.002253 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.002395 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.002475 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.002636 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.002718 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.002868 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.002947 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.003113 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.003201 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.003344 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.003424 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.003615 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.003697 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.003847 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.003940 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.004089 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.004170 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.004318 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] identity.caching = True {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.004399 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] identity.caching = True {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.004560 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.004718 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.004871 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.005475 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.005599 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.005719 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.005833 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.005925 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.006075 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.006157 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.006303 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.006383 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.006536 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.006626 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.006784 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.006899 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.007035 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.007151 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.007269 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.007386 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.007537 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.007641 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.007772 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.007862 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.008019 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.008108 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.008267 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.008357 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.008513 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.008593 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.008767 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.008857 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.009013 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.009094 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.009282 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.009361 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.009517 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.009607 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.009751 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.009832 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.009977 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.010056 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.010207 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.010295 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.010434 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.010515 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.010665 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.010746 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.010902 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.010990 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.011135 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.011214 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.011375 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.011502 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.011623 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.011718 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.011866 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.011947 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.012119 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.012270 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.012367 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.012448 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.012582 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.012671 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.012825 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.012906 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.013061 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.013151 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.013298 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.013378 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.013528 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.013608 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.013764 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.013852 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.013994 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.014073 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.014231 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.014311 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.014464 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.014546 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.014697 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.014777 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.014940 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.015019 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.015183 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.015266 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.015412 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.015510 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.015662 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.015752 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.015908 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.016056 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.016189 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.016321 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.016451 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.016581 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.016719 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.016848 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.016976 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.017115 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.017244 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] ldap.user = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.017374 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.user = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.017508 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.017645 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.017773 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.017900 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.018028 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.018156 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.018292 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.018423 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.018549 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.018676 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.018804 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.018940 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.019075 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.019203 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.019331 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.019512 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.019594 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.019668 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.019754 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.019870 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.019953 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.020028 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.020100 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.020172 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.020254 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.020328 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.020427 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.020491 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.020551 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.020611 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.020680 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.020755 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.020909 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.020998 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.021136 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.021217 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.021375 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.021458 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.021606 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.021687 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.021836 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.021917 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.022069 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.022150 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.022297 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.022383 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.022535 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.022617 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.022775 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.022857 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.023005 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.023085 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.023252 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.023332 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.023496 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.023583 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.023739 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.023819 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.023971 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.024054 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.024201 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.024283 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.024434 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.024514 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.024677 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.024788 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.024913 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.025033 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.025140 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.025266 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.025372 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.025505 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.025600 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] resource.caching = True {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.025749 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] resource.caching = True {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.025830 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.025999 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.026079 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.026245 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.026334 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.026484 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.026572 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.026733 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.026814 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.026966 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.027054 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.027205 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.027286 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.027474 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.027559 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.027692 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.027857 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.027936 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] role.caching = True {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.028009 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.028151 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] role.driver = sql {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.028233 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] role.caching = True {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.028379 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.028468 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] role.driver = sql {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.028614 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.028694 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.028855 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.028935 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.029098 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.029180 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.029339 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.029420 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.029581 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.029661 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.029822 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.029905 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.030064 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.030144 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.030303 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.030383 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.030530 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.030611 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.030766 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.030844 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.031004 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.031085 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.031244 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.031326 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.031503 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.031589 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.031750 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.031894 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.032135 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.032216 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.032375 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.032454 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.032617 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.032696 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.032859 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.032941 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.033105 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.033185 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.033337 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.033417 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.033573 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.033654 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.033821 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.033901 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.034056 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.034145 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.034284 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.034366 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.034513 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.034593 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.034740 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.034829 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.034970 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.035050 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.035220 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.035300 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.035477 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.035572 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.035715 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.035796 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.035947 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.036046 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.036199 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.036288 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.036428 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.036507 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] token.caching = True {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.036659 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.036737 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] token.caching = True {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.036892 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.036979 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.037123 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.037202 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.037363 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.037442 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.037603 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.037690 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.037834 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.037916 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.038073 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.038153 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.038312 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.038400 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.038552 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.038632 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.038783 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.038863 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.039015 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.039104 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.039244 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.039325 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.039497 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.039581 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.039775 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.039882 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.040021 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.040092 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.040251 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.040336 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.040529 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.040622 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.040755 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.040837 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] database.connection = **** {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.041012 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.041093 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] database.connection = **** {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.041255 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.041334 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.041488 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.041567 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.041727 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.041807 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.041957 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.042037 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.042189 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.042269 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.042423 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.042513 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.042656 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.042737 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.042888 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.042967 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.043118 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.043198 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.043357 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.043453 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.043612 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.043692 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.043855 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.043938 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.044087 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.044168 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.044322 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.044401 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.044547 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.044628 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.044783 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.044862 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.045012 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.045090 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.045172 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 01:15:14.045248 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:15:14.045400 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 01:15:14.075302 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81447) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 01:15:14.075487 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81446) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 01:15:14.075606 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81447) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 01:15:14.075689 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81446) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 01:15:14.075769 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81447) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 01:15:14.075846 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81446) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 01:15:14.084040 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81447) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 01:15:14.084212 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81446) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 01:15:14.111865 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81446) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 01:15:14.111994 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81447) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 01:15:14.112091 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81446) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 01:15:14.112175 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81447) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 01:15:14.165700 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81446) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 01:15:14.166103 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81447) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 01:15:14.215262 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81446) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 01:15:14.215513 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81446) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 01:15:14.216318 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81447) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 01:15:14.216548 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81447) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 01:15:14.369775 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81446) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 01:15:14.370001 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81446) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 01:15:14.370228 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81446) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 01:15:14.370452 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81446) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 01:15:14.370607 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81447) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 01:15:14.370718 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81446) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 01:15:14.370836 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81447) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 01:15:14.370920 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81446) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 01:15:14.371052 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81447) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 01:15:14.371265 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81447) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 01:15:14.371502 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81447) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 01:15:14.371714 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81447) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 01:15:14.393754 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81446) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 01:15:14.393884 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81447) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 01:15:14.394044 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81446) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 01:15:14.394153 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81447) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 01:15:14.394308 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81446) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 01:15:14.394395 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81447) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 01:15:14.394471 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81446) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 01:15:14.394545 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81447) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 01:15:14.394619 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81446) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 01:15:14.394702 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81447) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 01:15:14.394834 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81446) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 01:15:14.394918 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81447) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 01:15:14.395050 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81446) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 01:15:14.395134 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81447) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 01:15:14.405894 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81446) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 01:15:14.406193 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81447) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 01:15:14.419083 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81446) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 01:15:14.419302 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81446) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 01:15:14.419541 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81446) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 01:15:14.419629 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81447) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 01:15:14.419771 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81446) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 01:15:14.419855 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81447) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 01:15:14.419988 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81447) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 01:15:14.420069 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81446) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 01:15:14.420192 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81446) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 01:15:14.420289 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81447) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 01:15:14.420400 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81446) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 01:15:14.420482 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81447) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 01:15:14.420608 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81447) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 01:15:14.420819 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81447) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 01:15:14.437857 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.438012 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.438099 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 30 01:15:14.438179 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 30 01:15:14.438393 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.438519 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.438623 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 30 01:15:14.438703 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 30 01:15:14.438850 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.438970 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.439114 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.439232 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.439375 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.439663 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.439773 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.440033 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.449283 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.449394 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.449566 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.449651 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.449838 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.449923 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.450122 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.450206 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.457107 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81447) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 01:15:14.457205 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81446) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 01:15:14.460026 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81447) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 01:15:14.460127 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81446) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 01:15:14.460309 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.460394 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.460591 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.460674 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.460869 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.460962 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.461149 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.461233 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.461410 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.461529 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.461658 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.461772 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.461935 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.462058 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.462205 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.462380 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.462466 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.462656 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.462739 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.462926 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.486170 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.486288 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.487656 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81447) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 01:15:14.487753 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81446) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 01:15:14.487936 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.488020 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.493041 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81446) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 01:15:14.493291 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81447) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 01:15:14.493451 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.493537 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.493613 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.493795 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.500078 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81446) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 01:15:14.500176 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81447) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 01:15:14.500364 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.500449 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.504337 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81446) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 01:15:14.504443 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81447) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 01:15:14.504632 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.504717 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.504968 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.505051 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.505250 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.505335 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.505523 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.505607 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.505824 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.506091 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.506364 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.507525 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.507822 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.508111 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.523525 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.523643 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.523802 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.523888 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.527687 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81446) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 01:15:14.527819 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81447) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 01:15:14.530744 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.531017 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.531106 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.531310 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.535292 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81446) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 01:15:14.535503 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81447) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 01:15:14.538930 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81446) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 01:15:14.539187 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81447) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 01:15:14.541997 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.542302 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.542398 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.542591 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.542741 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.542885 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.542977 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.543168 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.543276 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.543574 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.543662 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.543851 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.559865 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81446) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 01:15:14.560155 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.560292 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81447) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 01:15:14.560421 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.560579 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.560687 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.560846 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.561108 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.567426 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.567979 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.569119 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.569489 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.570653 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.570936 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.571066 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.571335 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.573619 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81446) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 01:15:14.573905 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.573991 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81447) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 01:15:14.574198 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.574283 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.574484 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.574618 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.574770 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.574900 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.575187 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.586133 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81446) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 01:15:14.586355 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81447) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 01:15:14.586444 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.586691 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.586776 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.587327 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.587504 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.587618 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.587724 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.587827 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.587929 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.588040 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.588143 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.588245 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.603986 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81446) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 01:15:14.604475 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81447) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 01:15:14.607015 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81446) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 01:15:14.607391 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81447) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 01:15:14.609932 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.610284 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.611370 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.611730 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.612883 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81446) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 01:15:14.613179 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.613335 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81447) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 01:15:14.613458 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.613614 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.613900 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.620611 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.620802 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.622101 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81446) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 01:15:14.622272 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81447) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 01:15:14.625003 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.625290 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.625375 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.625579 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.625663 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.625858 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.625942 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.626131 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.633819 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81446) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 01:15:14.634062 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81447) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 01:15:14.634157 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.634309 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.634408 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.634587 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.641287 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81446) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 01:15:14.641466 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81447) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 01:15:14.641566 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.641747 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.641832 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.642023 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.642107 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.642296 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.642380 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.642564 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.642648 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.642831 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.642925 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.643109 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.643192 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.643380 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.643543 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.643678 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.643762 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.643950 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.644047 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.644217 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.644299 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.644474 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.644556 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.644734 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.644818 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.645018 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81447) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 01:15:14.679779 dv-cinder-819668-6-smb devstack@keystone.service[81446]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56419e0229c0 pid: 81446 (default app) Aug 30 01:15:14.680185 dv-cinder-819668-6-smb devstack@keystone.service[81447]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56419e0229c0 pid: 81447 (default app) Aug 30 01:15:14.683211 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030c94a-294b-4bf8-85c1-61ec803e8249 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:14.683530 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030c94a-294b-4bf8-85c1-61ec803e8249 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:14.683802 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030c94a-294b-4bf8-85c1-61ec803e8249 None None] PATH_INFO: `/v3` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:14.687948 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1/1] 10.222.0.60 () {50 vars in 791 bytes} [Tue Aug 30 01:15:14 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:21.283897 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa760a1e-2674-4dd8-a535-5f252f300a5e None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:21.284412 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa760a1e-2674-4dd8-a535-5f252f300a5e None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:21.284412 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa760a1e-2674-4dd8-a535-5f252f300a5e None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:21.289265 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1/2] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:15:21 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:15:21.294480 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc061ae1-2a49-49a3-be8b-ea23a2f74bc1 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:21.294922 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc061ae1-2a49-49a3-be8b-ea23a2f74bc1 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:21.295083 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc061ae1-2a49-49a3-be8b-ea23a2f74bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:21.365647 dv-cinder-819668-6-smb devstack@keystone.service[81446]: INFO dbcounter [None req-fc061ae1-2a49-49a3-be8b-ea23a2f74bc1 None None] Registered counter for database keystone Aug 30 01:15:21.384513 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG oslo_db.sqlalchemy.engines [None req-fc061ae1-2a49-49a3-be8b-ea23a2f74bc1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81446) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 01:15:21.390728 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writer thread running {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 01:15:21.570951 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG passlib.handlers.bcrypt [None req-fc061ae1-2a49-49a3-be8b-ea23a2f74bc1 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81446) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 30 01:15:21.571246 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG passlib.handlers.bcrypt [None req-fc061ae1-2a49-49a3-be8b-ea23a2f74bc1 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81446) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 30 01:15:21.630176 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-fc061ae1-2a49-49a3-be8b-ea23a2f74bc1 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:21.631810 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-fc061ae1-2a49-49a3-be8b-ea23a2f74bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:21.761285 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 2/3] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:15:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 468 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 30 01:15:22.222249 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa760a1e-2674-4dd8-a535-5f252f300a5e None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:22.291321 dv-cinder-819668-6-smb devstack@keystone.service[81447]: INFO dbcounter [None req-fa760a1e-2674-4dd8-a535-5f252f300a5e None None] Registered counter for database keystone Aug 30 01:15:22.312548 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG oslo_db.sqlalchemy.engines [None req-fa760a1e-2674-4dd8-a535-5f252f300a5e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81447) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 01:15:22.319364 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writer thread running {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 01:15:22.436505 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa760a1e-2674-4dd8-a535-5f252f300a5e None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:22.440891 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce83e8b-3768-47b2-8805-cd62a483be4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:22.441322 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce83e8b-3768-47b2-8805-cd62a483be4c admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:22.441601 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce83e8b-3768-47b2-8805-cd62a483be4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:22.441871 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce83e8b-3768-47b2-8805-cd62a483be4c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:22.450768 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce83e8b-3768-47b2-8805-cd62a483be4c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:22.501972 dv-cinder-819668-6-smb devstack@keystone.service[81447]: WARNING keystone.common.rbac_enforcer.enforcer [None req-cce83e8b-3768-47b2-8805-cd62a483be4c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 30 01:15:22.502256 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce83e8b-3768-47b2-8805-cd62a483be4c admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:22.512922 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 2/4] 10.222.0.60 () {58 vars in 1324 bytes} [Tue Aug 30 01:15:22 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 01:15:22.519098 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc061ae1-2a49-49a3-be8b-ea23a2f74bc1 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:22.533266 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc061ae1-2a49-49a3-be8b-ea23a2f74bc1 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:22.537712 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa7dfdc-7054-4256-9551-071a15ada7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:22.538813 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7dfdc-7054-4256-9551-071a15ada7d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:22.539099 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7dfdc-7054-4256-9551-071a15ada7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:22.539377 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7dfdc-7054-4256-9551-071a15ada7d7 admin admin] PATH_INFO: `/v3/projects/9a06ede3df8449d487fb53c388e91ca5` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:22.540996 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa7dfdc-7054-4256-9551-071a15ada7d7 admin admin] RBAC: Authorizing `identity:get_project(project_id=9a06ede3df8449d487fb53c388e91ca5)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:22.595217 dv-cinder-819668-6-smb devstack@keystone.service[81446]: WARNING keystone.common.rbac_enforcer.enforcer [None req-bfa7dfdc-7054-4256-9551-071a15ada7d7 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 30 01:15:22.595611 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa7dfdc-7054-4256-9551-071a15ada7d7 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:22.600944 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 3/5] 10.222.0.60 () {56 vars in 1207 bytes} [Tue Aug 30 01:15:22 2022] GET /identity/v3/projects/9a06ede3df8449d487fb53c388e91ca5 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:24.482514 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef8c6d-8d36-4785-b32f-97f928d0382b None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:24.483097 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef8c6d-8d36-4785-b32f-97f928d0382b None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:24.483097 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef8c6d-8d36-4785-b32f-97f928d0382b None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:24.487134 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 3/6] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:15:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:15:24.492582 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687f363-f50a-4565-b88a-d671d79fe4a9 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:24.492998 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687f363-f50a-4565-b88a-d671d79fe4a9 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:24.493156 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687f363-f50a-4565-b88a-d671d79fe4a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:24.512806 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-5687f363-f50a-4565-b88a-d671d79fe4a9 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:24.514311 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-5687f363-f50a-4565-b88a-d671d79fe4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:24.522459 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 4/7] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:15:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 30 01:15:24.791797 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ef8c6d-8d36-4785-b32f-97f928d0382b None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:24.804486 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ef8c6d-8d36-4785-b32f-97f928d0382b None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:24.808650 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e398442b-8885-48c2-932f-3687a213c8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:24.809249 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398442b-8885-48c2-932f-3687a213c8de admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:24.809528 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398442b-8885-48c2-932f-3687a213c8de admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:24.809802 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398442b-8885-48c2-932f-3687a213c8de admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:24.817989 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e398442b-8885-48c2-932f-3687a213c8de admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:24.819792 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e398442b-8885-48c2-932f-3687a213c8de admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:24.828342 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 4/8] 10.222.0.60 () {58 vars in 1324 bytes} [Tue Aug 30 01:15:24 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 01:15:24.834352 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5687f363-f50a-4565-b88a-d671d79fe4a9 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:24.843624 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5687f363-f50a-4565-b88a-d671d79fe4a9 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:24.847874 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c260f-23b0-45fc-8d9e-8f23f08863c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:24.848524 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c260f-23b0-45fc-8d9e-8f23f08863c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:24.848805 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c260f-23b0-45fc-8d9e-8f23f08863c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:24.849080 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c260f-23b0-45fc-8d9e-8f23f08863c4 admin admin] PATH_INFO: `/v3/users/68ff671606954cb48c45e22d8978bcf2` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:24.850385 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600c260f-23b0-45fc-8d9e-8f23f08863c4 admin admin] RBAC: Authorizing `identity:get_user(user_id=68ff671606954cb48c45e22d8978bcf2)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:24.852247 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600c260f-23b0-45fc-8d9e-8f23f08863c4 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:24.853753 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 5/9] 10.222.0.60 () {56 vars in 1198 bytes} [Tue Aug 30 01:15:24 2022] GET /identity/v3/users/68ff671606954cb48c45e22d8978bcf2 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:15:26.802441 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8570207-32d0-44c2-89cb-18b622ad283f None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:26.802992 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8570207-32d0-44c2-89cb-18b622ad283f None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:26.802992 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8570207-32d0-44c2-89cb-18b622ad283f None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:26.804332 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 5/10] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:15:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:15:26.809501 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054fffb-ab41-4aa6-8f30-0653649aefae None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:26.809884 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054fffb-ab41-4aa6-8f30-0653649aefae None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:26.810131 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054fffb-ab41-4aa6-8f30-0653649aefae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:26.828618 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-e054fffb-ab41-4aa6-8f30-0653649aefae None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:26.829802 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-e054fffb-ab41-4aa6-8f30-0653649aefae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:26.864582 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32827ce6-ce4f-4661-8c52-e9cadd6a3e91 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:26.864885 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32827ce6-ce4f-4661-8c52-e9cadd6a3e91 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:26.865227 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32827ce6-ce4f-4661-8c52-e9cadd6a3e91 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:26.866622 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 6/11] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:15:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:15:26.872859 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19a39b-88a3-4bfb-8f4b-dcb931890595 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:26.873140 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19a39b-88a3-4bfb-8f4b-dcb931890595 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:26.873414 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19a39b-88a3-4bfb-8f4b-dcb931890595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:26.911650 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 6/12] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:15:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:15:26.916353 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG passlib.handlers.bcrypt [None req-2a19a39b-88a3-4bfb-8f4b-dcb931890595 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81447) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 30 01:15:26.916744 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG passlib.handlers.bcrypt [None req-2a19a39b-88a3-4bfb-8f4b-dcb931890595 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81447) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 30 01:15:26.966235 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-2a19a39b-88a3-4bfb-8f4b-dcb931890595 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:26.967923 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-2a19a39b-88a3-4bfb-8f4b-dcb931890595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:27.074183 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 7/13] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:15:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 01:15:27.194933 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e054fffb-ab41-4aa6-8f30-0653649aefae None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:27.218598 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:27.300255 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e054fffb-ab41-4aa6-8f30-0653649aefae None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:27.338913 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f470e-30f0-4d3b-911a-8dc431021e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:27.339587 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f470e-30f0-4d3b-911a-8dc431021e47 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:27.340132 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f470e-30f0-4d3b-911a-8dc431021e47 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:27.340409 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f470e-30f0-4d3b-911a-8dc431021e47 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:27.347627 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a19a39b-88a3-4bfb-8f4b-dcb931890595 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:27.352916 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7f470e-30f0-4d3b-911a-8dc431021e47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:15:27.362060 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-eb7f470e-30f0-4d3b-911a-8dc431021e47 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:15:27.362060 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:15:27.362060 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:15:27.362060 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:15:27.362060 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:15:27.362060 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:15:27.362060 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:15:27.362060 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:15:27.362060 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:15:27.362060 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:15:27.362060 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:15:27.362060 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:15:27.362060 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:15:27.362060 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:15:27.362060 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:15:27.362060 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:15:27.363034 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:15:27.363034 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:15:27.363034 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:15:27.363034 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:15:27.363034 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:15:27.363034 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:15:27.363034 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:15:27.363034 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:15:27.363034 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:15:27.363034 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:15:27.363034 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:15:27.363034 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:15:27.363034 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:15:27.363034 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:15:27.363034 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:15:27.363034 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:15:27.364487 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:15:27.364487 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:15:27.364487 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:15:27.364487 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:15:27.364487 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:15:27.364487 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:15:27.364487 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:15:27.364487 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:15:27.364487 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:15:27.364487 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:15:27.364487 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:15:27.364487 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:15:27.364487 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 7/14] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 30 01:15:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:15:27.369489 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f470e-30f0-4d3b-911a-8dc431021e47 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:27.449389 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a19a39b-88a3-4bfb-8f4b-dcb931890595 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:27.451658 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:27.452283 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:27.472252 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f470e-30f0-4d3b-911a-8dc431021e47 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:27.490421 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794d4934-9050-4e9f-b3e3-437308692f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:27.491282 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d4934-9050-4e9f-b3e3-437308692f90 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:27.491594 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d4934-9050-4e9f-b3e3-437308692f90 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:27.491871 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d4934-9050-4e9f-b3e3-437308692f90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:27.506611 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f5a718-1ad4-4888-ac5d-974b86f15455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:27.507215 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f5a718-1ad4-4888-ac5d-974b86f15455 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:27.507530 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f5a718-1ad4-4888-ac5d-974b86f15455 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:27.507810 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f5a718-1ad4-4888-ac5d-974b86f15455 None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:27.508484 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f5a718-1ad4-4888-ac5d-974b86f15455 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:15:27.508791 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f5a718-1ad4-4888-ac5d-974b86f15455 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:27.510198 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f5a718-1ad4-4888-ac5d-974b86f15455 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:27.522253 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 8/15] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 30 01:15:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:15:27.527761 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f5a718-1ad4-4888-ac5d-974b86f15455 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:27.560968 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794d4934-9050-4e9f-b3e3-437308692f90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:27.562489 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794d4934-9050-4e9f-b3e3-437308692f90 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:27.628545 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f5a718-1ad4-4888-ac5d-974b86f15455 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:27.664136 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148160f-62f7-45dc-90b4-b873d4b2f1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:27.664780 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148160f-62f7-45dc-90b4-b873d4b2f1ea None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:27.665083 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148160f-62f7-45dc-90b4-b873d4b2f1ea None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:27.665344 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148160f-62f7-45dc-90b4-b873d4b2f1ea None admin] PATH_INFO: `/v3/users/68ff671606954cb48c45e22d8978bcf2` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:27.666494 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1148160f-62f7-45dc-90b4-b873d4b2f1ea None admin] RBAC: Authorizing `identity:get_user(user_id=68ff671606954cb48c45e22d8978bcf2)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:27.667998 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1148160f-62f7-45dc-90b4-b873d4b2f1ea None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:27.669394 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 8/16] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 30 01:15:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 01:15:27.669562 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 9/17] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 30 01:15:27 2022] GET /identity/v3/users/68ff671606954cb48c45e22d8978bcf2 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:15:27.675006 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148160f-62f7-45dc-90b4-b873d4b2f1ea None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:27.675132 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794d4934-9050-4e9f-b3e3-437308692f90 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:27.678277 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:27.690042 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:27.775796 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794d4934-9050-4e9f-b3e3-437308692f90 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:27.777158 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148160f-62f7-45dc-90b4-b873d4b2f1ea None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:27.809739 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caadc23b-8f9a-441b-8b32-0fc9d3d0e093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:27.810587 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caadc23b-8f9a-441b-8b32-0fc9d3d0e093 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:27.810870 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caadc23b-8f9a-441b-8b32-0fc9d3d0e093 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:27.811145 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caadc23b-8f9a-441b-8b32-0fc9d3d0e093 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:27.812457 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79035399-483b-4c63-a1b3-71134a5f25f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:27.812828 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caadc23b-8f9a-441b-8b32-0fc9d3d0e093 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:27.813079 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79035399-483b-4c63-a1b3-71134a5f25f0 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:27.813360 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79035399-483b-4c63-a1b3-71134a5f25f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:27.813631 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79035399-483b-4c63-a1b3-71134a5f25f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:27.813909 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caadc23b-8f9a-441b-8b32-0fc9d3d0e093 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:27.815492 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 9/18] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:15:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:27.821982 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caadc23b-8f9a-441b-8b32-0fc9d3d0e093 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:27.824796 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79035399-483b-4c63-a1b3-71134a5f25f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:27.826277 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79035399-483b-4c63-a1b3-71134a5f25f0 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:27.843771 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-79035399-483b-4c63-a1b3-71134a5f25f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:15:27.843771 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:15:27.843771 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:15:27.843771 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:15:27.843771 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:15:27.843771 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:15:27.843771 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:15:27.843771 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:15:27.843771 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:15:27.843771 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:15:27.843771 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:15:27.843771 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:15:27.843771 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:15:27.843771 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:15:27.843771 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:15:27.843771 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:15:27.844855 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:15:27.844855 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:15:27.844855 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:15:27.844855 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:15:27.844855 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:15:27.844855 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:15:27.844855 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:15:27.844855 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:15:27.844855 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:15:27.844855 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:15:27.844855 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:15:27.844855 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:15:27.844855 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:15:27.844855 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:15:27.844855 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:15:27.844855 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:15:27.844855 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:15:27.845679 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:15:27.845679 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:15:27.845679 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:15:27.845679 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 10/19] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:15:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:15:27.850605 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79035399-483b-4c63-a1b3-71134a5f25f0 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:27.892603 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:27.917085 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:27.929128 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caadc23b-8f9a-441b-8b32-0fc9d3d0e093 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:27.955528 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79035399-483b-4c63-a1b3-71134a5f25f0 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:27.963405 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af70df2-d50e-481d-97d1-8a7967fbdb07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:27.964107 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af70df2-d50e-481d-97d1-8a7967fbdb07 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:27.964386 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af70df2-d50e-481d-97d1-8a7967fbdb07 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:27.964916 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af70df2-d50e-481d-97d1-8a7967fbdb07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:27.965635 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af70df2-d50e-481d-97d1-8a7967fbdb07 None admin] RBAC: Adding query filter params (role.id=f6bc03b6972e420eb338ee7fd1443974, scope.domain.id=default, user.id=68ff671606954cb48c45e22d8978bcf2) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:15:27.965941 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af70df2-d50e-481d-97d1-8a7967fbdb07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:27.967400 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af70df2-d50e-481d-97d1-8a7967fbdb07 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:27.976548 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 10/20] 10.222.0.60 () {56 vars in 1322 bytes} [Tue Aug 30 01:15:27 2022] GET /identity/v3/role_assignments?user.id=68ff671606954cb48c45e22d8978bcf2&scope.domain.id=default&role.id=f6bc03b6972e420eb338ee7fd1443974 => generated 233 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:15:27.989607 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6391d60b-f09b-4a8b-8681-ce7ca81d8ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:27.990253 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391d60b-f09b-4a8b-8681-ce7ca81d8ce0 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:27.990536 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391d60b-f09b-4a8b-8681-ce7ca81d8ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:27.990812 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391d60b-f09b-4a8b-8681-ce7ca81d8ce0 None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:27.991526 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6391d60b-f09b-4a8b-8681-ce7ca81d8ce0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:15:27.991836 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6391d60b-f09b-4a8b-8681-ce7ca81d8ce0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:27.993302 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6391d60b-f09b-4a8b-8681-ce7ca81d8ce0 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:28.013517 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 11/21] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:15:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:15:30.075086 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e6a8e-d49b-4b39-8866-6b1d7f7bfa54 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:30.075656 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e6a8e-d49b-4b39-8866-6b1d7f7bfa54 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:30.075656 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e6a8e-d49b-4b39-8866-6b1d7f7bfa54 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:30.077216 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 11/22] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:15:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:15:30.085717 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d798a8-d605-48db-8380-c69d1d267b7a None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:30.086137 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d798a8-d605-48db-8380-c69d1d267b7a None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:30.086320 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d798a8-d605-48db-8380-c69d1d267b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:30.109819 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-f8d798a8-d605-48db-8380-c69d1d267b7a None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:30.111039 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-f8d798a8-d605-48db-8380-c69d1d267b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:30.186750 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 12/23] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:15:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:15:30.312226 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26316135-4ee4-4011-9e08-77f758d520ad None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:30.312540 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26316135-4ee4-4011-9e08-77f758d520ad None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:30.312799 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26316135-4ee4-4011-9e08-77f758d520ad None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:30.314105 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 12/24] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:15:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:15:30.319636 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77cfd38-5c80-4318-8ca7-4815d4c19af1 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:30.319915 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77cfd38-5c80-4318-8ca7-4815d4c19af1 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:30.320191 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77cfd38-5c80-4318-8ca7-4815d4c19af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:30.346490 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-b77cfd38-5c80-4318-8ca7-4815d4c19af1 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:30.347666 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-b77cfd38-5c80-4318-8ca7-4815d4c19af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:30.411792 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:30.430824 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 13/25] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:15:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:15:30.613910 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26316135-4ee4-4011-9e08-77f758d520ad None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:30.739553 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26316135-4ee4-4011-9e08-77f758d520ad None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:30.778858 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d486d15-36c6-46cd-a91a-ac5acd916859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:30.779528 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d486d15-36c6-46cd-a91a-ac5acd916859 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:30.779814 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d486d15-36c6-46cd-a91a-ac5acd916859 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:30.780091 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d486d15-36c6-46cd-a91a-ac5acd916859 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:30.785418 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c052e-c6af-46b7-a9a2-381103b6d5a6 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:30.785769 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c052e-c6af-46b7-a9a2-381103b6d5a6 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:30.786552 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c052e-c6af-46b7-a9a2-381103b6d5a6 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:30.788354 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 14/26] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:15:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:15:30.792986 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82793cf1-110e-4fb2-aefb-1bced310f4c3 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:30.793275 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82793cf1-110e-4fb2-aefb-1bced310f4c3 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:30.793596 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82793cf1-110e-4fb2-aefb-1bced310f4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:30.798235 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:30.820185 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d486d15-36c6-46cd-a91a-ac5acd916859 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:15:30.832450 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-82793cf1-110e-4fb2-aefb-1bced310f4c3 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:30.835498 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-82793cf1-110e-4fb2-aefb-1bced310f4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:30.844534 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-9d486d15-36c6-46cd-a91a-ac5acd916859 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:15:30.844534 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:15:30.844534 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:15:30.844534 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:15:30.844534 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:15:30.844534 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:15:30.844534 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:15:30.844534 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:15:30.844534 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:15:30.844534 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:15:30.844534 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:15:30.844534 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:15:30.844534 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:15:30.844534 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:15:30.844534 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:15:30.844534 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:15:30.845393 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:15:30.845393 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:15:30.845393 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:15:30.845393 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:15:30.845393 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:15:30.845393 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:15:30.845393 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:15:30.845393 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:15:30.845393 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:15:30.845393 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:15:30.845393 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:15:30.845393 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:15:30.845393 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:15:30.845393 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:15:30.845393 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:15:30.845393 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:15:30.846132 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:15:30.846132 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:15:30.846132 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:15:30.846132 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:15:30.846132 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:15:30.846132 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:15:30.846132 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:15:30.846132 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:15:30.846132 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:15:30.846132 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:15:30.846132 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:15:30.846132 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:15:30.850538 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 13/27] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 30 01:15:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:15:30.864461 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d486d15-36c6-46cd-a91a-ac5acd916859 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:30.970676 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 15/28] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:15:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 01:15:30.971889 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82793cf1-110e-4fb2-aefb-1bced310f4c3 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:31.076051 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d486d15-36c6-46cd-a91a-ac5acd916859 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:31.137067 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde70468-4819-4f06-9cfd-f81212262774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:31.137721 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde70468-4819-4f06-9cfd-f81212262774 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:31.138000 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde70468-4819-4f06-9cfd-f81212262774 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:31.138270 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde70468-4819-4f06-9cfd-f81212262774 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:31.166680 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde70468-4819-4f06-9cfd-f81212262774 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:31.176411 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde70468-4819-4f06-9cfd-f81212262774 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:31.181529 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82793cf1-110e-4fb2-aefb-1bced310f4c3 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:31.194166 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-dde70468-4819-4f06-9cfd-f81212262774 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:15:31.194166 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:15:31.194166 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:15:31.194166 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:15:31.194166 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:15:31.194166 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:15:31.194166 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:15:31.194166 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:15:31.194166 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:15:31.194166 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:15:31.194166 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:15:31.194166 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:15:31.194166 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:15:31.194166 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:15:31.194166 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:15:31.194166 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:15:31.195245 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:15:31.195245 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:15:31.195245 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:15:31.195245 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:15:31.195245 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:15:31.195245 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:15:31.195245 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:15:31.195245 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:15:31.195245 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:15:31.195245 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:15:31.195245 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:15:31.195245 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:15:31.195245 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:15:31.195245 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:15:31.195245 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:15:31.195245 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:15:31.195245 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:15:31.196297 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:15:31.196297 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:15:31.196297 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:15:31.197964 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 14/29] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:15:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:15:31.199356 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf16f8-856c-44b1-b02e-874c993f4352 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:31.199794 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf16f8-856c-44b1-b02e-874c993f4352 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:31.200224 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf16f8-856c-44b1-b02e-874c993f4352 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:31.201904 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 15/30] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:15:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:15:31.209313 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26aa13-03a8-4801-8304-df92a46d84a1 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:31.209592 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26aa13-03a8-4801-8304-df92a46d84a1 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:31.209862 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26aa13-03a8-4801-8304-df92a46d84a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:31.219798 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:31.239300 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-6f26aa13-03a8-4801-8304-df92a46d84a1 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:31.240572 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-6f26aa13-03a8-4801-8304-df92a46d84a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:31.258466 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e45e694-ad6a-4f81-bd74-aedbbd86d6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:31.259080 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45e694-ad6a-4f81-bd74-aedbbd86d6f4 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:31.259353 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45e694-ad6a-4f81-bd74-aedbbd86d6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:31.259667 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45e694-ad6a-4f81-bd74-aedbbd86d6f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:31.260336 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e45e694-ad6a-4f81-bd74-aedbbd86d6f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:15:31.260634 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e45e694-ad6a-4f81-bd74-aedbbd86d6f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:31.262029 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e45e694-ad6a-4f81-bd74-aedbbd86d6f4 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:31.275174 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 16/31] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 30 01:15:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:31.278120 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e45e694-ad6a-4f81-bd74-aedbbd86d6f4 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:31.327823 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:31.377376 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 16/32] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:15:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:15:31.378694 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f26aa13-03a8-4801-8304-df92a46d84a1 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:31.472160 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e45e694-ad6a-4f81-bd74-aedbbd86d6f4 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:31.502212 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f26aa13-03a8-4801-8304-df92a46d84a1 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:31.529117 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1776d6d-a1f4-4f7c-80e2-1c5c3dc6c1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:31.529735 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1776d6d-a1f4-4f7c-80e2-1c5c3dc6c1f4 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:31.530010 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1776d6d-a1f4-4f7c-80e2-1c5c3dc6c1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:31.530279 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1776d6d-a1f4-4f7c-80e2-1c5c3dc6c1f4 None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:31.530930 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1776d6d-a1f4-4f7c-80e2-1c5c3dc6c1f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:15:31.531231 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1776d6d-a1f4-4f7c-80e2-1c5c3dc6c1f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:31.532654 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1776d6d-a1f4-4f7c-80e2-1c5c3dc6c1f4 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:31.551220 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 17/33] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:15:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:31.552920 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1776d6d-a1f4-4f7c-80e2-1c5c3dc6c1f4 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:31.555476 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099d5bc9-d9ed-428a-b9dd-1afed1b0b724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:31.556108 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d5bc9-d9ed-428a-b9dd-1afed1b0b724 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:31.556444 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d5bc9-d9ed-428a-b9dd-1afed1b0b724 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:31.556719 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d5bc9-d9ed-428a-b9dd-1afed1b0b724 None admin] PATH_INFO: `/v3/users/68ff671606954cb48c45e22d8978bcf2` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:31.558762 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099d5bc9-d9ed-428a-b9dd-1afed1b0b724 None admin] RBAC: Authorizing `identity:get_user(user_id=68ff671606954cb48c45e22d8978bcf2)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:31.559659 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099d5bc9-d9ed-428a-b9dd-1afed1b0b724 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:31.561239 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 17/34] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 30 01:15:31 2022] GET /identity/v3/users/68ff671606954cb48c45e22d8978bcf2 => generated 247 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:31.562356 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf5f7c2-987d-40f4-b296-e5519978b07c None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:31.567026 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf5f7c2-987d-40f4-b296-e5519978b07c None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:31.567881 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf5f7c2-987d-40f4-b296-e5519978b07c None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:31.569272 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 18/35] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:15:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:15:31.569945 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf5f7c2-987d-40f4-b296-e5519978b07c None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:31.599836 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:31.636486 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:31.690600 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1776d6d-a1f4-4f7c-80e2-1c5c3dc6c1f4 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:31.701508 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf5f7c2-987d-40f4-b296-e5519978b07c None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:31.737346 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb606f0-9db5-4229-8728-31f5f0984284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:31.737868 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb606f0-9db5-4229-8728-31f5f0984284 None admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:31.738148 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb606f0-9db5-4229-8728-31f5f0984284 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:31.738423 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb606f0-9db5-4229-8728-31f5f0984284 None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:31.739756 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb606f0-9db5-4229-8728-31f5f0984284 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:31.741212 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb606f0-9db5-4229-8728-31f5f0984284 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:31.745004 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22398bed-80ad-40c8-9523-d0feeafdd774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:31.745845 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22398bed-80ad-40c8-9523-d0feeafdd774 None admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:31.746303 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22398bed-80ad-40c8-9523-d0feeafdd774 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:31.746815 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22398bed-80ad-40c8-9523-d0feeafdd774 None admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:31.747927 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22398bed-80ad-40c8-9523-d0feeafdd774 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:31.749788 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22398bed-80ad-40c8-9523-d0feeafdd774 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:31.861788 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 18/36] 10.222.0.60 () {60 vars in 1131 bytes} [Tue Aug 30 01:15:31 2022] POST /identity/v3/roles => generated 219 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:15:31.865235 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb606f0-9db5-4229-8728-31f5f0984284 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:31.897068 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 19/37] 10.222.0.60 () {60 vars in 1141 bytes} [Tue Aug 30 01:15:31 2022] POST /identity/v3/projects => generated 301 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:15:31.898672 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d459c-ed2e-4a35-9673-cc05c04d91f1 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:31.898971 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d459c-ed2e-4a35-9673-cc05c04d91f1 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:31.899359 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d459c-ed2e-4a35-9673-cc05c04d91f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:31.920335 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-619d459c-ed2e-4a35-9673-cc05c04d91f1 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:31.921961 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-619d459c-ed2e-4a35-9673-cc05c04d91f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:32.005091 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:32.008832 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 20/38] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:15:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:15:32.009725 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619d459c-ed2e-4a35-9673-cc05c04d91f1 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:32.013954 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb606f0-9db5-4229-8728-31f5f0984284 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:32.060685 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:32.087102 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2717f2bd-94c0-4fa1-a77a-fe8c47ca1961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:32.088233 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2717f2bd-94c0-4fa1-a77a-fe8c47ca1961 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:32.088233 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2717f2bd-94c0-4fa1-a77a-fe8c47ca1961 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:32.088427 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2717f2bd-94c0-4fa1-a77a-fe8c47ca1961 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:32.090121 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2717f2bd-94c0-4fa1-a77a-fe8c47ca1961 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:32.091769 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2717f2bd-94c0-4fa1-a77a-fe8c47ca1961 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:32.093520 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 19/39] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:15:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:32.094571 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf360a-66d1-40e4-acc0-0f79f8822717 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:32.094857 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf360a-66d1-40e4-acc0-0f79f8822717 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:32.095137 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf360a-66d1-40e4-acc0-0f79f8822717 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:32.097588 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 20/40] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:15:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:15:32.101310 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf360a-66d1-40e4-acc0-0f79f8822717 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:32.160170 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619d459c-ed2e-4a35-9673-cc05c04d91f1 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:32.200874 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e201b2-3a28-4c1f-8da5-7141e51f1c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:32.201512 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e201b2-3a28-4c1f-8da5-7141e51f1c5e None admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:32.201796 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e201b2-3a28-4c1f-8da5-7141e51f1c5e None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:32.202074 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e201b2-3a28-4c1f-8da5-7141e51f1c5e None admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:32.202770 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e201b2-3a28-4c1f-8da5-7141e51f1c5e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:32.204374 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e201b2-3a28-4c1f-8da5-7141e51f1c5e None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:32.222935 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 21/41] 10.222.0.60 () {60 vars in 1131 bytes} [Tue Aug 30 01:15:32 2022] POST /identity/v3/roles => generated 225 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:15:32.224582 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1570e51-5c93-489b-90e3-70bdc39929ca None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:32.224874 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1570e51-5c93-489b-90e3-70bdc39929ca None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:32.225152 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1570e51-5c93-489b-90e3-70bdc39929ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:32.250171 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-f1570e51-5c93-489b-90e3-70bdc39929ca None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:32.251466 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-f1570e51-5c93-489b-90e3-70bdc39929ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:32.346169 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 22/42] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:15:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:15:32.346939 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1570e51-5c93-489b-90e3-70bdc39929ca None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:32.362020 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf360a-66d1-40e4-acc0-0f79f8822717 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:32.377541 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:32.405708 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d6f426-e8a6-4dbb-8354-c224acf3fa40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:32.406378 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6f426-e8a6-4dbb-8354-c224acf3fa40 None admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:32.406662 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6f426-e8a6-4dbb-8354-c224acf3fa40 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:32.406938 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6f426-e8a6-4dbb-8354-c224acf3fa40 None admin] PATH_INFO: `/v3/domains/default/users/68ff671606954cb48c45e22d8978bcf2/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:32.416217 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d6f426-e8a6-4dbb-8354-c224acf3fa40 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=68ff671606954cb48c45e22d8978bcf2, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:32.417708 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d6f426-e8a6-4dbb-8354-c224acf3fa40 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:32.440134 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 21/43] 10.222.0.60 () {58 vars in 1361 bytes} [Tue Aug 30 01:15:32 2022] PUT /identity/v3/domains/default/users/68ff671606954cb48c45e22d8978bcf2/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:15:32.474557 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1570e51-5c93-489b-90e3-70bdc39929ca None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:32.513301 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa40544-f925-4ac5-9e8f-199e5c287461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:32.513930 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa40544-f925-4ac5-9e8f-199e5c287461 None admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:32.514213 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa40544-f925-4ac5-9e8f-199e5c287461 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:32.514489 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa40544-f925-4ac5-9e8f-199e5c287461 None admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:32.515183 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa40544-f925-4ac5-9e8f-199e5c287461 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:32.516639 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa40544-f925-4ac5-9e8f-199e5c287461 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:32.533084 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 23/44] 10.222.0.60 () {60 vars in 1131 bytes} [Tue Aug 30 01:15:32 2022] POST /identity/v3/roles => generated 223 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:15:32.640600 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d6f426-e8a6-4dbb-8354-c224acf3fa40 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:32.669676 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:32.751924 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d6f426-e8a6-4dbb-8354-c224acf3fa40 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:32.786223 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dada17b3-dad5-4cfa-a5c1-06392d672f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:32.786859 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada17b3-dad5-4cfa-a5c1-06392d672f04 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:32.787203 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada17b3-dad5-4cfa-a5c1-06392d672f04 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:32.787504 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada17b3-dad5-4cfa-a5c1-06392d672f04 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:32.788607 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dada17b3-dad5-4cfa-a5c1-06392d672f04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:32.790089 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dada17b3-dad5-4cfa-a5c1-06392d672f04 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:32.791701 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 22/45] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:15:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:32.797689 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa40544-f925-4ac5-9e8f-199e5c287461 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:32.874972 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:32.898123 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa40544-f925-4ac5-9e8f-199e5c287461 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:32.932870 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44961ea-6814-4576-aad9-6f0c6547533f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:32.933487 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44961ea-6814-4576-aad9-6f0c6547533f None admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:32.934061 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44961ea-6814-4576-aad9-6f0c6547533f None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:32.934358 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44961ea-6814-4576-aad9-6f0c6547533f None admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:32.935140 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44961ea-6814-4576-aad9-6f0c6547533f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:32.937139 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44961ea-6814-4576-aad9-6f0c6547533f None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:32.964274 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 24/46] 10.222.0.60 () {60 vars in 1141 bytes} [Tue Aug 30 01:15:32 2022] POST /identity/v3/projects => generated 312 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:15:34.374226 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c3b630-0933-4596-af6e-6e75709de970 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:34.374938 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c3b630-0933-4596-af6e-6e75709de970 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:34.374938 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c3b630-0933-4596-af6e-6e75709de970 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:34.377354 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 23/47] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:15:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:15:34.383122 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0e253-a476-4acb-8d55-9a5d24f3092e None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:34.383591 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0e253-a476-4acb-8d55-9a5d24f3092e None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:34.383720 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0e253-a476-4acb-8d55-9a5d24f3092e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:34.404199 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-e4e0e253-a476-4acb-8d55-9a5d24f3092e None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:34.405483 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-e4e0e253-a476-4acb-8d55-9a5d24f3092e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:34.471499 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 25/48] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:15:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:15:34.739127 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c3b630-0933-4596-af6e-6e75709de970 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:34.832378 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:34.843098 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c3b630-0933-4596-af6e-6e75709de970 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:34.877809 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7e703-3d8b-47a5-8dcd-6cd7f0439e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:34.878434 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7e703-3d8b-47a5-8dcd-6cd7f0439e9a None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:34.878716 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7e703-3d8b-47a5-8dcd-6cd7f0439e9a None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:34.878992 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7e703-3d8b-47a5-8dcd-6cd7f0439e9a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:34.884034 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c96b8-ea4c-4cc5-9e04-4b6e90de6837 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:34.884325 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c96b8-ea4c-4cc5-9e04-4b6e90de6837 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:34.884607 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c96b8-ea4c-4cc5-9e04-4b6e90de6837 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:34.885941 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 26/49] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:15:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:15:34.889804 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e7e703-3d8b-47a5-8dcd-6cd7f0439e9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:15:34.890842 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7925fb9-13e8-4dc6-bb8b-1f7aaf2ab12f None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:34.891131 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7925fb9-13e8-4dc6-bb8b-1f7aaf2ab12f None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:34.891412 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7925fb9-13e8-4dc6-bb8b-1f7aaf2ab12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:34.894779 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-b5e7e703-3d8b-47a5-8dcd-6cd7f0439e9a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:15:34.894779 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:15:34.894779 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:15:34.894779 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:15:34.894779 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:15:34.894779 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:15:34.894779 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:15:34.894779 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:15:34.894779 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:15:34.894779 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:15:34.894779 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:15:34.894779 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:15:34.894779 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:15:34.894779 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:15:34.894779 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:15:34.894779 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:15:34.895659 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:15:34.895659 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:15:34.895659 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:15:34.895659 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:15:34.895659 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:15:34.895659 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:15:34.895659 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:15:34.895659 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:15:34.895659 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:15:34.895659 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:15:34.895659 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:15:34.895659 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:15:34.895659 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:15:34.895659 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:15:34.895659 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:15:34.895659 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:15:34.896389 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:15:34.896389 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:15:34.896389 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:15:34.896389 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:15:34.896389 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:15:34.896389 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:15:34.896389 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:15:34.896389 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:15:34.896389 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:15:34.896389 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:15:34.896389 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:15:34.896389 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:15:34.896389 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 24/50] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 30 01:15:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:15:34.901808 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7e703-3d8b-47a5-8dcd-6cd7f0439e9a None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:34.912240 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-e7925fb9-13e8-4dc6-bb8b-1f7aaf2ab12f None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:34.913800 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-e7925fb9-13e8-4dc6-bb8b-1f7aaf2ab12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:34.970265 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:34.983258 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 27/51] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:15:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 01:15:35.002717 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7e703-3d8b-47a5-8dcd-6cd7f0439e9a None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:35.037206 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9942d47-5040-4b67-8687-b5295b9c7386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:35.037810 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9942d47-5040-4b67-8687-b5295b9c7386 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:35.038090 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9942d47-5040-4b67-8687-b5295b9c7386 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:35.038362 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9942d47-5040-4b67-8687-b5295b9c7386 None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:35.039027 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9942d47-5040-4b67-8687-b5295b9c7386 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:15:35.039330 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9942d47-5040-4b67-8687-b5295b9c7386 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:35.040763 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9942d47-5040-4b67-8687-b5295b9c7386 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:35.048725 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 25/52] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 30 01:15:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:15:35.054352 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7925fb9-13e8-4dc6-bb8b-1f7aaf2ab12f None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:35.157426 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7925fb9-13e8-4dc6-bb8b-1f7aaf2ab12f None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:35.191481 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eff97b-16ed-430c-af85-d38df1abc030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:35.192138 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eff97b-16ed-430c-af85-d38df1abc030 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:35.192419 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eff97b-16ed-430c-af85-d38df1abc030 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:35.192691 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eff97b-16ed-430c-af85-d38df1abc030 None admin] PATH_INFO: `/v3/users/68ff671606954cb48c45e22d8978bcf2` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:35.193802 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eff97b-16ed-430c-af85-d38df1abc030 None admin] RBAC: Authorizing `identity:get_user(user_id=68ff671606954cb48c45e22d8978bcf2)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:35.195246 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eff97b-16ed-430c-af85-d38df1abc030 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:35.197017 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 28/53] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 30 01:15:35 2022] GET /identity/v3/users/68ff671606954cb48c45e22d8978bcf2 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:35.202577 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9942d47-5040-4b67-8687-b5295b9c7386 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:35.219705 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:35.248828 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eff97b-16ed-430c-af85-d38df1abc030 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:35.305715 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9942d47-5040-4b67-8687-b5295b9c7386 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:35.342615 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ebc99-3787-439d-ae73-fece46781e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:35.343264 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ebc99-3787-439d-ae73-fece46781e6d None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:35.343580 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ebc99-3787-439d-ae73-fece46781e6d None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:35.343854 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ebc99-3787-439d-ae73-fece46781e6d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:35.344997 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2ebc99-3787-439d-ae73-fece46781e6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:35.346493 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2ebc99-3787-439d-ae73-fece46781e6d None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:35.348249 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 26/54] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:15:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:35.354421 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ebc99-3787-439d-ae73-fece46781e6d None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:35.410436 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:35.437998 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:35.453683 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eff97b-16ed-430c-af85-d38df1abc030 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:35.456316 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ebc99-3787-439d-ae73-fece46781e6d None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:35.487734 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4fe961-d916-44f4-9b05-7c76a5f8e660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:35.488368 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4fe961-d916-44f4-9b05-7c76a5f8e660 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:35.488650 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4fe961-d916-44f4-9b05-7c76a5f8e660 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:35.489521 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4fe961-d916-44f4-9b05-7c76a5f8e660 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:35.490546 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff230b8b-8698-4eea-ad4e-950ed9eab7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:35.490657 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4fe961-d916-44f4-9b05-7c76a5f8e660 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:35.491153 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff230b8b-8698-4eea-ad4e-950ed9eab7a7 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:35.491456 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff230b8b-8698-4eea-ad4e-950ed9eab7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:35.491745 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff230b8b-8698-4eea-ad4e-950ed9eab7a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:35.492098 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4fe961-d916-44f4-9b05-7c76a5f8e660 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:35.492474 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff230b8b-8698-4eea-ad4e-950ed9eab7a7 None admin] RBAC: Adding query filter params (role.id=f6bc03b6972e420eb338ee7fd1443974, scope.domain.id=default, user.id=68ff671606954cb48c45e22d8978bcf2) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:15:35.492992 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff230b8b-8698-4eea-ad4e-950ed9eab7a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:35.493678 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 29/55] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:15:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:15:35.494311 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff230b8b-8698-4eea-ad4e-950ed9eab7a7 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:35.499124 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4fe961-d916-44f4-9b05-7c76a5f8e660 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:35.501662 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 27/56] 10.222.0.60 () {56 vars in 1322 bytes} [Tue Aug 30 01:15:35 2022] GET /identity/v3/role_assignments?user.id=68ff671606954cb48c45e22d8978bcf2&scope.domain.id=default&role.id=f6bc03b6972e420eb338ee7fd1443974 => generated 530 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:15:35.605634 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4fe961-d916-44f4-9b05-7c76a5f8e660 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:35.632861 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:35.643204 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e168f6b0-877d-4a7c-8927-52ab88772906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:35.643204 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e168f6b0-877d-4a7c-8927-52ab88772906 None admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:35.643204 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e168f6b0-877d-4a7c-8927-52ab88772906 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:35.643514 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e168f6b0-877d-4a7c-8927-52ab88772906 None admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:35.643957 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e168f6b0-877d-4a7c-8927-52ab88772906 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:35.645396 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e168f6b0-877d-4a7c-8927-52ab88772906 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:35.673021 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 30/57] 10.222.0.60 () {60 vars in 1140 bytes} [Tue Aug 30 01:15:35 2022] POST /identity/v3/projects => generated 298 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:15:37.609698 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e59dfd7-237c-4d45-9ba9-c05130aca217 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:37.610095 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e59dfd7-237c-4d45-9ba9-c05130aca217 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:37.610257 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e59dfd7-237c-4d45-9ba9-c05130aca217 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:37.611648 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 28/58] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:15:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:15:37.617653 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c1513a-d24c-4b6f-a3a5-a7cea5c8bbf5 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:37.618049 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c1513a-d24c-4b6f-a3a5-a7cea5c8bbf5 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:37.618210 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c1513a-d24c-4b6f-a3a5-a7cea5c8bbf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:37.635830 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-a2c1513a-d24c-4b6f-a3a5-a7cea5c8bbf5 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:37.637026 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-a2c1513a-d24c-4b6f-a3a5-a7cea5c8bbf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:37.701335 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 31/59] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:15:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:15:37.970232 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e59dfd7-237c-4d45-9ba9-c05130aca217 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:38.070651 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e59dfd7-237c-4d45-9ba9-c05130aca217 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:38.103883 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bba855-8a3b-424d-bcb6-58a57f3d3959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:38.104501 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bba855-8a3b-424d-bcb6-58a57f3d3959 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:38.104784 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bba855-8a3b-424d-bcb6-58a57f3d3959 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:38.105058 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bba855-8a3b-424d-bcb6-58a57f3d3959 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:38.106155 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bba855-8a3b-424d-bcb6-58a57f3d3959 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:38.107629 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bba855-8a3b-424d-bcb6-58a57f3d3959 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:38.109185 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 29/60] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:15:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:38.114714 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c1513a-d24c-4b6f-a3a5-a7cea5c8bbf5 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:38.212082 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c1513a-d24c-4b6f-a3a5-a7cea5c8bbf5 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:38.220847 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:38.246208 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284de747-c37c-4c28-ad26-8f40dad3f5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:38.246810 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284de747-c37c-4c28-ad26-8f40dad3f5b0 None admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:38.247092 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284de747-c37c-4c28-ad26-8f40dad3f5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:38.247367 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284de747-c37c-4c28-ad26-8f40dad3f5b0 None admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:38.248041 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284de747-c37c-4c28-ad26-8f40dad3f5b0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:38.249493 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284de747-c37c-4c28-ad26-8f40dad3f5b0 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:38.275763 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 32/61] 10.222.0.60 () {60 vars in 1132 bytes} [Tue Aug 30 01:15:38 2022] POST /identity/v3/users => generated 275 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:15:41.177362 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b7fe9b-73cf-4738-b239-41c4d5b64929 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:41.178389 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b7fe9b-73cf-4738-b239-41c4d5b64929 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:41.178881 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b7fe9b-73cf-4738-b239-41c4d5b64929 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:41.180479 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 30/62] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:15:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:15:41.185870 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6547a1-f95b-432f-8599-4ce5b76cfe28 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:41.186715 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6547a1-f95b-432f-8599-4ce5b76cfe28 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:41.187193 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6547a1-f95b-432f-8599-4ce5b76cfe28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:41.205714 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-ed6547a1-f95b-432f-8599-4ce5b76cfe28 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:41.207275 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-ed6547a1-f95b-432f-8599-4ce5b76cfe28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:41.302859 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 33/63] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:15:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:15:41.470832 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c1012d-78fa-42d5-8715-f94fde416293 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:41.471455 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c1012d-78fa-42d5-8715-f94fde416293 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:41.471935 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c1012d-78fa-42d5-8715-f94fde416293 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:41.474083 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 31/64] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:15:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:15:41.479657 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa59b5f-4d92-4741-a267-8f37227e5761 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:41.480237 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa59b5f-4d92-4741-a267-8f37227e5761 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:41.480715 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa59b5f-4d92-4741-a267-8f37227e5761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:41.508491 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-eaa59b5f-4d92-4741-a267-8f37227e5761 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:41.510030 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-eaa59b5f-4d92-4741-a267-8f37227e5761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:41.591579 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 34/65] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:15:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:15:41.653287 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c1012d-78fa-42d5-8715-f94fde416293 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:41.674632 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90971c7e-388d-4692-8199-6fef1d45c313 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:41.675297 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:41.675822 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90971c7e-388d-4692-8199-6fef1d45c313 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:41.677330 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90971c7e-388d-4692-8199-6fef1d45c313 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:41.679232 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 35/66] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:15:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:15:41.684463 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f597f44-b99c-4ff5-ab5d-25df7f1da4ac None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:41.684757 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f597f44-b99c-4ff5-ab5d-25df7f1da4ac None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:41.685039 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f597f44-b99c-4ff5-ab5d-25df7f1da4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:41.715759 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-3f597f44-b99c-4ff5-ab5d-25df7f1da4ac None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:41.716969 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-3f597f44-b99c-4ff5-ab5d-25df7f1da4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:41.766073 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:41.831508 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c1012d-78fa-42d5-8715-f94fde416293 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:41.835354 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 36/67] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:15:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 01:15:41.837144 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84e0fd-d81d-4156-99c4-f86810157481 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:41.837590 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84e0fd-d81d-4156-99c4-f86810157481 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:41.838032 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84e0fd-d81d-4156-99c4-f86810157481 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:41.840077 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 37/68] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:15:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:15:41.850113 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71103a0-9405-4ff6-80a1-aaee234ce451 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:41.850598 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71103a0-9405-4ff6-80a1-aaee234ce451 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:41.851099 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71103a0-9405-4ff6-80a1-aaee234ce451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:41.877975 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-a71103a0-9405-4ff6-80a1-aaee234ce451 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:41.879537 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-a71103a0-9405-4ff6-80a1-aaee234ce451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:41.888431 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f9ddde-df13-45fd-b805-11ef51da3a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:41.888821 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f9ddde-df13-45fd-b805-11ef51da3a7d None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:41.889108 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f9ddde-df13-45fd-b805-11ef51da3a7d None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:41.889382 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f9ddde-df13-45fd-b805-11ef51da3a7d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:41.909186 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f9ddde-df13-45fd-b805-11ef51da3a7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:15:41.914841 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-c8f9ddde-df13-45fd-b805-11ef51da3a7d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 01:15:41.914841 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:15:41.914841 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:15:41.914841 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:15:41.914841 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:15:41.914841 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:15:41.914841 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:15:41.914841 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:15:41.914841 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:15:41.914841 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:15:41.914841 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:15:41.914841 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:15:41.914841 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:15:41.914841 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:15:41.914841 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:15:41.914841 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:15:41.915749 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:15:41.915749 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:15:41.915749 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:15:41.915749 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:15:41.915749 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:15:41.915749 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:15:41.915749 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:15:41.915749 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:15:41.915749 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:15:41.915749 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:15:41.915749 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:15:41.915749 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:15:41.915749 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:15:41.915749 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:15:41.915749 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:15:41.915749 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:15:41.916547 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:15:41.916547 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:15:41.916547 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:15:41.916547 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:15:41.916547 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:15:41.916547 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:15:41.916547 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:15:41.916547 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:15:41.916547 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:15:41.916547 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:15:41.916547 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 01:15:41.916547 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:15:41.916547 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 32/69] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 30 01:15:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:15:41.917160 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f9ddde-df13-45fd-b805-11ef51da3a7d None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:41.962050 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 38/70] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:15:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:15:41.963323 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71103a0-9405-4ff6-80a1-aaee234ce451 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:41.998460 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:42.048887 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f9ddde-df13-45fd-b805-11ef51da3a7d None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:42.056519 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:42.074459 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71103a0-9405-4ff6-80a1-aaee234ce451 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:42.093662 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa72304-0d94-40ba-859a-af4a3f64f742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:42.094303 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa72304-0d94-40ba-859a-af4a3f64f742 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:42.094587 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa72304-0d94-40ba-859a-af4a3f64f742 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:42.094860 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa72304-0d94-40ba-859a-af4a3f64f742 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:42.105288 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa72304-0d94-40ba-859a-af4a3f64f742 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:15:42.110734 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-caa72304-0d94-40ba-859a-af4a3f64f742 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:15:42.110734 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:15:42.110734 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:15:42.110734 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:15:42.110734 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:15:42.110734 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:15:42.110734 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:15:42.110734 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:15:42.110734 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:15:42.110734 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:15:42.110734 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:15:42.110734 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:15:42.110734 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:15:42.110734 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:15:42.110734 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:15:42.110734 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:15:42.111608 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:15:42.111608 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:15:42.111608 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:15:42.111608 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:15:42.111608 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:15:42.111608 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:15:42.111608 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:15:42.111608 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:15:42.111608 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:15:42.111608 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:15:42.111608 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:15:42.111608 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:15:42.111608 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:15:42.111608 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:15:42.111608 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:15:42.111608 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:15:42.112385 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:15:42.112385 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:15:42.112385 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:15:42.112385 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:15:42.112385 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:15:42.112385 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:15:42.112385 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:15:42.112385 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:15:42.112385 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:15:42.112385 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:15:42.112385 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:15:42.112385 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:15:42.112385 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 33/71] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 30 01:15:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:15:42.113462 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74362165-b95a-4928-b8a9-c62c37c1476d None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:42.113462 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74362165-b95a-4928-b8a9-c62c37c1476d None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:42.113643 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74362165-b95a-4928-b8a9-c62c37c1476d None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:42.114969 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 34/72] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:15:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:15:42.117585 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099ce8e2-15a8-4558-b4bd-649df16fa434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:42.118434 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ce8e2-15a8-4558-b4bd-649df16fa434 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:42.118912 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ce8e2-15a8-4558-b4bd-649df16fa434 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:42.119381 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ce8e2-15a8-4558-b4bd-649df16fa434 None admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:42.119588 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74362165-b95a-4928-b8a9-c62c37c1476d None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:42.120556 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099ce8e2-15a8-4558-b4bd-649df16fa434 None admin] RBAC: Adding query filter params (name=member) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:15:42.121091 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099ce8e2-15a8-4558-b4bd-649df16fa434 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:42.122687 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099ce8e2-15a8-4558-b4bd-649df16fa434 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:42.136723 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 39/73] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Aug 30 01:15:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:42.138342 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5cdecd-5d86-4bc4-9de3-29687e7049d8 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:42.138824 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5cdecd-5d86-4bc4-9de3-29687e7049d8 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:42.139293 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5cdecd-5d86-4bc4-9de3-29687e7049d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:42.159138 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-0c5cdecd-5d86-4bc4-9de3-29687e7049d8 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:42.160875 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-0c5cdecd-5d86-4bc4-9de3-29687e7049d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:42.232585 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 40/74] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:15:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:15:42.233384 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5cdecd-5d86-4bc4-9de3-29687e7049d8 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:42.237636 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74362165-b95a-4928-b8a9-c62c37c1476d None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:42.275636 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534fd9b6-6aef-4313-9205-7b01749c9f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:42.276304 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534fd9b6-6aef-4313-9205-7b01749c9f3a None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:42.276590 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534fd9b6-6aef-4313-9205-7b01749c9f3a None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:42.276866 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534fd9b6-6aef-4313-9205-7b01749c9f3a None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:42.277540 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534fd9b6-6aef-4313-9205-7b01749c9f3a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:15:42.277847 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534fd9b6-6aef-4313-9205-7b01749c9f3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:42.279332 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534fd9b6-6aef-4313-9205-7b01749c9f3a None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:42.281281 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:42.289673 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 35/75] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 30 01:15:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:42.290473 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534fd9b6-6aef-4313-9205-7b01749c9f3a None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:42.316619 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:42.342856 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5cdecd-5d86-4bc4-9de3-29687e7049d8 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:42.380982 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a699b94f-85eb-430c-b606-7e3291352faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:42.381615 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699b94f-85eb-430c-b606-7e3291352faa None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:42.381898 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699b94f-85eb-430c-b606-7e3291352faa None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:42.382172 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699b94f-85eb-430c-b606-7e3291352faa None admin] PATH_INFO: `/v3/users/40d2c2b96e7d483aba514a9499f4459d` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:42.398474 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a699b94f-85eb-430c-b606-7e3291352faa None admin] RBAC: Authorizing `identity:get_user(user_id=40d2c2b96e7d483aba514a9499f4459d)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:42.399386 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534fd9b6-6aef-4313-9205-7b01749c9f3a None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:42.399977 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a699b94f-85eb-430c-b606-7e3291352faa None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:42.401618 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 41/76] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 30 01:15:42 2022] GET /identity/v3/users/40d2c2b96e7d483aba514a9499f4459d => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:42.402387 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a699b94f-85eb-430c-b606-7e3291352faa None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:42.442657 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a19448c-9130-4d32-9ee9-8767a4b3f02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:42.443739 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19448c-9130-4d32-9ee9-8767a4b3f02d None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:42.444220 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19448c-9130-4d32-9ee9-8767a4b3f02d None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:42.444690 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19448c-9130-4d32-9ee9-8767a4b3f02d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:42.456001 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a19448c-9130-4d32-9ee9-8767a4b3f02d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:15:42.461893 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-3a19448c-9130-4d32-9ee9-8767a4b3f02d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 01:15:42.461893 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:15:42.461893 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:15:42.461893 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:15:42.461893 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:15:42.461893 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:15:42.461893 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:15:42.461893 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:15:42.461893 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:15:42.461893 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:15:42.461893 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:15:42.461893 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:15:42.461893 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:15:42.461893 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:15:42.461893 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:15:42.461893 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:15:42.462730 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:15:42.462730 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:15:42.462730 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:15:42.462730 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:15:42.462730 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:15:42.462730 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:15:42.462730 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:15:42.462730 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:15:42.462730 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:15:42.462730 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:15:42.462730 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:15:42.462730 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:15:42.462730 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:15:42.462730 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:15:42.462730 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:15:42.462730 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:15:42.463508 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:15:42.463508 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:15:42.463508 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:15:42.463508 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:15:42.463508 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:15:42.463508 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:15:42.463508 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:15:42.463508 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:15:42.463508 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:15:42.463508 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:15:42.463508 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 01:15:42.463508 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:15:42.466107 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 36/77] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Aug 30 01:15:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:15:42.467108 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a19448c-9130-4d32-9ee9-8767a4b3f02d None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:42.518331 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a699b94f-85eb-430c-b606-7e3291352faa None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:42.533754 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:42.553531 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5381d6ba-8248-4938-9e9a-dd7b786bdb62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:42.554163 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5381d6ba-8248-4938-9e9a-dd7b786bdb62 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:42.554443 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5381d6ba-8248-4938-9e9a-dd7b786bdb62 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:42.554714 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5381d6ba-8248-4938-9e9a-dd7b786bdb62 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:42.556930 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:42.566167 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5381d6ba-8248-4938-9e9a-dd7b786bdb62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:15:42.571173 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-5381d6ba-8248-4938-9e9a-dd7b786bdb62 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 01:15:42.571173 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:15:42.571173 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:15:42.571173 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:15:42.571173 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:15:42.571173 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:15:42.571173 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:15:42.571173 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:15:42.571173 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:15:42.571173 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:15:42.571173 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:15:42.571173 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:15:42.571173 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:15:42.571173 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:15:42.571173 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:15:42.571173 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:15:42.572086 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:15:42.572086 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:15:42.572086 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:15:42.572086 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:15:42.572086 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:15:42.572086 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:15:42.572086 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:15:42.572086 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:15:42.572086 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:15:42.572086 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:15:42.572086 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:15:42.572086 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:15:42.572086 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:15:42.572086 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:15:42.572086 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:15:42.572086 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:15:42.572836 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:15:42.572836 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:15:42.572836 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:15:42.572836 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:15:42.572836 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:15:42.572836 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:15:42.572836 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:15:42.572836 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:15:42.572836 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:15:42.572836 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:15:42.572836 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 01:15:42.572836 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:15:42.572836 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 42/78] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 30 01:15:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:15:42.573467 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5381d6ba-8248-4938-9e9a-dd7b786bdb62 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:42.581483 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a19448c-9130-4d32-9ee9-8767a4b3f02d None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:42.618646 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4cb53e-75e6-4ff6-ab66-8d52a7f229ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:42.619293 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4cb53e-75e6-4ff6-ab66-8d52a7f229ba None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:42.619606 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4cb53e-75e6-4ff6-ab66-8d52a7f229ba None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:42.619887 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4cb53e-75e6-4ff6-ab66-8d52a7f229ba None admin] PATH_INFO: `/v3/users/68ff671606954cb48c45e22d8978bcf2` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:42.621018 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4cb53e-75e6-4ff6-ab66-8d52a7f229ba None admin] RBAC: Authorizing `identity:get_user(user_id=68ff671606954cb48c45e22d8978bcf2)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:42.622476 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4cb53e-75e6-4ff6-ab66-8d52a7f229ba None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:42.624085 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 37/79] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 30 01:15:42 2022] GET /identity/v3/users/68ff671606954cb48c45e22d8978bcf2 => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:42.628357 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4cb53e-75e6-4ff6-ab66-8d52a7f229ba None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:42.675446 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5381d6ba-8248-4938-9e9a-dd7b786bdb62 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:42.709741 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39879692-3e45-4e4e-8a2e-69639e5b7c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:42.710707 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39879692-3e45-4e4e-8a2e-69639e5b7c73 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:42.711140 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39879692-3e45-4e4e-8a2e-69639e5b7c73 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:42.711419 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39879692-3e45-4e4e-8a2e-69639e5b7c73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:42.728136 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4cb53e-75e6-4ff6-ab66-8d52a7f229ba None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:42.761873 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:42.771466 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:42.773572 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5f2a7-0737-4e97-99ba-e5405884d053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:42.774184 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5f2a7-0737-4e97-99ba-e5405884d053 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:42.774471 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5f2a7-0737-4e97-99ba-e5405884d053 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:42.774746 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5f2a7-0737-4e97-99ba-e5405884d053 None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:42.775410 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e5f2a7-0737-4e97-99ba-e5405884d053 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:15:42.775866 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e5f2a7-0737-4e97-99ba-e5405884d053 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:42.777266 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e5f2a7-0737-4e97-99ba-e5405884d053 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:42.779267 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39879692-3e45-4e4e-8a2e-69639e5b7c73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:42.780792 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39879692-3e45-4e4e-8a2e-69639e5b7c73 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:42.785380 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 38/80] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 30 01:15:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:42.786732 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5f2a7-0737-4e97-99ba-e5405884d053 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:42.884784 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 43/81] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 30 01:15:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:42.889519 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39879692-3e45-4e4e-8a2e-69639e5b7c73 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:42.893736 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5f2a7-0737-4e97-99ba-e5405884d053 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:42.926716 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fafb52-785c-4ecc-ba55-21d8511c32e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:42.927345 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fafb52-785c-4ecc-ba55-21d8511c32e9 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:42.927649 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fafb52-785c-4ecc-ba55-21d8511c32e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:42.927921 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fafb52-785c-4ecc-ba55-21d8511c32e9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:42.929024 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fafb52-785c-4ecc-ba55-21d8511c32e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:42.930567 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fafb52-785c-4ecc-ba55-21d8511c32e9 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:42.932150 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 39/82] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:15:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:42.932150 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fafb52-785c-4ecc-ba55-21d8511c32e9 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:42.977501 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:42.984227 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39879692-3e45-4e4e-8a2e-69639e5b7c73 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:42.988231 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:43.018131 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d840b-8785-4b8e-b029-53716f6aa127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:43.018742 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d840b-8785-4b8e-b029-53716f6aa127 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:43.019018 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d840b-8785-4b8e-b029-53716f6aa127 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:43.019288 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d840b-8785-4b8e-b029-53716f6aa127 None admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:43.020595 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63d840b-8785-4b8e-b029-53716f6aa127 None admin] RBAC: Adding query filter params (name=member) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:15:43.020902 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63d840b-8785-4b8e-b029-53716f6aa127 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:43.022273 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63d840b-8785-4b8e-b029-53716f6aa127 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:43.031937 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 44/83] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Aug 30 01:15:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:43.032750 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d840b-8785-4b8e-b029-53716f6aa127 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:43.040074 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fafb52-785c-4ecc-ba55-21d8511c32e9 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:43.079748 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ab99a-3038-43f5-b24d-0817a3fb7cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:43.080363 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ab99a-3038-43f5-b24d-0817a3fb7cab None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:43.080644 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ab99a-3038-43f5-b24d-0817a3fb7cab None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:43.080918 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ab99a-3038-43f5-b24d-0817a3fb7cab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:43.135801 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d840b-8785-4b8e-b029-53716f6aa127 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:43.149530 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7ab99a-3038-43f5-b24d-0817a3fb7cab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:43.151013 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7ab99a-3038-43f5-b24d-0817a3fb7cab None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:43.169636 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95de72b1-9c36-4fce-9825-630e89f73a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:43.170271 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de72b1-9c36-4fce-9825-630e89f73a8f None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:43.170552 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de72b1-9c36-4fce-9825-630e89f73a8f None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:43.170836 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de72b1-9c36-4fce-9825-630e89f73a8f None admin] PATH_INFO: `/v3/users/40d2c2b96e7d483aba514a9499f4459d` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:43.172000 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95de72b1-9c36-4fce-9825-630e89f73a8f None admin] RBAC: Authorizing `identity:get_user(user_id=40d2c2b96e7d483aba514a9499f4459d)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:43.173444 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95de72b1-9c36-4fce-9825-630e89f73a8f None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:43.175034 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 45/84] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 30 01:15:43 2022] GET /identity/v3/users/40d2c2b96e7d483aba514a9499f4459d => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:43.175820 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95de72b1-9c36-4fce-9825-630e89f73a8f None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:43.206961 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:43.211616 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:43.257180 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 40/85] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 30 01:15:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:43.257997 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ab99a-3038-43f5-b24d-0817a3fb7cab None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:43.286704 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95de72b1-9c36-4fce-9825-630e89f73a8f None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:43.323966 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c331cee-8c06-4d77-9423-a560d1c09c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:43.324697 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c331cee-8c06-4d77-9423-a560d1c09c05 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:43.325166 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c331cee-8c06-4d77-9423-a560d1c09c05 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:43.325638 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c331cee-8c06-4d77-9423-a560d1c09c05 None admin] PATH_INFO: `/v3/projects/023703a6c5664626b371621981c1b1ba` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:43.326952 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c331cee-8c06-4d77-9423-a560d1c09c05 None admin] RBAC: Authorizing `identity:get_project(project_id=023703a6c5664626b371621981c1b1ba)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:43.328439 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c331cee-8c06-4d77-9423-a560d1c09c05 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:43.330073 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 46/86] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 30 01:15:43 2022] GET /identity/v3/projects/023703a6c5664626b371621981c1b1ba => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:43.330838 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c331cee-8c06-4d77-9423-a560d1c09c05 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:43.365674 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ab99a-3038-43f5-b24d-0817a3fb7cab None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:43.401491 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54abd83c-1f95-44ee-a76d-100b68ea9eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:43.402022 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54abd83c-1f95-44ee-a76d-100b68ea9eae None admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:43.402302 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54abd83c-1f95-44ee-a76d-100b68ea9eae None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:43.402576 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54abd83c-1f95-44ee-a76d-100b68ea9eae None admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:43.403230 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54abd83c-1f95-44ee-a76d-100b68ea9eae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:43.404711 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54abd83c-1f95-44ee-a76d-100b68ea9eae None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:43.423743 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:43.432508 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 41/87] 10.222.0.60 () {60 vars in 1132 bytes} [Tue Aug 30 01:15:43 2022] POST /identity/v3/users => generated 289 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:15:43.433329 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54abd83c-1f95-44ee-a76d-100b68ea9eae None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:43.433578 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c331cee-8c06-4d77-9423-a560d1c09c05 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:43.468058 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:43.473113 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b9cef-a556-47d4-9b96-22bf47f11ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:43.473766 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b9cef-a556-47d4-9b96-22bf47f11ee6 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:43.474068 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b9cef-a556-47d4-9b96-22bf47f11ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:43.474334 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b9cef-a556-47d4-9b96-22bf47f11ee6 None admin] PATH_INFO: `/v3/users/40d2c2b96e7d483aba514a9499f4459d` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:43.475756 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9b9cef-a556-47d4-9b96-22bf47f11ee6 None admin] RBAC: Authorizing `identity:get_user(user_id=40d2c2b96e7d483aba514a9499f4459d)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:43.477218 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9b9cef-a556-47d4-9b96-22bf47f11ee6 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:43.478838 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 47/88] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 30 01:15:43 2022] GET /identity/v3/users/40d2c2b96e7d483aba514a9499f4459d => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:43.479650 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b9cef-a556-47d4-9b96-22bf47f11ee6 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:43.579796 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54abd83c-1f95-44ee-a76d-100b68ea9eae None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:43.607994 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b9cef-a556-47d4-9b96-22bf47f11ee6 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:43.627330 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a36db-7a6e-4d8c-89c8-50dee99c11f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:43.627976 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a36db-7a6e-4d8c-89c8-50dee99c11f4 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:43.628262 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a36db-7a6e-4d8c-89c8-50dee99c11f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:43.631394 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a36db-7a6e-4d8c-89c8-50dee99c11f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:43.646445 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c040f-e547-4b86-9ceb-03aaf6699ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:43.647368 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c040f-e547-4b86-9ceb-03aaf6699ad9 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:43.647368 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c040f-e547-4b86-9ceb-03aaf6699ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:43.647693 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c040f-e547-4b86-9ceb-03aaf6699ad9 None admin] PATH_INFO: `/v3/projects/023703a6c5664626b371621981c1b1ba` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:43.648825 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c040f-e547-4b86-9ceb-03aaf6699ad9 None admin] RBAC: Authorizing `identity:get_project(project_id=023703a6c5664626b371621981c1b1ba)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:43.650273 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c040f-e547-4b86-9ceb-03aaf6699ad9 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:43.652436 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 48/89] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 30 01:15:43 2022] GET /identity/v3/projects/023703a6c5664626b371621981c1b1ba => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:43.652736 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c040f-e547-4b86-9ceb-03aaf6699ad9 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:43.693758 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:43.720593 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3a36db-7a6e-4d8c-89c8-50dee99c11f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:43.722091 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3a36db-7a6e-4d8c-89c8-50dee99c11f4 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:43.739813 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:43.785231 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c040f-e547-4b86-9ceb-03aaf6699ad9 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:43.834876 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e9c1ab-f5c8-40fc-9222-834add1473a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:43.835530 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9c1ab-f5c8-40fc-9222-834add1473a5 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:43.835818 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9c1ab-f5c8-40fc-9222-834add1473a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:43.836099 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9c1ab-f5c8-40fc-9222-834add1473a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:43.837104 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e9c1ab-f5c8-40fc-9222-834add1473a5 None admin] RBAC: Adding query filter params (role.id=5b38bd827c5847969c4ee48e27261f5b, scope.project.id=023703a6c5664626b371621981c1b1ba, user.id=40d2c2b96e7d483aba514a9499f4459d) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:15:43.837431 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e9c1ab-f5c8-40fc-9222-834add1473a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:43.839589 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e9c1ab-f5c8-40fc-9222-834add1473a5 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:43.842541 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 42/90] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 30 01:15:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:43.843688 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a36db-7a6e-4d8c-89c8-50dee99c11f4 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:43.845745 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 49/91] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 30 01:15:43 2022] GET /identity/v3/role_assignments?user.id=40d2c2b96e7d483aba514a9499f4459d&scope.project.id=023703a6c5664626b371621981c1b1ba&role.id=5b38bd827c5847969c4ee48e27261f5b => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:43.846836 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e9c1ab-f5c8-40fc-9222-834add1473a5 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:43.958367 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a36db-7a6e-4d8c-89c8-50dee99c11f4 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:43.974258 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:43.987032 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:44.001237 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e9c1ab-f5c8-40fc-9222-834add1473a5 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:44.033229 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19906811-7b45-468d-9eba-7d629687e980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:44.033859 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19906811-7b45-468d-9eba-7d629687e980 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:44.034140 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19906811-7b45-468d-9eba-7d629687e980 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:44.034417 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19906811-7b45-468d-9eba-7d629687e980 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:44.048894 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c949946f-b725-458b-b0d9-229ad15c2283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:44.049959 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949946f-b725-458b-b0d9-229ad15c2283 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:44.050402 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949946f-b725-458b-b0d9-229ad15c2283 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:44.050826 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949946f-b725-458b-b0d9-229ad15c2283 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:44.051649 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c949946f-b725-458b-b0d9-229ad15c2283 None admin] RBAC: Adding query filter params (role.id=f6bc03b6972e420eb338ee7fd1443974, scope.project.id=023703a6c5664626b371621981c1b1ba, user.id=68ff671606954cb48c45e22d8978bcf2) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:15:44.052205 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c949946f-b725-458b-b0d9-229ad15c2283 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:44.053714 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c949946f-b725-458b-b0d9-229ad15c2283 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:44.060443 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 50/92] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 30 01:15:43 2022] GET /identity/v3/role_assignments?user.id=68ff671606954cb48c45e22d8978bcf2&scope.project.id=023703a6c5664626b371621981c1b1ba&role.id=f6bc03b6972e420eb338ee7fd1443974 => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:44.061844 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c949946f-b725-458b-b0d9-229ad15c2283 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:44.181927 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19906811-7b45-468d-9eba-7d629687e980 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:44.183804 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19906811-7b45-468d-9eba-7d629687e980 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:44.199496 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c949946f-b725-458b-b0d9-229ad15c2283 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:44.244020 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da644ff-d607-4ee9-96fb-854a41510067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:44.244598 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da644ff-d607-4ee9-96fb-854a41510067 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:44.244887 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da644ff-d607-4ee9-96fb-854a41510067 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:44.245169 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da644ff-d607-4ee9-96fb-854a41510067 None admin] PATH_INFO: `/v3/projects/023703a6c5664626b371621981c1b1ba` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:44.246481 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da644ff-d607-4ee9-96fb-854a41510067 None admin] RBAC: Authorizing `identity:get_project(project_id=023703a6c5664626b371621981c1b1ba)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:44.248177 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da644ff-d607-4ee9-96fb-854a41510067 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:44.250214 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 51/93] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 30 01:15:44 2022] GET /identity/v3/projects/023703a6c5664626b371621981c1b1ba => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:44.257299 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da644ff-d607-4ee9-96fb-854a41510067 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:44.327854 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:44.387182 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da644ff-d607-4ee9-96fb-854a41510067 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:44.431724 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9864f90f-fa38-4615-a42d-6bc911137925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:44.432350 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864f90f-fa38-4615-a42d-6bc911137925 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:44.432633 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864f90f-fa38-4615-a42d-6bc911137925 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:44.432908 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864f90f-fa38-4615-a42d-6bc911137925 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:44.434136 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9864f90f-fa38-4615-a42d-6bc911137925 None admin] RBAC: Adding query filter params (role.id=449624f20ef248ef97aeceba5b22eccd, scope.project.id=023703a6c5664626b371621981c1b1ba, user.id=40d2c2b96e7d483aba514a9499f4459d) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:15:44.434511 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9864f90f-fa38-4615-a42d-6bc911137925 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:44.436170 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9864f90f-fa38-4615-a42d-6bc911137925 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:44.439052 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 43/94] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 30 01:15:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 596 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:44.445293 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19906811-7b45-468d-9eba-7d629687e980 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:44.446723 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 52/95] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 30 01:15:44 2022] GET /identity/v3/role_assignments?user.id=40d2c2b96e7d483aba514a9499f4459d&scope.project.id=023703a6c5664626b371621981c1b1ba&role.id=449624f20ef248ef97aeceba5b22eccd => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:44.468344 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:44.594634 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19906811-7b45-468d-9eba-7d629687e980 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:44.653353 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6428cf-f02d-4eee-9111-14342c42e84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:44.654014 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6428cf-f02d-4eee-9111-14342c42e84c None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:44.654293 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6428cf-f02d-4eee-9111-14342c42e84c None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:44.654561 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6428cf-f02d-4eee-9111-14342c42e84c None admin] PATH_INFO: `/v3/projects/461a99523fbb4b2abff004235ad031d8` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:44.655742 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6428cf-f02d-4eee-9111-14342c42e84c None admin] RBAC: Authorizing `identity:get_project(project_id=461a99523fbb4b2abff004235ad031d8)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:44.657242 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6428cf-f02d-4eee-9111-14342c42e84c None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:44.658877 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 44/96] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 30 01:15:44 2022] GET /identity/v3/projects/461a99523fbb4b2abff004235ad031d8 => generated 312 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:15:44.665198 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9864f90f-fa38-4615-a42d-6bc911137925 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:44.765676 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:44.778352 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9864f90f-fa38-4615-a42d-6bc911137925 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:44.815381 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62dd005-2009-4817-b366-e085fd60b97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:44.816032 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62dd005-2009-4817-b366-e085fd60b97d None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:44.816311 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62dd005-2009-4817-b366-e085fd60b97d None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:44.816578 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62dd005-2009-4817-b366-e085fd60b97d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:44.817877 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62dd005-2009-4817-b366-e085fd60b97d None admin] RBAC: Adding query filter params (role.id=5b38bd827c5847969c4ee48e27261f5b, scope.project.id=461a99523fbb4b2abff004235ad031d8, user.id=40d2c2b96e7d483aba514a9499f4459d) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:15:44.818245 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62dd005-2009-4817-b366-e085fd60b97d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:44.819731 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62dd005-2009-4817-b366-e085fd60b97d None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:44.825665 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 53/97] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 30 01:15:44 2022] GET /identity/v3/role_assignments?user.id=40d2c2b96e7d483aba514a9499f4459d&scope.project.id=461a99523fbb4b2abff004235ad031d8&role.id=5b38bd827c5847969c4ee48e27261f5b => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:46.030631 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0035d4-fff8-44ba-81b0-9152210009ab None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:46.031690 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0035d4-fff8-44ba-81b0-9152210009ab None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:46.032209 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0035d4-fff8-44ba-81b0-9152210009ab None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:46.033759 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 45/98] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:15:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:15:46.039207 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f3949-260d-421e-9a72-37df0853c0b2 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:46.040059 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f3949-260d-421e-9a72-37df0853c0b2 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:46.040534 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f3949-260d-421e-9a72-37df0853c0b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:46.059073 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-1a3f3949-260d-421e-9a72-37df0853c0b2 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:46.060647 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-1a3f3949-260d-421e-9a72-37df0853c0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:46.146617 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 54/99] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:15:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 01:15:46.227332 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf2ad1a-63b4-47c1-997a-8e3cdba86984 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:46.227985 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf2ad1a-63b4-47c1-997a-8e3cdba86984 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:46.228460 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf2ad1a-63b4-47c1-997a-8e3cdba86984 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:46.230031 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 46/100] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:15:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:15:46.235324 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc17892-2c4e-44e2-ba5f-db33503dcee1 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:46.235643 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc17892-2c4e-44e2-ba5f-db33503dcee1 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:46.235920 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc17892-2c4e-44e2-ba5f-db33503dcee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:46.260432 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-9bc17892-2c4e-44e2-ba5f-db33503dcee1 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:46.261612 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-9bc17892-2c4e-44e2-ba5f-db33503dcee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:46.349125 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 55/101] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:15:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:15:46.592381 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf2ad1a-63b4-47c1-997a-8e3cdba86984 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:46.620082 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034984e8-7eb2-4e67-99ac-5596bfba429e None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:46.620391 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034984e8-7eb2-4e67-99ac-5596bfba429e None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:46.620644 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034984e8-7eb2-4e67-99ac-5596bfba429e None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:46.622636 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 56/102] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:15:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:15:46.644464 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc1cb2-d56f-44fb-a325-75ea41c36ab0 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:46.644805 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc1cb2-d56f-44fb-a325-75ea41c36ab0 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:46.645588 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc1cb2-d56f-44fb-a325-75ea41c36ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:46.697645 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-0ffc1cb2-d56f-44fb-a325-75ea41c36ab0 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:46.700998 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-0ffc1cb2-d56f-44fb-a325-75ea41c36ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:46.721426 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:46.742424 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:46.799539 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf2ad1a-63b4-47c1-997a-8e3cdba86984 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:46.864791 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 57/103] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:15:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 01:15:46.865925 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffc1cb2-d56f-44fb-a325-75ea41c36ab0 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:46.881267 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ccdbf-8115-4ff7-8521-1fcae2248689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:46.881920 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ccdbf-8115-4ff7-8521-1fcae2248689 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:46.882363 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ccdbf-8115-4ff7-8521-1fcae2248689 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:46.882805 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ccdbf-8115-4ff7-8521-1fcae2248689 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:46.908388 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153ccdbf-8115-4ff7-8521-1fcae2248689 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:15:46.913755 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-153ccdbf-8115-4ff7-8521-1fcae2248689 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 01:15:46.913755 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:15:46.913755 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:15:46.913755 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:15:46.913755 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:15:46.913755 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:15:46.913755 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:15:46.913755 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:15:46.913755 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:15:46.913755 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:15:46.913755 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:15:46.913755 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:15:46.913755 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:15:46.913755 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:15:46.913755 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:15:46.913755 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:15:46.914799 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:15:46.914799 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:15:46.914799 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:15:46.914799 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:15:46.914799 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:15:46.914799 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:15:46.914799 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:15:46.914799 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:15:46.914799 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:15:46.914799 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:15:46.914799 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:15:46.914799 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:15:46.914799 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:15:46.914799 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:15:46.914799 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:15:46.914799 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:15:46.915799 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:15:46.915799 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:15:46.915799 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:15:46.915799 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:15:46.915799 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:15:46.915799 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:15:46.915799 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:15:46.915799 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:15:46.915799 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:15:46.915799 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:15:46.915799 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 01:15:46.915799 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:15:46.917736 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 47/104] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 30 01:15:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:15:46.923233 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ccdbf-8115-4ff7-8521-1fcae2248689 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:47.050336 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffc1cb2-d56f-44fb-a325-75ea41c36ab0 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:47.116216 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe6ade-b28b-411f-ae0a-a6636deabf13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:47.117173 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe6ade-b28b-411f-ae0a-a6636deabf13 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:47.117923 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe6ade-b28b-411f-ae0a-a6636deabf13 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:47.118658 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe6ade-b28b-411f-ae0a-a6636deabf13 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:47.121272 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fe6ade-b28b-411f-ae0a-a6636deabf13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:47.123245 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fe6ade-b28b-411f-ae0a-a6636deabf13 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:47.125100 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 58/105] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:15:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:47.131515 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe6ade-b28b-411f-ae0a-a6636deabf13 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:47.149688 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:47.185724 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ccdbf-8115-4ff7-8521-1fcae2248689 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:47.262942 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc300cba-b8a3-4387-b17f-9698d8d04dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:47.263610 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc300cba-b8a3-4387-b17f-9698d8d04dff None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:47.263896 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc300cba-b8a3-4387-b17f-9698d8d04dff None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:47.264176 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc300cba-b8a3-4387-b17f-9698d8d04dff None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:47.264852 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc300cba-b8a3-4387-b17f-9698d8d04dff None admin] RBAC: Adding query filter params (name=reader) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:15:47.265162 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc300cba-b8a3-4387-b17f-9698d8d04dff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:47.266573 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc300cba-b8a3-4387-b17f-9698d8d04dff None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:47.278738 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:47.281567 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe6ade-b28b-411f-ae0a-a6636deabf13 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:47.282873 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 48/106] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Aug 30 01:15:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:15:47.283541 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc300cba-b8a3-4387-b17f-9698d8d04dff None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:47.320554 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47103790-ab17-46dc-b6f2-ca2908abc1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:47.321332 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47103790-ab17-46dc-b6f2-ca2908abc1c9 None admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:47.321743 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47103790-ab17-46dc-b6f2-ca2908abc1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:47.322116 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47103790-ab17-46dc-b6f2-ca2908abc1c9 None admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:47.322982 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47103790-ab17-46dc-b6f2-ca2908abc1c9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:47.324700 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47103790-ab17-46dc-b6f2-ca2908abc1c9 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:47.362403 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 59/107] 10.222.0.60 () {60 vars in 1141 bytes} [Tue Aug 30 01:15:47 2022] POST /identity/v3/projects => generated 302 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:15:47.364534 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e12e1c-1a38-4a78-8caa-f6fc842644c5 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:47.365228 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e12e1c-1a38-4a78-8caa-f6fc842644c5 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:47.365645 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e12e1c-1a38-4a78-8caa-f6fc842644c5 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:47.368195 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 60/108] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:15:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:15:47.373191 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e12e1c-1a38-4a78-8caa-f6fc842644c5 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:47.415526 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc300cba-b8a3-4387-b17f-9698d8d04dff None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:47.447810 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:47.455466 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85669d0-abb9-4e72-8dfb-f7b4cfa8f92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:47.456360 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85669d0-abb9-4e72-8dfb-f7b4cfa8f92e None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:47.456783 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85669d0-abb9-4e72-8dfb-f7b4cfa8f92e None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:47.457391 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85669d0-abb9-4e72-8dfb-f7b4cfa8f92e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:47.470711 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85669d0-abb9-4e72-8dfb-f7b4cfa8f92e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:15:47.477371 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-e85669d0-abb9-4e72-8dfb-f7b4cfa8f92e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 01:15:47.477371 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:15:47.477371 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:15:47.477371 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:15:47.477371 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:15:47.477371 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:15:47.477371 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:15:47.477371 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:15:47.477371 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:15:47.477371 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:15:47.477371 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:15:47.477371 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:15:47.477371 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:15:47.477371 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:15:47.477371 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:15:47.477371 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:15:47.478369 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:15:47.478369 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:15:47.478369 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:15:47.478369 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:15:47.478369 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:15:47.478369 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:15:47.478369 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:15:47.478369 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:15:47.478369 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:15:47.478369 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:15:47.478369 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:15:47.478369 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:15:47.478369 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:15:47.478369 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:15:47.478369 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:15:47.478369 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:15:47.479282 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:15:47.479282 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:15:47.479282 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:15:47.479282 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:15:47.479282 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:15:47.479282 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:15:47.479282 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:15:47.479282 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:15:47.479282 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:15:47.479282 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:15:47.479282 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 01:15:47.479282 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:15:47.481456 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 49/109] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 30 01:15:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:15:47.482912 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8c72c-4de1-4bfa-8e13-e73c9a095a39 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:47.483380 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8c72c-4de1-4bfa-8e13-e73c9a095a39 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:47.483865 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8c72c-4de1-4bfa-8e13-e73c9a095a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:47.504686 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-00b8c72c-4de1-4bfa-8e13-e73c9a095a39 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:47.506636 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-00b8c72c-4de1-4bfa-8e13-e73c9a095a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:47.532215 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e12e1c-1a38-4a78-8caa-f6fc842644c5 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:47.571500 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:47.584561 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9db00c1-850e-4d79-a6f8-7f1770635a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:47.584831 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 50/110] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:15:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:15:47.585212 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db00c1-850e-4d79-a6f8-7f1770635a93 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:47.585548 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db00c1-850e-4d79-a6f8-7f1770635a93 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:47.585830 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db00c1-850e-4d79-a6f8-7f1770635a93 None admin] PATH_INFO: `/v3/users/7a56bbfc21b54fcd8a7ff7c3c96fe853` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:47.586481 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b8c72c-4de1-4bfa-8e13-e73c9a095a39 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:47.612423 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9db00c1-850e-4d79-a6f8-7f1770635a93 None admin] RBAC: Authorizing `identity:get_user(user_id=7a56bbfc21b54fcd8a7ff7c3c96fe853)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:47.615047 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9db00c1-850e-4d79-a6f8-7f1770635a93 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:47.616993 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 61/111] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 30 01:15:47 2022] GET /identity/v3/users/7a56bbfc21b54fcd8a7ff7c3c96fe853 => generated 289 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:47.618460 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30dd82-c84b-4f3a-94c1-c72c8736f4e5 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:47.618918 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30dd82-c84b-4f3a-94c1-c72c8736f4e5 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:47.619369 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30dd82-c84b-4f3a-94c1-c72c8736f4e5 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:47.620845 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 62/112] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:15:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:15:47.622239 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf30dd82-c84b-4f3a-94c1-c72c8736f4e5 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:47.721217 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b8c72c-4de1-4bfa-8e13-e73c9a095a39 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:47.732589 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf30dd82-c84b-4f3a-94c1-c72c8736f4e5 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:47.756318 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:47.761487 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29de9346-4aee-4d50-8f5d-61d3dfc194e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:47.762165 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de9346-4aee-4d50-8f5d-61d3dfc194e7 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:47.762382 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de9346-4aee-4d50-8f5d-61d3dfc194e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:47.762654 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de9346-4aee-4d50-8f5d-61d3dfc194e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:47.763334 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29de9346-4aee-4d50-8f5d-61d3dfc194e7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:15:47.763670 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29de9346-4aee-4d50-8f5d-61d3dfc194e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:47.765172 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29de9346-4aee-4d50-8f5d-61d3dfc194e7 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:47.773771 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9bf824-8bc0-4991-afd8-a61c4d9358b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:47.774273 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 51/113] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Aug 30 01:15:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:47.774973 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9bf824-8bc0-4991-afd8-a61c4d9358b4 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:47.775563 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9bf824-8bc0-4991-afd8-a61c4d9358b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:47.775667 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f37a4-bd7f-4b1d-a5bf-6b87c914f789 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:47.775907 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f37a4-bd7f-4b1d-a5bf-6b87c914f789 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:47.776185 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f37a4-bd7f-4b1d-a5bf-6b87c914f789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:47.776568 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9bf824-8bc0-4991-afd8-a61c4d9358b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:47.794902 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-5b8f37a4-bd7f-4b1d-a5bf-6b87c914f789 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:47.796375 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-5b8f37a4-bd7f-4b1d-a5bf-6b87c914f789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:47.849147 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:47.854880 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9bf824-8bc0-4991-afd8-a61c4d9358b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:47.856699 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9bf824-8bc0-4991-afd8-a61c4d9358b4 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:47.874985 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 52/114] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:15:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:15:47.876093 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8f37a4-bd7f-4b1d-a5bf-6b87c914f789 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:47.962735 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 63/115] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 30 01:15:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 01:15:47.964424 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de499ee-8a38-4235-bc6e-3ab2942820b7 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:47.965206 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de499ee-8a38-4235-bc6e-3ab2942820b7 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:47.965669 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de499ee-8a38-4235-bc6e-3ab2942820b7 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:47.967112 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 64/116] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:15:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:15:47.968257 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de499ee-8a38-4235-bc6e-3ab2942820b7 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:47.997263 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:48.007172 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8f37a4-bd7f-4b1d-a5bf-6b87c914f789 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:48.043404 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdc3beb-7c0b-4482-8b78-cb215acf0021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:48.044463 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc3beb-7c0b-4482-8b78-cb215acf0021 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:48.044946 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc3beb-7c0b-4482-8b78-cb215acf0021 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:48.045418 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc3beb-7c0b-4482-8b78-cb215acf0021 None admin] PATH_INFO: `/v3/users/40d2c2b96e7d483aba514a9499f4459d` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:48.046886 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdc3beb-7c0b-4482-8b78-cb215acf0021 None admin] RBAC: Authorizing `identity:get_user(user_id=40d2c2b96e7d483aba514a9499f4459d)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:48.048727 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdc3beb-7c0b-4482-8b78-cb215acf0021 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:48.050523 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 53/117] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 30 01:15:47 2022] GET /identity/v3/users/40d2c2b96e7d483aba514a9499f4459d => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:48.052112 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdc3beb-7c0b-4482-8b78-cb215acf0021 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:48.094068 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de499ee-8a38-4235-bc6e-3ab2942820b7 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:48.109345 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:48.140070 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d4235d-feda-4342-977e-e606e5a77452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:48.141276 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4235d-feda-4342-977e-e606e5a77452 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:48.141666 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4235d-feda-4342-977e-e606e5a77452 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:48.142045 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4235d-feda-4342-977e-e606e5a77452 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:48.157545 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d4235d-feda-4342-977e-e606e5a77452 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:15:48.163565 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-a5d4235d-feda-4342-977e-e606e5a77452 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:15:48.163565 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:15:48.163565 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:15:48.163565 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:15:48.163565 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:15:48.163565 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:15:48.163565 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:15:48.163565 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:15:48.163565 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:15:48.163565 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:15:48.163565 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:15:48.163565 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:15:48.163565 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:15:48.163565 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:15:48.163565 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:15:48.163565 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:15:48.164576 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:15:48.164576 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:15:48.164576 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:15:48.164576 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:15:48.164576 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:15:48.164576 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:15:48.164576 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:15:48.164576 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:15:48.164576 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:15:48.164576 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:15:48.164576 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:15:48.164576 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:15:48.164576 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:15:48.164576 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:15:48.164576 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:15:48.164576 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:15:48.165548 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:15:48.165548 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:15:48.165548 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:15:48.165548 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:15:48.165548 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:15:48.165548 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:15:48.165548 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:15:48.165548 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:15:48.165548 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:15:48.165548 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:15:48.165548 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:15:48.165548 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:15:48.166266 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdc3beb-7c0b-4482-8b78-cb215acf0021 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:48.167569 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 65/118] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 30 01:15:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:15:48.169379 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ab0fd-006a-4054-8e70-e7e601d7fbe9 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:48.169824 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ab0fd-006a-4054-8e70-e7e601d7fbe9 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:48.170230 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ab0fd-006a-4054-8e70-e7e601d7fbe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:48.190173 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-2b3ab0fd-006a-4054-8e70-e7e601d7fbe9 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:48.191371 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-2b3ab0fd-006a-4054-8e70-e7e601d7fbe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:48.204371 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc93c9-b463-44f4-a37e-c972296141b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:48.205651 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc93c9-b463-44f4-a37e-c972296141b7 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:48.206121 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc93c9-b463-44f4-a37e-c972296141b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:48.206561 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc93c9-b463-44f4-a37e-c972296141b7 None admin] PATH_INFO: `/v3/projects/023703a6c5664626b371621981c1b1ba` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:48.207898 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc93c9-b463-44f4-a37e-c972296141b7 None admin] RBAC: Authorizing `identity:get_project(project_id=023703a6c5664626b371621981c1b1ba)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:48.209548 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc93c9-b463-44f4-a37e-c972296141b7 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:48.211311 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 54/119] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 30 01:15:48 2022] GET /identity/v3/projects/023703a6c5664626b371621981c1b1ba => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:48.212228 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc93c9-b463-44f4-a37e-c972296141b7 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:48.267375 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 66/120] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:15:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:15:48.268262 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ab0fd-006a-4054-8e70-e7e601d7fbe9 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:48.294852 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:48.336987 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc93c9-b463-44f4-a37e-c972296141b7 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:48.357256 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:48.376848 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d22ce82-f36c-4a07-85c0-01e80220e3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:48.377715 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22ce82-f36c-4a07-85c0-01e80220e3ef None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:48.378163 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22ce82-f36c-4a07-85c0-01e80220e3ef None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:48.378632 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22ce82-f36c-4a07-85c0-01e80220e3ef None admin] PATH_INFO: `/v3/projects/023703a6c5664626b371621981c1b1ba` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:48.380095 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d22ce82-f36c-4a07-85c0-01e80220e3ef None admin] RBAC: Authorizing `identity:get_project(project_id=023703a6c5664626b371621981c1b1ba)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:48.381805 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d22ce82-f36c-4a07-85c0-01e80220e3ef None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:48.383852 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 55/121] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 30 01:15:48 2022] GET /identity/v3/projects/023703a6c5664626b371621981c1b1ba => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:48.384991 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d22ce82-f36c-4a07-85c0-01e80220e3ef None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:48.407700 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ab0fd-006a-4054-8e70-e7e601d7fbe9 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:48.454700 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6620f33c-9bbb-403f-95ba-aa0fda81166a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:48.455611 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620f33c-9bbb-403f-95ba-aa0fda81166a None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:48.455904 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620f33c-9bbb-403f-95ba-aa0fda81166a None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:48.456180 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620f33c-9bbb-403f-95ba-aa0fda81166a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:48.470109 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6620f33c-9bbb-403f-95ba-aa0fda81166a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:15:48.477778 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-6620f33c-9bbb-403f-95ba-aa0fda81166a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 01:15:48.477778 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:15:48.477778 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:15:48.477778 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:15:48.477778 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:15:48.477778 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:15:48.477778 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:15:48.477778 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:15:48.477778 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:15:48.477778 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:15:48.477778 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:15:48.477778 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:15:48.477778 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:15:48.477778 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:15:48.477778 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:15:48.477778 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:15:48.478773 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:15:48.478773 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:15:48.478773 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:15:48.478773 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:15:48.478773 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:15:48.478773 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:15:48.478773 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:15:48.478773 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:15:48.478773 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:15:48.478773 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:15:48.478773 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:15:48.478773 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:15:48.478773 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:15:48.478773 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:15:48.478773 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:15:48.478773 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:15:48.479754 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:15:48.479754 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:15:48.479754 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:15:48.479754 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:15:48.479754 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:15:48.479754 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:15:48.479754 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:15:48.479754 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:15:48.479754 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:15:48.479754 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:15:48.479754 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 01:15:48.479754 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:15:48.481789 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 67/122] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 30 01:15:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:15:48.486381 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6620f33c-9bbb-403f-95ba-aa0fda81166a None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:48.510240 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d22ce82-f36c-4a07-85c0-01e80220e3ef None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:48.549005 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aec5d9-759c-40c8-b48b-875f5582c384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:48.549945 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aec5d9-759c-40c8-b48b-875f5582c384 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:48.550443 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aec5d9-759c-40c8-b48b-875f5582c384 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:48.550760 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aec5d9-759c-40c8-b48b-875f5582c384 None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:48.551486 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aec5d9-759c-40c8-b48b-875f5582c384 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:15:48.551840 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aec5d9-759c-40c8-b48b-875f5582c384 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:48.553228 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aec5d9-759c-40c8-b48b-875f5582c384 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:48.561882 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 56/123] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 30 01:15:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:48.562856 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aec5d9-759c-40c8-b48b-875f5582c384 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:48.574985 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:48.609140 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6620f33c-9bbb-403f-95ba-aa0fda81166a None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:48.624055 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:48.650641 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2518d151-201b-40f2-a8b3-2b0174758386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:48.651304 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518d151-201b-40f2-a8b3-2b0174758386 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:48.652068 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518d151-201b-40f2-a8b3-2b0174758386 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:48.652361 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518d151-201b-40f2-a8b3-2b0174758386 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:48.653102 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2518d151-201b-40f2-a8b3-2b0174758386 None admin] RBAC: Adding query filter params (role.id=c2266dd88cfd4bdbb73eea767bcd4bac, scope.project.id=023703a6c5664626b371621981c1b1ba, user.id=7a56bbfc21b54fcd8a7ff7c3c96fe853) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:15:48.653419 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2518d151-201b-40f2-a8b3-2b0174758386 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:48.655244 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2518d151-201b-40f2-a8b3-2b0174758386 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:48.671545 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 68/124] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 30 01:15:48 2022] GET /identity/v3/role_assignments?user.id=7a56bbfc21b54fcd8a7ff7c3c96fe853&scope.project.id=023703a6c5664626b371621981c1b1ba&role.id=c2266dd88cfd4bdbb73eea767bcd4bac => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:48.671545 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2518d151-201b-40f2-a8b3-2b0174758386 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:48.678876 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aec5d9-759c-40c8-b48b-875f5582c384 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:48.724566 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d68bbb-e79c-45ed-bdaf-10a869b631fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:48.725671 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d68bbb-e79c-45ed-bdaf-10a869b631fa None admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:48.727037 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d68bbb-e79c-45ed-bdaf-10a869b631fa None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:48.727425 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d68bbb-e79c-45ed-bdaf-10a869b631fa None admin] PATH_INFO: `/v3/projects/023703a6c5664626b371621981c1b1ba/users/40d2c2b96e7d483aba514a9499f4459d/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:48.729618 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d68bbb-e79c-45ed-bdaf-10a869b631fa None admin] RBAC: Authorizing `identity:create_grant(project_id=023703a6c5664626b371621981c1b1ba, user_id=40d2c2b96e7d483aba514a9499f4459d, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:48.731259 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d68bbb-e79c-45ed-bdaf-10a869b631fa None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:48.751535 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 57/125] 10.222.0.60 () {58 vars in 1439 bytes} [Tue Aug 30 01:15:48 2022] PUT /identity/v3/projects/023703a6c5664626b371621981c1b1ba/users/40d2c2b96e7d483aba514a9499f4459d/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:48.752771 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d68bbb-e79c-45ed-bdaf-10a869b631fa None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:48.845448 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2518d151-201b-40f2-a8b3-2b0174758386 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:48.886625 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f02748a-1784-43e6-975e-864c3ff8e7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:48.887396 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02748a-1784-43e6-975e-864c3ff8e7da None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:48.887700 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02748a-1784-43e6-975e-864c3ff8e7da None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:48.887974 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02748a-1784-43e6-975e-864c3ff8e7da None admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:48.888940 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f02748a-1784-43e6-975e-864c3ff8e7da None admin] RBAC: Adding query filter params (name=member) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:15:48.889246 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f02748a-1784-43e6-975e-864c3ff8e7da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:48.890660 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f02748a-1784-43e6-975e-864c3ff8e7da None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:48.894473 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:48.913937 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 69/126] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Aug 30 01:15:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:48.914831 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f02748a-1784-43e6-975e-864c3ff8e7da None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:48.971644 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d68bbb-e79c-45ed-bdaf-10a869b631fa None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:48.982588 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:49.021623 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa0542e-0217-415d-9b3e-29839d7e1057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:49.022263 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0542e-0217-415d-9b3e-29839d7e1057 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:49.022540 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0542e-0217-415d-9b3e-29839d7e1057 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:49.022846 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0542e-0217-415d-9b3e-29839d7e1057 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:49.046171 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa0542e-0217-415d-9b3e-29839d7e1057 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:15:49.060687 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-1fa0542e-0217-415d-9b3e-29839d7e1057 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 01:15:49.060687 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:15:49.060687 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:15:49.060687 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:15:49.060687 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:15:49.060687 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:15:49.060687 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:15:49.060687 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:15:49.060687 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:15:49.060687 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:15:49.060687 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:15:49.060687 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:15:49.060687 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:15:49.060687 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:15:49.060687 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:15:49.060687 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:15:49.061623 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:15:49.061623 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:15:49.061623 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:15:49.061623 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:15:49.061623 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:15:49.061623 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:15:49.061623 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:15:49.061623 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:15:49.061623 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:15:49.061623 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:15:49.061623 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:15:49.061623 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:15:49.061623 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:15:49.061623 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:15:49.061623 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:15:49.061623 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:15:49.062397 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:15:49.062397 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:15:49.062397 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:15:49.062397 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:15:49.062397 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:15:49.062397 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:15:49.062397 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:15:49.062397 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:15:49.062397 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:15:49.062397 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:15:49.062397 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 01:15:49.062397 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:15:49.062397 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 58/127] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Aug 30 01:15:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:15:49.064728 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa0542e-0217-415d-9b3e-29839d7e1057 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:49.086758 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f02748a-1784-43e6-975e-864c3ff8e7da None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:49.122982 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460de88c-8a00-4a73-aeee-a14002fdc35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:49.123787 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460de88c-8a00-4a73-aeee-a14002fdc35f None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:49.123955 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460de88c-8a00-4a73-aeee-a14002fdc35f None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:49.124204 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460de88c-8a00-4a73-aeee-a14002fdc35f None admin] PATH_INFO: `/v3/users/68ff671606954cb48c45e22d8978bcf2` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:49.125331 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460de88c-8a00-4a73-aeee-a14002fdc35f None admin] RBAC: Authorizing `identity:get_user(user_id=68ff671606954cb48c45e22d8978bcf2)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:49.126801 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460de88c-8a00-4a73-aeee-a14002fdc35f None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:49.128611 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 70/128] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 30 01:15:48 2022] GET /identity/v3/users/68ff671606954cb48c45e22d8978bcf2 => generated 247 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:49.130763 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460de88c-8a00-4a73-aeee-a14002fdc35f None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:49.234544 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:49.282920 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460de88c-8a00-4a73-aeee-a14002fdc35f None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:49.331596 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa0542e-0217-415d-9b3e-29839d7e1057 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:49.351471 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc28192-4869-4f72-b720-8ae5d2d7174c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:49.352636 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc28192-4869-4f72-b720-8ae5d2d7174c None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:49.353095 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc28192-4869-4f72-b720-8ae5d2d7174c None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:49.353573 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc28192-4869-4f72-b720-8ae5d2d7174c None admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:49.354587 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc28192-4869-4f72-b720-8ae5d2d7174c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:15:49.355067 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc28192-4869-4f72-b720-8ae5d2d7174c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:49.356673 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc28192-4869-4f72-b720-8ae5d2d7174c None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:49.371373 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 71/129] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 30 01:15:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:49.372579 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc28192-4869-4f72-b720-8ae5d2d7174c None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:49.396251 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a41fa86-18e9-4052-9673-53e5555be6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:49.396898 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41fa86-18e9-4052-9673-53e5555be6cd None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:49.397262 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41fa86-18e9-4052-9673-53e5555be6cd None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:49.397617 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41fa86-18e9-4052-9673-53e5555be6cd None admin] PATH_INFO: `/v3/users/40d2c2b96e7d483aba514a9499f4459d` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:49.402456 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a41fa86-18e9-4052-9673-53e5555be6cd None admin] RBAC: Authorizing `identity:get_user(user_id=40d2c2b96e7d483aba514a9499f4459d)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:49.404433 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a41fa86-18e9-4052-9673-53e5555be6cd None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:49.406224 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 59/130] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 30 01:15:49 2022] GET /identity/v3/users/40d2c2b96e7d483aba514a9499f4459d => generated 275 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:49.407067 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a41fa86-18e9-4052-9673-53e5555be6cd None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:49.490108 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:49.496371 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc28192-4869-4f72-b720-8ae5d2d7174c None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:49.570000 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f450033-41eb-4a61-afe9-b65070b111a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:49.570986 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f450033-41eb-4a61-afe9-b65070b111a7 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:49.571458 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f450033-41eb-4a61-afe9-b65070b111a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:49.572798 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f450033-41eb-4a61-afe9-b65070b111a7 None admin] PATH_INFO: `/v3/projects/023703a6c5664626b371621981c1b1ba` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:49.574451 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f450033-41eb-4a61-afe9-b65070b111a7 None admin] RBAC: Authorizing `identity:get_project(project_id=023703a6c5664626b371621981c1b1ba)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:49.577724 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f450033-41eb-4a61-afe9-b65070b111a7 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:49.579830 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 72/131] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 30 01:15:49 2022] GET /identity/v3/projects/023703a6c5664626b371621981c1b1ba => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:49.583638 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:49.594429 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f450033-41eb-4a61-afe9-b65070b111a7 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:49.649308 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a41fa86-18e9-4052-9673-53e5555be6cd None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:49.704023 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40794241-4f60-4094-9dfb-dee61cdd2fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:49.705249 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40794241-4f60-4094-9dfb-dee61cdd2fbd None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:49.705838 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40794241-4f60-4094-9dfb-dee61cdd2fbd None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:49.706328 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40794241-4f60-4094-9dfb-dee61cdd2fbd None admin] PATH_INFO: `/v3/users/40d2c2b96e7d483aba514a9499f4459d` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:49.707796 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40794241-4f60-4094-9dfb-dee61cdd2fbd None admin] RBAC: Authorizing `identity:get_user(user_id=40d2c2b96e7d483aba514a9499f4459d)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:49.709529 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40794241-4f60-4094-9dfb-dee61cdd2fbd None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:49.711472 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 60/132] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 30 01:15:49 2022] GET /identity/v3/users/40d2c2b96e7d483aba514a9499f4459d => generated 275 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:49.717163 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40794241-4f60-4094-9dfb-dee61cdd2fbd None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:49.907295 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f450033-41eb-4a61-afe9-b65070b111a7 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:49.951971 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d47a7a-6f10-44ab-8543-e58d68f63479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:49.952617 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d47a7a-6f10-44ab-8543-e58d68f63479 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:49.953463 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d47a7a-6f10-44ab-8543-e58d68f63479 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:49.953750 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d47a7a-6f10-44ab-8543-e58d68f63479 None admin] PATH_INFO: `/v3/projects/461a99523fbb4b2abff004235ad031d8` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:49.955096 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d47a7a-6f10-44ab-8543-e58d68f63479 None admin] RBAC: Authorizing `identity:get_project(project_id=461a99523fbb4b2abff004235ad031d8)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:49.957751 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d47a7a-6f10-44ab-8543-e58d68f63479 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:49.959382 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 73/133] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 30 01:15:49 2022] GET /identity/v3/projects/461a99523fbb4b2abff004235ad031d8 => generated 312 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:49.961247 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d47a7a-6f10-44ab-8543-e58d68f63479 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:49.986981 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40794241-4f60-4094-9dfb-dee61cdd2fbd None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:49.991042 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:50.029780 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b981aeb-8052-4677-aaba-2c90fa44d76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:50.030452 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b981aeb-8052-4677-aaba-2c90fa44d76b None admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:50.030752 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b981aeb-8052-4677-aaba-2c90fa44d76b None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:50.031018 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b981aeb-8052-4677-aaba-2c90fa44d76b None admin] PATH_INFO: `/v3/projects/023703a6c5664626b371621981c1b1ba/users/68ff671606954cb48c45e22d8978bcf2/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:50.033029 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b981aeb-8052-4677-aaba-2c90fa44d76b None admin] RBAC: Authorizing `identity:create_grant(project_id=023703a6c5664626b371621981c1b1ba, user_id=68ff671606954cb48c45e22d8978bcf2, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:50.034419 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b981aeb-8052-4677-aaba-2c90fa44d76b None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:50.056902 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 61/134] 10.222.0.60 () {58 vars in 1439 bytes} [Tue Aug 30 01:15:49 2022] PUT /identity/v3/projects/023703a6c5664626b371621981c1b1ba/users/68ff671606954cb48c45e22d8978bcf2/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:50.056902 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2cdeb6-75b4-4d01-82f7-03079d8765e0 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:50.056902 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2cdeb6-75b4-4d01-82f7-03079d8765e0 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:50.056902 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2cdeb6-75b4-4d01-82f7-03079d8765e0 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:50.056902 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 62/135] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:15:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:15:50.057324 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2cdeb6-75b4-4d01-82f7-03079d8765e0 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:50.068665 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:50.129630 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d47a7a-6f10-44ab-8543-e58d68f63479 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:50.170564 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547014b1-7445-4f03-bf58-a2ef3031b62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:50.171111 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547014b1-7445-4f03-bf58-a2ef3031b62a None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:50.171396 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547014b1-7445-4f03-bf58-a2ef3031b62a None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:50.171708 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547014b1-7445-4f03-bf58-a2ef3031b62a None admin] PATH_INFO: `/v3/projects/023703a6c5664626b371621981c1b1ba` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:50.173360 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547014b1-7445-4f03-bf58-a2ef3031b62a None admin] RBAC: Authorizing `identity:get_project(project_id=023703a6c5664626b371621981c1b1ba)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:50.175226 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547014b1-7445-4f03-bf58-a2ef3031b62a None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:50.177717 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 74/136] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 30 01:15:49 2022] GET /identity/v3/projects/023703a6c5664626b371621981c1b1ba => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:50.180221 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bcfc0a-0342-407d-864f-f20a191b0f82 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:50.180500 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bcfc0a-0342-407d-864f-f20a191b0f82 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:50.180914 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bcfc0a-0342-407d-864f-f20a191b0f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:50.202264 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-c0bcfc0a-0342-407d-864f-f20a191b0f82 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:50.203450 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-c0bcfc0a-0342-407d-864f-f20a191b0f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:50.234300 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2cdeb6-75b4-4d01-82f7-03079d8765e0 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:50.279499 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9407a740-6b19-427b-9807-604f10ef393f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:50.279499 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407a740-6b19-427b-9807-604f10ef393f None admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:50.279499 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407a740-6b19-427b-9807-604f10ef393f None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:50.279499 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407a740-6b19-427b-9807-604f10ef393f None admin] PATH_INFO: `/v3/projects/461a99523fbb4b2abff004235ad031d8/users/40d2c2b96e7d483aba514a9499f4459d/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:50.279908 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9407a740-6b19-427b-9807-604f10ef393f None admin] RBAC: Authorizing `identity:create_grant(project_id=461a99523fbb4b2abff004235ad031d8, user_id=40d2c2b96e7d483aba514a9499f4459d, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:50.279908 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9407a740-6b19-427b-9807-604f10ef393f None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:50.294268 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 63/137] 10.222.0.60 () {58 vars in 1439 bytes} [Tue Aug 30 01:15:50 2022] PUT /identity/v3/projects/461a99523fbb4b2abff004235ad031d8/users/40d2c2b96e7d483aba514a9499f4459d/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:50.295286 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9407a740-6b19-427b-9807-604f10ef393f None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:50.328163 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:50.353608 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 75/138] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:15:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:15:50.449665 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9407a740-6b19-427b-9807-604f10ef393f None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:50.500477 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d118aad2-720b-4122-9cda-9054de308451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:50.501150 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118aad2-720b-4122-9cda-9054de308451 None admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:50.501435 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118aad2-720b-4122-9cda-9054de308451 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:50.501712 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118aad2-720b-4122-9cda-9054de308451 None admin] PATH_INFO: `/v3/projects/023703a6c5664626b371621981c1b1ba/users/40d2c2b96e7d483aba514a9499f4459d/roles/449624f20ef248ef97aeceba5b22eccd` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:50.505760 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d118aad2-720b-4122-9cda-9054de308451 None admin] RBAC: Authorizing `identity:create_grant(project_id=023703a6c5664626b371621981c1b1ba, user_id=40d2c2b96e7d483aba514a9499f4459d, role_id=449624f20ef248ef97aeceba5b22eccd)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:50.507215 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d118aad2-720b-4122-9cda-9054de308451 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:50.539720 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 64/139] 10.222.0.60 () {58 vars in 1439 bytes} [Tue Aug 30 01:15:50 2022] PUT /identity/v3/projects/023703a6c5664626b371621981c1b1ba/users/40d2c2b96e7d483aba514a9499f4459d/roles/449624f20ef248ef97aeceba5b22eccd => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:15:50.731059 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bcfc0a-0342-407d-864f-f20a191b0f82 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:50.796788 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:50.844620 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bcfc0a-0342-407d-864f-f20a191b0f82 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:50.855479 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b665c1-06ea-4501-811b-9e763213e9be None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:50.855781 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b665c1-06ea-4501-811b-9e763213e9be None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:50.856023 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b665c1-06ea-4501-811b-9e763213e9be None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:50.857594 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 65/140] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:15:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:15:50.872609 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f444282-aa89-459a-a35e-172fcc6e4ba5 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:50.872889 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f444282-aa89-459a-a35e-172fcc6e4ba5 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:50.873170 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f444282-aa89-459a-a35e-172fcc6e4ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:50.881436 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc78f096-1cdf-4c61-ae75-f1e3a4ade318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:50.882091 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78f096-1cdf-4c61-ae75-f1e3a4ade318 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:50.882376 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78f096-1cdf-4c61-ae75-f1e3a4ade318 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:50.882650 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78f096-1cdf-4c61-ae75-f1e3a4ade318 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:50.883808 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc78f096-1cdf-4c61-ae75-f1e3a4ade318 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:50.885385 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc78f096-1cdf-4c61-ae75-f1e3a4ade318 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:50.886986 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 76/141] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:15:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:50.892868 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc78f096-1cdf-4c61-ae75-f1e3a4ade318 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:50.924561 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-5f444282-aa89-459a-a35e-172fcc6e4ba5 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:50.925775 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-5f444282-aa89-459a-a35e-172fcc6e4ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:51.006871 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc78f096-1cdf-4c61-ae75-f1e3a4ade318 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:51.044848 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f4949-b96a-4d45-8a67-38ca6e6ebce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:51.045484 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f4949-b96a-4d45-8a67-38ca6e6ebce3 None admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:51.045768 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f4949-b96a-4d45-8a67-38ca6e6ebce3 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:51.046041 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f4949-b96a-4d45-8a67-38ca6e6ebce3 None admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:51.046711 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378f4949-b96a-4d45-8a67-38ca6e6ebce3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:51.047186 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:51.050444 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378f4949-b96a-4d45-8a67-38ca6e6ebce3 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:51.078261 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 77/142] 10.222.0.60 () {60 vars in 1132 bytes} [Tue Aug 30 01:15:50 2022] POST /identity/v3/users => generated 283 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:15:51.079033 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 66/143] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:15:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:15:51.416724 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e4ad8a-d94c-4c41-abb6-467107ef512f None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:51.417237 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e4ad8a-d94c-4c41-abb6-467107ef512f None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:51.417335 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e4ad8a-d94c-4c41-abb6-467107ef512f None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:51.418630 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 78/144] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:15:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:15:51.424333 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e68eb-0b93-4d82-8402-c98e7f4b03d9 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:51.424621 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e68eb-0b93-4d82-8402-c98e7f4b03d9 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:51.424893 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e68eb-0b93-4d82-8402-c98e7f4b03d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:51.445496 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-542e68eb-0b93-4d82-8402-c98e7f4b03d9 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:51.446690 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-542e68eb-0b93-4d82-8402-c98e7f4b03d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:51.458723 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:51.530898 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 67/145] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:15:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 01:15:51.653989 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e4ad8a-d94c-4c41-abb6-467107ef512f None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:51.774449 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e4ad8a-d94c-4c41-abb6-467107ef512f None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:51.814625 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a263842-da6a-44eb-ab11-db590077f162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:51.815310 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a263842-da6a-44eb-ab11-db590077f162 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:51.815612 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a263842-da6a-44eb-ab11-db590077f162 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:51.815882 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a263842-da6a-44eb-ab11-db590077f162 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:51.829606 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a263842-da6a-44eb-ab11-db590077f162 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:15:51.835108 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-5a263842-da6a-44eb-ab11-db590077f162 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 01:15:51.835108 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:15:51.835108 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:15:51.835108 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:15:51.835108 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:15:51.835108 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:15:51.835108 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:15:51.835108 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:15:51.835108 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:15:51.835108 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:15:51.835108 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:15:51.835108 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:15:51.835108 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:15:51.835108 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:15:51.835108 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:15:51.835108 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:15:51.835986 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:15:51.835986 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:15:51.835986 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:15:51.835986 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:15:51.835986 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:15:51.835986 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:15:51.835986 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:15:51.835986 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:15:51.835986 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:15:51.835986 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:15:51.835986 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:15:51.835986 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:15:51.835986 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:15:51.835986 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:15:51.835986 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:15:51.835986 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:15:51.836735 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:15:51.836735 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:15:51.836735 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:15:51.836735 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:15:51.836735 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:15:51.836735 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:15:51.836735 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:15:51.836735 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:15:51.836735 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:15:51.836735 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:15:51.836735 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 01:15:51.836735 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:15:51.836735 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 79/146] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 30 01:15:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:15:51.843894 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e68eb-0b93-4d82-8402-c98e7f4b03d9 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:51.961085 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e68eb-0b93-4d82-8402-c98e7f4b03d9 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:52.003201 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2840dee4-8a08-4a2c-b69f-415d822f6336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:52.003840 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2840dee4-8a08-4a2c-b69f-415d822f6336 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:52.006596 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2840dee4-8a08-4a2c-b69f-415d822f6336 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:52.006893 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2840dee4-8a08-4a2c-b69f-415d822f6336 None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:52.007624 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2840dee4-8a08-4a2c-b69f-415d822f6336 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:15:52.007928 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2840dee4-8a08-4a2c-b69f-415d822f6336 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:52.009360 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2840dee4-8a08-4a2c-b69f-415d822f6336 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:52.020418 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 68/147] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Aug 30 01:15:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:52.026297 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a263842-da6a-44eb-ab11-db590077f162 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:52.078308 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:52.083925 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2840dee4-8a08-4a2c-b69f-415d822f6336 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:52.093790 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:52.191989 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a263842-da6a-44eb-ab11-db590077f162 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:52.248232 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f832c98c-4e53-4d61-b81e-de42782521df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:52.248894 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832c98c-4e53-4d61-b81e-de42782521df None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:52.249175 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832c98c-4e53-4d61-b81e-de42782521df None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:52.249448 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832c98c-4e53-4d61-b81e-de42782521df None admin] PATH_INFO: `/v3/users/7a56bbfc21b54fcd8a7ff7c3c96fe853` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:52.250528 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2840dee4-8a08-4a2c-b69f-415d822f6336 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:52.250636 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f832c98c-4e53-4d61-b81e-de42782521df None admin] RBAC: Authorizing `identity:get_user(user_id=7a56bbfc21b54fcd8a7ff7c3c96fe853)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:52.256297 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f832c98c-4e53-4d61-b81e-de42782521df None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:52.258069 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 80/148] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 30 01:15:52 2022] GET /identity/v3/users/7a56bbfc21b54fcd8a7ff7c3c96fe853 => generated 289 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:15:52.263702 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f832c98c-4e53-4d61-b81e-de42782521df None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:52.305658 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3048aa3d-81a2-4509-b712-fd8a0903f507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:52.306317 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3048aa3d-81a2-4509-b712-fd8a0903f507 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:52.306605 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3048aa3d-81a2-4509-b712-fd8a0903f507 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:52.306879 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3048aa3d-81a2-4509-b712-fd8a0903f507 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:52.326077 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3048aa3d-81a2-4509-b712-fd8a0903f507 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:15:52.335910 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-3048aa3d-81a2-4509-b712-fd8a0903f507 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 01:15:52.335910 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:15:52.335910 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:15:52.335910 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:15:52.335910 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:15:52.335910 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:15:52.335910 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:15:52.335910 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:15:52.335910 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:15:52.335910 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:15:52.335910 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:15:52.335910 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:15:52.335910 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:15:52.335910 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:15:52.335910 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:15:52.335910 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:15:52.336768 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:15:52.336768 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:15:52.336768 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:15:52.336768 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:15:52.336768 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:15:52.336768 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:15:52.336768 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:15:52.336768 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:15:52.336768 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:15:52.336768 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:15:52.336768 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:15:52.336768 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:15:52.336768 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:15:52.336768 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:15:52.336768 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:15:52.336768 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:15:52.337523 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:15:52.337523 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:15:52.337523 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:15:52.337523 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:15:52.337523 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:15:52.337523 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:15:52.337523 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:15:52.337523 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:15:52.337523 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:15:52.337523 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:15:52.337523 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 01:15:52.337523 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:15:52.337523 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 69/149] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 30 01:15:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:15:52.344557 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3048aa3d-81a2-4509-b712-fd8a0903f507 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:52.420197 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f832c98c-4e53-4d61-b81e-de42782521df None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:52.439745 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:52.452221 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:52.500172 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0cf18-dc68-46e2-b8f5-1a15a24f6b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:52.500829 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0cf18-dc68-46e2-b8f5-1a15a24f6b1d None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:52.501118 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0cf18-dc68-46e2-b8f5-1a15a24f6b1d None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:52.501394 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0cf18-dc68-46e2-b8f5-1a15a24f6b1d None admin] PATH_INFO: `/v3/projects/023703a6c5664626b371621981c1b1ba` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:52.502448 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3048aa3d-81a2-4509-b712-fd8a0903f507 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:52.502963 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a0cf18-dc68-46e2-b8f5-1a15a24f6b1d None admin] RBAC: Authorizing `identity:get_project(project_id=023703a6c5664626b371621981c1b1ba)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:52.504622 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a0cf18-dc68-46e2-b8f5-1a15a24f6b1d None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:52.506448 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 81/150] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 30 01:15:52 2022] GET /identity/v3/projects/023703a6c5664626b371621981c1b1ba => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:15:52.512596 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0cf18-dc68-46e2-b8f5-1a15a24f6b1d None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:52.553197 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a46a7bb-baa2-412d-9c61-a71c10109e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:52.554217 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46a7bb-baa2-412d-9c61-a71c10109e3e None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:52.554217 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46a7bb-baa2-412d-9c61-a71c10109e3e None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:52.554478 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46a7bb-baa2-412d-9c61-a71c10109e3e None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:52.555101 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a46a7bb-baa2-412d-9c61-a71c10109e3e None admin] RBAC: Adding query filter params (name=member) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:15:52.559516 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a46a7bb-baa2-412d-9c61-a71c10109e3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:52.559516 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a46a7bb-baa2-412d-9c61-a71c10109e3e None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:52.566116 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 70/151] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Aug 30 01:15:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:52.606467 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a46a7bb-baa2-412d-9c61-a71c10109e3e None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:52.667459 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0cf18-dc68-46e2-b8f5-1a15a24f6b1d None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:52.721730 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c7308-5db4-475a-8a09-7fdfbb020a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:52.723331 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c7308-5db4-475a-8a09-7fdfbb020a28 None admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:52.723826 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c7308-5db4-475a-8a09-7fdfbb020a28 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:52.724288 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c7308-5db4-475a-8a09-7fdfbb020a28 None admin] PATH_INFO: `/v3/projects/023703a6c5664626b371621981c1b1ba/users/7a56bbfc21b54fcd8a7ff7c3c96fe853/roles/c2266dd88cfd4bdbb73eea767bcd4bac` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:52.732948 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5c7308-5db4-475a-8a09-7fdfbb020a28 None admin] RBAC: Authorizing `identity:create_grant(project_id=023703a6c5664626b371621981c1b1ba, user_id=7a56bbfc21b54fcd8a7ff7c3c96fe853, role_id=c2266dd88cfd4bdbb73eea767bcd4bac)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:52.734747 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5c7308-5db4-475a-8a09-7fdfbb020a28 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:52.765425 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 82/152] 10.222.0.60 () {58 vars in 1439 bytes} [Tue Aug 30 01:15:52 2022] PUT /identity/v3/projects/023703a6c5664626b371621981c1b1ba/users/7a56bbfc21b54fcd8a7ff7c3c96fe853/roles/c2266dd88cfd4bdbb73eea767bcd4bac => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:15:52.769535 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a46a7bb-baa2-412d-9c61-a71c10109e3e None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:52.805127 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:52.813959 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db556019-7b94-44f3-863f-a6a76d1a9579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:52.814520 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db556019-7b94-44f3-863f-a6a76d1a9579 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:52.814798 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db556019-7b94-44f3-863f-a6a76d1a9579 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:52.815064 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db556019-7b94-44f3-863f-a6a76d1a9579 None admin] PATH_INFO: `/v3/users/40d2c2b96e7d483aba514a9499f4459d` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:52.818936 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db556019-7b94-44f3-863f-a6a76d1a9579 None admin] RBAC: Authorizing `identity:get_user(user_id=40d2c2b96e7d483aba514a9499f4459d)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:52.820712 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db556019-7b94-44f3-863f-a6a76d1a9579 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:52.822542 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 71/153] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 30 01:15:52 2022] GET /identity/v3/users/40d2c2b96e7d483aba514a9499f4459d => generated 275 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:52.828352 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c7308-5db4-475a-8a09-7fdfbb020a28 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:52.891060 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:52.965727 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c7308-5db4-475a-8a09-7fdfbb020a28 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:53.009172 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05afa2d-025c-4002-ad35-ac64c8c0e4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:53.009851 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05afa2d-025c-4002-ad35-ac64c8c0e4c4 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:53.010130 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05afa2d-025c-4002-ad35-ac64c8c0e4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:53.010397 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05afa2d-025c-4002-ad35-ac64c8c0e4c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:53.092469 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05afa2d-025c-4002-ad35-ac64c8c0e4c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:53.093899 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05afa2d-025c-4002-ad35-ac64c8c0e4c4 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:53.138660 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:53.210708 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 83/154] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 30 01:15:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:53.220437 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db556019-7b94-44f3-863f-a6a76d1a9579 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:53.351848 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db556019-7b94-44f3-863f-a6a76d1a9579 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:53.400393 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c3092-044d-4669-b7a0-d650d8573332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:53.401406 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c3092-044d-4669-b7a0-d650d8573332 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:53.401878 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c3092-044d-4669-b7a0-d650d8573332 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:53.402338 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c3092-044d-4669-b7a0-d650d8573332 None admin] PATH_INFO: `/v3/projects/023703a6c5664626b371621981c1b1ba` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:53.403704 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6c3092-044d-4669-b7a0-d650d8573332 None admin] RBAC: Authorizing `identity:get_project(project_id=023703a6c5664626b371621981c1b1ba)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:53.405381 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6c3092-044d-4669-b7a0-d650d8573332 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:53.407217 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 72/155] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 30 01:15:53 2022] GET /identity/v3/projects/023703a6c5664626b371621981c1b1ba => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:53.413887 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05afa2d-025c-4002-ad35-ac64c8c0e4c4 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:53.463677 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276fc345-5130-4c43-872d-60564b22121c None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:53.464294 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276fc345-5130-4c43-872d-60564b22121c None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:53.464761 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276fc345-5130-4c43-872d-60564b22121c None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:53.466879 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 73/156] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:15:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:15:53.477470 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4cd5e7-af87-48ad-8a49-c52fc61883ef None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:53.478052 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4cd5e7-af87-48ad-8a49-c52fc61883ef None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:53.478514 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4cd5e7-af87-48ad-8a49-c52fc61883ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:53.518282 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-bb4cd5e7-af87-48ad-8a49-c52fc61883ef None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:53.520407 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-bb4cd5e7-af87-48ad-8a49-c52fc61883ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:53.569765 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05afa2d-025c-4002-ad35-ac64c8c0e4c4 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:53.620107 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f7071-731c-499f-b943-84ea445c0c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:53.620654 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f7071-731c-499f-b943-84ea445c0c93 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:53.620931 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f7071-731c-499f-b943-84ea445c0c93 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:53.621198 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f7071-731c-499f-b943-84ea445c0c93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:53.621938 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f7071-731c-499f-b943-84ea445c0c93 None admin] RBAC: Adding query filter params (role.id=5b38bd827c5847969c4ee48e27261f5b, scope.project.id=023703a6c5664626b371621981c1b1ba, user.id=40d2c2b96e7d483aba514a9499f4459d) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:15:53.622243 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f7071-731c-499f-b943-84ea445c0c93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:53.627786 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f7071-731c-499f-b943-84ea445c0c93 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:53.634906 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 84/157] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 30 01:15:53 2022] GET /identity/v3/role_assignments?user.id=40d2c2b96e7d483aba514a9499f4459d&scope.project.id=023703a6c5664626b371621981c1b1ba&role.id=5b38bd827c5847969c4ee48e27261f5b => generated 608 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:53.636210 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a06b4-3090-44a5-ad87-717e07cc2bb6 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:53.636490 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a06b4-3090-44a5-ad87-717e07cc2bb6 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:53.636760 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a06b4-3090-44a5-ad87-717e07cc2bb6 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:53.638099 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 85/158] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:15:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:15:53.643618 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47065a-253c-4f05-842a-bc8fc2401ef4 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:53.643888 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47065a-253c-4f05-842a-bc8fc2401ef4 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:53.644166 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47065a-253c-4f05-842a-bc8fc2401ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:53.659804 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:53.663767 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:53.682072 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 74/159] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:15:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 01:15:53.683733 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-3f47065a-253c-4f05-842a-bc8fc2401ef4 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:53.684960 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-3f47065a-253c-4f05-842a-bc8fc2401ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:53.808117 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 86/160] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:15:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:15:54.161317 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4cd5e7-af87-48ad-8a49-c52fc61883ef None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:54.271375 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4cd5e7-af87-48ad-8a49-c52fc61883ef None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:54.317897 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86382d97-ef07-4150-baf8-4b8c802e3c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:54.318922 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86382d97-ef07-4150-baf8-4b8c802e3c17 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:54.319406 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86382d97-ef07-4150-baf8-4b8c802e3c17 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:54.319924 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86382d97-ef07-4150-baf8-4b8c802e3c17 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:54.340553 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86382d97-ef07-4150-baf8-4b8c802e3c17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:15:54.345818 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-86382d97-ef07-4150-baf8-4b8c802e3c17 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:15:54.345818 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:15:54.345818 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:15:54.345818 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:15:54.345818 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:15:54.345818 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:15:54.345818 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:15:54.345818 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:15:54.345818 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:15:54.345818 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:15:54.345818 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:15:54.345818 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:15:54.345818 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:15:54.345818 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:15:54.345818 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:15:54.345818 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:15:54.346756 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:15:54.346756 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:15:54.346756 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:15:54.346756 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:15:54.346756 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:15:54.346756 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:15:54.346756 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:15:54.346756 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:15:54.346756 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:15:54.346756 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:15:54.346756 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:15:54.346756 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:15:54.346756 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:15:54.346756 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:15:54.346756 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:15:54.346756 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:15:54.347616 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:15:54.347616 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:15:54.347616 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:15:54.347616 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:15:54.347616 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:15:54.347616 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:15:54.347616 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:15:54.347616 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:15:54.347616 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:15:54.347616 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:15:54.347616 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:15:54.347616 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:15:54.349884 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 75/161] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 30 01:15:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:15:54.356031 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f47065a-253c-4f05-842a-bc8fc2401ef4 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:54.364188 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed723b-b646-4111-9dba-a04d18482e30 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:54.364819 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed723b-b646-4111-9dba-a04d18482e30 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:54.365305 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed723b-b646-4111-9dba-a04d18482e30 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:54.366851 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 76/162] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:15:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:15:54.384105 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802a66b-ee59-4f33-a5a3-26e8191d7ab1 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:54.384739 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802a66b-ee59-4f33-a5a3-26e8191d7ab1 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:54.385232 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802a66b-ee59-4f33-a5a3-26e8191d7ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:54.409359 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-7802a66b-ee59-4f33-a5a3-26e8191d7ab1 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:54.410972 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-7802a66b-ee59-4f33-a5a3-26e8191d7ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:54.490017 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f47065a-253c-4f05-842a-bc8fc2401ef4 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:54.506121 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:54.533794 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 77/163] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:15:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 01:15:54.538696 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7802a66b-ee59-4f33-a5a3-26e8191d7ab1 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:54.580155 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9312364-10d4-493e-a520-aae3c757a687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:54.580957 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9312364-10d4-493e-a520-aae3c757a687 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:54.581323 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9312364-10d4-493e-a520-aae3c757a687 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:54.581683 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9312364-10d4-493e-a520-aae3c757a687 None admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:54.582499 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9312364-10d4-493e-a520-aae3c757a687 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:15:54.582892 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9312364-10d4-493e-a520-aae3c757a687 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:54.584393 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9312364-10d4-493e-a520-aae3c757a687 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:54.586251 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:54.616979 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 87/164] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 30 01:15:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:54.631105 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9312364-10d4-493e-a520-aae3c757a687 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:54.741791 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7802a66b-ee59-4f33-a5a3-26e8191d7ab1 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:54.802994 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe1b21-7e5c-484d-b963-5ff1ac87fe44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:54.804900 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe1b21-7e5c-484d-b963-5ff1ac87fe44 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:54.805346 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe1b21-7e5c-484d-b963-5ff1ac87fe44 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:54.805780 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe1b21-7e5c-484d-b963-5ff1ac87fe44 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:54.813137 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9312364-10d4-493e-a520-aae3c757a687 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:54.828344 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabe1b21-7e5c-484d-b963-5ff1ac87fe44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:15:54.834295 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-eabe1b21-7e5c-484d-b963-5ff1ac87fe44 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 01:15:54.834295 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:15:54.834295 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:15:54.834295 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:15:54.834295 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:15:54.834295 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:15:54.834295 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:15:54.834295 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:15:54.834295 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:15:54.834295 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:15:54.834295 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:15:54.834295 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:15:54.834295 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:15:54.834295 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:15:54.834295 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:15:54.834295 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:15:54.835254 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:15:54.835254 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:15:54.835254 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:15:54.835254 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:15:54.835254 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:15:54.835254 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:15:54.835254 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:15:54.835254 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:15:54.835254 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:15:54.835254 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:15:54.835254 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:15:54.835254 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:15:54.835254 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:15:54.835254 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:15:54.835254 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:15:54.835254 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:15:54.836049 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:15:54.836049 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:15:54.836049 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:15:54.836049 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:15:54.836049 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:15:54.836049 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:15:54.836049 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:15:54.836049 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:15:54.836049 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:15:54.836049 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:15:54.836049 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 01:15:54.836049 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:15:54.838275 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 78/165] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Aug 30 01:15:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:15:54.844382 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe1b21-7e5c-484d-b963-5ff1ac87fe44 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:54.850291 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b8800-1711-40dc-889e-4fd5a0895b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:54.851029 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b8800-1711-40dc-889e-4fd5a0895b1f None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:54.851507 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b8800-1711-40dc-889e-4fd5a0895b1f None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:54.851894 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b8800-1711-40dc-889e-4fd5a0895b1f None admin] PATH_INFO: `/v3/users/68ff671606954cb48c45e22d8978bcf2` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:54.853131 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0b8800-1711-40dc-889e-4fd5a0895b1f None admin] RBAC: Authorizing `identity:get_user(user_id=68ff671606954cb48c45e22d8978bcf2)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:54.854680 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0b8800-1711-40dc-889e-4fd5a0895b1f None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:54.863912 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 88/166] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 30 01:15:54 2022] GET /identity/v3/users/68ff671606954cb48c45e22d8978bcf2 => generated 247 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:54.863912 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b8800-1711-40dc-889e-4fd5a0895b1f None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:54.913703 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:55.005836 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:55.020733 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe1b21-7e5c-484d-b963-5ff1ac87fe44 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:55.066748 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b8800-1711-40dc-889e-4fd5a0895b1f None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:55.072421 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b38243-8d99-4d7c-9309-2f86bc2e4490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:55.073044 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b38243-8d99-4d7c-9309-2f86bc2e4490 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:55.073325 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b38243-8d99-4d7c-9309-2f86bc2e4490 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:55.073596 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b38243-8d99-4d7c-9309-2f86bc2e4490 None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:55.074380 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b38243-8d99-4d7c-9309-2f86bc2e4490 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:15:55.074687 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b38243-8d99-4d7c-9309-2f86bc2e4490 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:55.076102 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b38243-8d99-4d7c-9309-2f86bc2e4490 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:55.094717 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 79/167] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 30 01:15:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:15:55.095714 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b38243-8d99-4d7c-9309-2f86bc2e4490 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:55.125048 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df14f4-ec1a-48e6-91c4-43c1e5242ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:55.125678 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df14f4-ec1a-48e6-91c4-43c1e5242ed6 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:55.125958 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df14f4-ec1a-48e6-91c4-43c1e5242ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:55.126233 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df14f4-ec1a-48e6-91c4-43c1e5242ed6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:55.236856 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97df14f4-ec1a-48e6-91c4-43c1e5242ed6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:55.238873 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97df14f4-ec1a-48e6-91c4-43c1e5242ed6 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:55.279730 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b38243-8d99-4d7c-9309-2f86bc2e4490 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:55.292718 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:55.358967 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:55.362453 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a810afc-5c89-46dd-a4f7-3c47bdbbbe0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:55.365455 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a810afc-5c89-46dd-a4f7-3c47bdbbbe0a None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:55.365754 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a810afc-5c89-46dd-a4f7-3c47bdbbbe0a None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:55.366032 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a810afc-5c89-46dd-a4f7-3c47bdbbbe0a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:55.400419 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a810afc-5c89-46dd-a4f7-3c47bdbbbe0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:15:55.406802 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-7a810afc-5c89-46dd-a4f7-3c47bdbbbe0a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 01:15:55.406802 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:15:55.406802 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:15:55.406802 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:15:55.406802 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:15:55.406802 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:15:55.406802 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:15:55.406802 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:15:55.406802 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:15:55.406802 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:15:55.406802 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:15:55.406802 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:15:55.406802 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:15:55.406802 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:15:55.406802 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:15:55.406802 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:15:55.407701 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:15:55.407701 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:15:55.407701 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:15:55.407701 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:15:55.407701 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:15:55.407701 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:15:55.407701 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:15:55.407701 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:15:55.407701 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:15:55.407701 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:15:55.407701 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:15:55.407701 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:15:55.407701 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:15:55.407701 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:15:55.407701 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:15:55.407701 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:15:55.408468 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:15:55.408468 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:15:55.408468 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:15:55.408468 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:15:55.408468 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:15:55.408468 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:15:55.408468 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:15:55.408468 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:15:55.408468 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:15:55.408468 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:15:55.408468 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 01:15:55.408468 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:15:55.408468 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 80/168] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 30 01:15:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:15:55.415062 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a810afc-5c89-46dd-a4f7-3c47bdbbbe0a None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:55.436789 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 89/169] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 30 01:15:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 01:15:55.437815 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df14f4-ec1a-48e6-91c4-43c1e5242ed6 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:55.619472 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df14f4-ec1a-48e6-91c4-43c1e5242ed6 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:55.659871 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a810afc-5c89-46dd-a4f7-3c47bdbbbe0a None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:55.673935 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d7d71-76aa-494f-987e-aa13fbf33c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:55.674617 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d7d71-76aa-494f-987e-aa13fbf33c90 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:55.675109 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d7d71-76aa-494f-987e-aa13fbf33c90 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:55.675647 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d7d71-76aa-494f-987e-aa13fbf33c90 None admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:55.677118 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2d7d71-76aa-494f-987e-aa13fbf33c90 None admin] RBAC: Adding query filter params (name=member) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:15:55.677426 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2d7d71-76aa-494f-987e-aa13fbf33c90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:55.678949 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2d7d71-76aa-494f-987e-aa13fbf33c90 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:55.689748 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 90/170] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Aug 30 01:15:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:55.690997 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d7d71-76aa-494f-987e-aa13fbf33c90 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:55.722540 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:55.732150 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b57854f-3942-4f76-b463-af29a81ea4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:55.732804 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57854f-3942-4f76-b463-af29a81ea4f3 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:55.733091 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57854f-3942-4f76-b463-af29a81ea4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:55.733358 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57854f-3942-4f76-b463-af29a81ea4f3 None admin] PATH_INFO: `/v3/users/40d2c2b96e7d483aba514a9499f4459d` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:55.734531 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b57854f-3942-4f76-b463-af29a81ea4f3 None admin] RBAC: Authorizing `identity:get_user(user_id=40d2c2b96e7d483aba514a9499f4459d)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:55.736040 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b57854f-3942-4f76-b463-af29a81ea4f3 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:55.737626 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 81/171] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 30 01:15:55 2022] GET /identity/v3/users/40d2c2b96e7d483aba514a9499f4459d => generated 275 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:55.739314 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889f2fe-2bae-44f8-a4e4-50c10dc01cec None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:55.739618 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889f2fe-2bae-44f8-a4e4-50c10dc01cec None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:55.739886 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889f2fe-2bae-44f8-a4e4-50c10dc01cec None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:55.747809 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 82/172] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:15:55 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:15:55.748651 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9889f2fe-2bae-44f8-a4e4-50c10dc01cec None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:55.810796 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d7d71-76aa-494f-987e-aa13fbf33c90 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:55.833751 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:55.850237 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc0ec0-f663-4b48-86c1-3863678d51ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:55.850931 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc0ec0-f663-4b48-86c1-3863678d51ce None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:55.851287 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc0ec0-f663-4b48-86c1-3863678d51ce None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:55.851664 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc0ec0-f663-4b48-86c1-3863678d51ce None admin] PATH_INFO: `/v3/projects/023703a6c5664626b371621981c1b1ba` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:55.852932 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fc0ec0-f663-4b48-86c1-3863678d51ce None admin] RBAC: Authorizing `identity:get_project(project_id=023703a6c5664626b371621981c1b1ba)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:55.854382 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fc0ec0-f663-4b48-86c1-3863678d51ce None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:55.856570 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 91/173] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 30 01:15:55 2022] GET /identity/v3/projects/023703a6c5664626b371621981c1b1ba => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:55.857343 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc0ec0-f663-4b48-86c1-3863678d51ce None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:55.929170 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9889f2fe-2bae-44f8-a4e4-50c10dc01cec None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:55.964174 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed70f9-9422-4273-8966-a09e11c51ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:55.964799 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed70f9-9422-4273-8966-a09e11c51ad5 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:55.965334 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed70f9-9422-4273-8966-a09e11c51ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:55.965604 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed70f9-9422-4273-8966-a09e11c51ad5 None admin] PATH_INFO: `/v3/users/40d2c2b96e7d483aba514a9499f4459d` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:55.966725 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fed70f9-9422-4273-8966-a09e11c51ad5 None admin] RBAC: Authorizing `identity:get_user(user_id=40d2c2b96e7d483aba514a9499f4459d)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:55.968198 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fed70f9-9422-4273-8966-a09e11c51ad5 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:55.969763 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 83/174] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 30 01:15:55 2022] GET /identity/v3/users/40d2c2b96e7d483aba514a9499f4459d => generated 275 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:55.971833 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:55.976212 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96e26f-e3c5-4f59-b59d-d2f82be14a90 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:55.976583 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96e26f-e3c5-4f59-b59d-d2f82be14a90 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:55.976860 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96e26f-e3c5-4f59-b59d-d2f82be14a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:55.980751 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc0ec0-f663-4b48-86c1-3863678d51ce None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:55.996055 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-8b96e26f-e3c5-4f59-b59d-d2f82be14a90 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:55.997251 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-8b96e26f-e3c5-4f59-b59d-d2f82be14a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:56.017512 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cf3cb4-cf77-48aa-8ac0-ffa6bb3220e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:56.018118 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf3cb4-cf77-48aa-8ac0-ffa6bb3220e4 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:56.018394 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf3cb4-cf77-48aa-8ac0-ffa6bb3220e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:56.018663 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf3cb4-cf77-48aa-8ac0-ffa6bb3220e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:56.076568 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 84/175] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:15:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:15:56.084741 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7dade2-4c9e-4eba-8c48-d5644c4526a9 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:56.085012 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7dade2-4c9e-4eba-8c48-d5644c4526a9 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:56.085286 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7dade2-4c9e-4eba-8c48-d5644c4526a9 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:56.090844 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 85/176] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:15:56 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:15:56.090844 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7dade2-4c9e-4eba-8c48-d5644c4526a9 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:56.098746 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cf3cb4-cf77-48aa-8ac0-ffa6bb3220e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:56.100395 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cf3cb4-cf77-48aa-8ac0-ffa6bb3220e4 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:56.131226 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:56.206028 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7dade2-4c9e-4eba-8c48-d5644c4526a9 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:56.220899 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:56.238357 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 92/177] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 30 01:15:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:56.238357 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6ad9b-2525-4616-966c-622e9ddd248d None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:56.238357 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6ad9b-2525-4616-966c-622e9ddd248d None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:56.239402 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6ad9b-2525-4616-966c-622e9ddd248d None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:56.240127 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 93/178] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:15:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:15:56.240851 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6ad9b-2525-4616-966c-622e9ddd248d None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:56.258410 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f74ed54-e435-4084-83bd-5fafbe2d58d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:56.259025 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74ed54-e435-4084-83bd-5fafbe2d58d5 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:56.259299 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74ed54-e435-4084-83bd-5fafbe2d58d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:56.259816 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74ed54-e435-4084-83bd-5fafbe2d58d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:56.260333 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f74ed54-e435-4084-83bd-5fafbe2d58d5 None admin] RBAC: Adding query filter params (role.id=f6bc03b6972e420eb338ee7fd1443974, scope.project.id=023703a6c5664626b371621981c1b1ba, user.id=68ff671606954cb48c45e22d8978bcf2) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:15:56.260640 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f74ed54-e435-4084-83bd-5fafbe2d58d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:56.262106 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f74ed54-e435-4084-83bd-5fafbe2d58d5 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:56.268127 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 86/179] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 30 01:15:56 2022] GET /identity/v3/role_assignments?user.id=68ff671606954cb48c45e22d8978bcf2&scope.project.id=023703a6c5664626b371621981c1b1ba&role.id=f6bc03b6972e420eb338ee7fd1443974 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:56.269460 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff6c2a-1706-422c-80e3-a349de5ab2f3 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:56.270323 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff6c2a-1706-422c-80e3-a349de5ab2f3 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:56.270600 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff6c2a-1706-422c-80e3-a349de5ab2f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:56.292319 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-1bff6c2a-1706-422c-80e3-a349de5ab2f3 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:56.294168 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-1bff6c2a-1706-422c-80e3-a349de5ab2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:56.374364 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 87/180] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:15:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:15:56.380021 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bff6c2a-1706-422c-80e3-a349de5ab2f3 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:56.392082 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6ad9b-2525-4616-966c-622e9ddd248d None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:56.412324 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:56.437034 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92260445-b895-4ed7-9ece-fb57e89aecef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:56.438187 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92260445-b895-4ed7-9ece-fb57e89aecef None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:56.438613 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92260445-b895-4ed7-9ece-fb57e89aecef None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:56.439249 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92260445-b895-4ed7-9ece-fb57e89aecef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:56.505466 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bff6c2a-1706-422c-80e3-a349de5ab2f3 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:56.524475 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:56.537881 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92260445-b895-4ed7-9ece-fb57e89aecef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:56.539697 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92260445-b895-4ed7-9ece-fb57e89aecef None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:56.544956 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9a03c6-9a48-44c5-be12-8ff87780eb1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:56.545771 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a03c6-9a48-44c5-be12-8ff87780eb1b None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:56.546294 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a03c6-9a48-44c5-be12-8ff87780eb1b None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:56.546815 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a03c6-9a48-44c5-be12-8ff87780eb1b None admin] PATH_INFO: `/v3/projects/023703a6c5664626b371621981c1b1ba` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:56.547956 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9a03c6-9a48-44c5-be12-8ff87780eb1b None admin] RBAC: Authorizing `identity:get_project(project_id=023703a6c5664626b371621981c1b1ba)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:56.549575 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9a03c6-9a48-44c5-be12-8ff87780eb1b None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:56.551468 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 88/181] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 30 01:15:56 2022] GET /identity/v3/projects/023703a6c5664626b371621981c1b1ba => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:56.552388 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884c6d5-44bc-41fa-b934-900c03efb7a8 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:56.552667 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884c6d5-44bc-41fa-b934-900c03efb7a8 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:56.552937 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884c6d5-44bc-41fa-b934-900c03efb7a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:56.576025 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-9884c6d5-44bc-41fa-b934-900c03efb7a8 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:56.577442 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-9884c6d5-44bc-41fa-b934-900c03efb7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:56.654908 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 94/182] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 30 01:15:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:56.656163 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 89/183] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:15:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:15:56.657227 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9884c6d5-44bc-41fa-b934-900c03efb7a8 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:56.662312 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a640c-61e5-48c0-b2e5-7e1b7699c03b None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:56.662529 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a640c-61e5-48c0-b2e5-7e1b7699c03b None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:56.662813 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a640c-61e5-48c0-b2e5-7e1b7699c03b None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:56.664354 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 95/184] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:15:56 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:15:56.665032 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a640c-61e5-48c0-b2e5-7e1b7699c03b None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:56.689559 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:56.763877 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:56.771314 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9884c6d5-44bc-41fa-b934-900c03efb7a8 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:56.772702 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a640c-61e5-48c0-b2e5-7e1b7699c03b None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:56.809611 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c626cc-93b8-40db-9c49-207e4c0cdf42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:56.810101 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a304aa-6dd8-41f2-8707-501defe8ccf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:56.810235 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c626cc-93b8-40db-9c49-207e4c0cdf42 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:56.810513 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c626cc-93b8-40db-9c49-207e4c0cdf42 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:56.810710 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a304aa-6dd8-41f2-8707-501defe8ccf6 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:56.810805 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c626cc-93b8-40db-9c49-207e4c0cdf42 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:56.810990 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a304aa-6dd8-41f2-8707-501defe8ccf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:56.811356 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a304aa-6dd8-41f2-8707-501defe8ccf6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:56.812202 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a304aa-6dd8-41f2-8707-501defe8ccf6 None admin] RBAC: Adding query filter params (role.id=449624f20ef248ef97aeceba5b22eccd, scope.project.id=023703a6c5664626b371621981c1b1ba, user.id=40d2c2b96e7d483aba514a9499f4459d) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:15:56.812515 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a304aa-6dd8-41f2-8707-501defe8ccf6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:56.813956 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a304aa-6dd8-41f2-8707-501defe8ccf6 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:56.827484 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 96/185] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 30 01:15:56 2022] GET /identity/v3/role_assignments?user.id=40d2c2b96e7d483aba514a9499f4459d&scope.project.id=023703a6c5664626b371621981c1b1ba&role.id=449624f20ef248ef97aeceba5b22eccd => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:56.827484 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a304aa-6dd8-41f2-8707-501defe8ccf6 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:56.830972 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c626cc-93b8-40db-9c49-207e4c0cdf42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:15:56.838059 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-57c626cc-93b8-40db-9c49-207e4c0cdf42 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:15:56.838059 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:15:56.838059 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:15:56.838059 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:15:56.838059 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:15:56.838059 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:15:56.838059 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:15:56.838059 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:15:56.838059 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:15:56.838059 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:15:56.838059 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:15:56.838059 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:15:56.838059 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:15:56.838059 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:15:56.838059 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:15:56.838059 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:15:56.839019 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:15:56.839019 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:15:56.839019 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:15:56.839019 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:15:56.839019 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:15:56.839019 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:15:56.839019 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:15:56.839019 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:15:56.839019 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:15:56.839019 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:15:56.839019 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:15:56.839019 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:15:56.839019 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:15:56.839019 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:15:56.839019 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:15:56.839019 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:15:56.839844 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:15:56.839844 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:15:56.839844 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:15:56.839844 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:15:56.839844 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:15:56.839844 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:15:56.839844 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:15:56.839844 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:15:56.839844 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:15:56.839844 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:15:56.839844 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:15:56.839844 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:15:56.839844 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 90/186] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 30 01:15:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:15:56.844387 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c626cc-93b8-40db-9c49-207e4c0cdf42 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:56.943206 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a304aa-6dd8-41f2-8707-501defe8ccf6 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:56.962677 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:56.983079 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c626cc-93b8-40db-9c49-207e4c0cdf42 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:56.992319 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8021bca4-348f-4091-982b-7407ea2b5a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:56.993052 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8021bca4-348f-4091-982b-7407ea2b5a4f None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:56.993324 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8021bca4-348f-4091-982b-7407ea2b5a4f None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:56.993644 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8021bca4-348f-4091-982b-7407ea2b5a4f None admin] PATH_INFO: `/v3/projects/461a99523fbb4b2abff004235ad031d8` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:56.994837 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8021bca4-348f-4091-982b-7407ea2b5a4f None admin] RBAC: Authorizing `identity:get_project(project_id=461a99523fbb4b2abff004235ad031d8)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:56.996340 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8021bca4-348f-4091-982b-7407ea2b5a4f None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:56.998807 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 97/187] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 30 01:15:56 2022] GET /identity/v3/projects/461a99523fbb4b2abff004235ad031d8 => generated 312 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:56.999946 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb87484-1b7e-4fb0-811f-c2cbbfd3f336 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:57.000233 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb87484-1b7e-4fb0-811f-c2cbbfd3f336 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:57.000509 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb87484-1b7e-4fb0-811f-c2cbbfd3f336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:57.021207 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-efb87484-1b7e-4fb0-811f-c2cbbfd3f336 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:57.022393 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-efb87484-1b7e-4fb0-811f-c2cbbfd3f336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:57.027748 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187ce020-484d-4393-9433-6e63c09ee6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:57.028380 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ce020-484d-4393-9433-6e63c09ee6a2 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:57.028655 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ce020-484d-4393-9433-6e63c09ee6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:57.028921 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ce020-484d-4393-9433-6e63c09ee6a2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:57.030031 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187ce020-484d-4393-9433-6e63c09ee6a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:57.031530 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187ce020-484d-4393-9433-6e63c09ee6a2 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:57.033272 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 91/188] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:15:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:57.033834 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187ce020-484d-4393-9433-6e63c09ee6a2 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:57.044496 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:57.096264 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 98/189] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:15:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:15:57.096941 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb87484-1b7e-4fb0-811f-c2cbbfd3f336 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:57.151289 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187ce020-484d-4393-9433-6e63c09ee6a2 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:57.187957 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5113d80f-3f10-476d-9cb5-f4f4970e6698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:57.188569 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113d80f-3f10-476d-9cb5-f4f4970e6698 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:57.188848 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113d80f-3f10-476d-9cb5-f4f4970e6698 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:57.189119 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113d80f-3f10-476d-9cb5-f4f4970e6698 None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:57.190198 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5113d80f-3f10-476d-9cb5-f4f4970e6698 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:15:57.190513 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5113d80f-3f10-476d-9cb5-f4f4970e6698 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:57.191971 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5113d80f-3f10-476d-9cb5-f4f4970e6698 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:57.200520 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 92/190] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 30 01:15:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:57.201088 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5113d80f-3f10-476d-9cb5-f4f4970e6698 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:57.203458 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb87484-1b7e-4fb0-811f-c2cbbfd3f336 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:57.218628 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:57.242988 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e42b085-2da0-466c-9c4e-f5234ea0bd93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:57.243174 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42b085-2da0-466c-9c4e-f5234ea0bd93 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:57.243477 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42b085-2da0-466c-9c4e-f5234ea0bd93 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:57.243753 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42b085-2da0-466c-9c4e-f5234ea0bd93 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:57.254088 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e42b085-2da0-466c-9c4e-f5234ea0bd93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:15:57.259022 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-0e42b085-2da0-466c-9c4e-f5234ea0bd93 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 01:15:57.259022 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:15:57.259022 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:15:57.259022 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:15:57.259022 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:15:57.259022 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:15:57.259022 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:15:57.259022 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:15:57.259022 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:15:57.259022 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:15:57.259022 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:15:57.259022 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:15:57.259022 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:15:57.259022 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:15:57.259022 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:15:57.259022 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:15:57.259937 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:15:57.259937 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:15:57.259937 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:15:57.259937 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:15:57.259937 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:15:57.259937 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:15:57.259937 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:15:57.259937 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:15:57.259937 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:15:57.259937 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:15:57.259937 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:15:57.259937 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:15:57.259937 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:15:57.259937 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:15:57.259937 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:15:57.259937 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:15:57.264421 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:15:57.264421 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:15:57.264421 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:15:57.264421 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:15:57.264421 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:15:57.264421 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:15:57.264421 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:15:57.264421 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:15:57.264421 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:15:57.264421 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:15:57.264421 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 01:15:57.264421 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:15:57.264421 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 99/191] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Aug 30 01:15:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:15:57.264421 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e42b085-2da0-466c-9c4e-f5234ea0bd93 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:57.280679 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:57.313405 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5113d80f-3f10-476d-9cb5-f4f4970e6698 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:57.349433 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987cba8e-bf0e-4a2b-b6b4-f1b87b140512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:57.350034 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987cba8e-bf0e-4a2b-b6b4-f1b87b140512 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:57.350310 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987cba8e-bf0e-4a2b-b6b4-f1b87b140512 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:57.350601 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987cba8e-bf0e-4a2b-b6b4-f1b87b140512 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:57.351300 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987cba8e-bf0e-4a2b-b6b4-f1b87b140512 None admin] RBAC: Adding query filter params (role.id=5b38bd827c5847969c4ee48e27261f5b, scope.project.id=461a99523fbb4b2abff004235ad031d8, user.id=40d2c2b96e7d483aba514a9499f4459d) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:15:57.351642 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987cba8e-bf0e-4a2b-b6b4-f1b87b140512 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:57.353187 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987cba8e-bf0e-4a2b-b6b4-f1b87b140512 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:57.367469 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 93/192] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 30 01:15:57 2022] GET /identity/v3/role_assignments?user.id=40d2c2b96e7d483aba514a9499f4459d&scope.project.id=461a99523fbb4b2abff004235ad031d8&role.id=5b38bd827c5847969c4ee48e27261f5b => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:57.367469 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987cba8e-bf0e-4a2b-b6b4-f1b87b140512 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:57.382658 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e42b085-2da0-466c-9c4e-f5234ea0bd93 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:57.419916 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d99b3-59f7-44f4-96de-6f319718c9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:57.420543 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d99b3-59f7-44f4-96de-6f319718c9ea None admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:57.420830 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d99b3-59f7-44f4-96de-6f319718c9ea None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:57.421100 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d99b3-59f7-44f4-96de-6f319718c9ea None admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:57.421765 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752d99b3-59f7-44f4-96de-6f319718c9ea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:57.423236 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752d99b3-59f7-44f4-96de-6f319718c9ea None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:57.448018 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 100/193] 10.222.0.60 () {60 vars in 1132 bytes} [Tue Aug 30 01:15:57 2022] POST /identity/v3/users => generated 297 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:15:57.455796 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d99b3-59f7-44f4-96de-6f319718c9ea None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:57.480054 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:57.528804 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987cba8e-bf0e-4a2b-b6b4-f1b87b140512 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:57.559137 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:57.595334 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b21b3-3aa8-4ff4-91e7-7ec27d14bbe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:57.596030 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b21b3-3aa8-4ff4-91e7-7ec27d14bbe6 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:57.596311 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b21b3-3aa8-4ff4-91e7-7ec27d14bbe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:57.596583 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b21b3-3aa8-4ff4-91e7-7ec27d14bbe6 None admin] PATH_INFO: `/v3/users/f5a4141642da477eb51d90acd8b1a0e2` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:57.609850 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d99b3-59f7-44f4-96de-6f319718c9ea None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:57.614829 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792b21b3-3aa8-4ff4-91e7-7ec27d14bbe6 None admin] RBAC: Authorizing `identity:get_user(user_id=f5a4141642da477eb51d90acd8b1a0e2)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:57.616402 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792b21b3-3aa8-4ff4-91e7-7ec27d14bbe6 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:57.618068 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 94/194] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 30 01:15:57 2022] GET /identity/v3/users/f5a4141642da477eb51d90acd8b1a0e2 => generated 283 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:57.618965 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b21b3-3aa8-4ff4-91e7-7ec27d14bbe6 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:57.652168 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b222b9e9-2eb2-4f4d-b285-a2b210af5b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:57.652782 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222b9e9-2eb2-4f4d-b285-a2b210af5b18 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:57.653063 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222b9e9-2eb2-4f4d-b285-a2b210af5b18 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:57.653428 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222b9e9-2eb2-4f4d-b285-a2b210af5b18 None admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:57.654121 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b222b9e9-2eb2-4f4d-b285-a2b210af5b18 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:15:57.654404 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b222b9e9-2eb2-4f4d-b285-a2b210af5b18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:57.655836 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b222b9e9-2eb2-4f4d-b285-a2b210af5b18 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:57.665595 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 101/195] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 30 01:15:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:57.666945 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b222b9e9-2eb2-4f4d-b285-a2b210af5b18 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:57.740296 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b21b3-3aa8-4ff4-91e7-7ec27d14bbe6 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:57.786859 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca425b69-5e5f-4da4-b051-a8d606a25a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:57.787992 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca425b69-5e5f-4da4-b051-a8d606a25a98 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:57.787992 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca425b69-5e5f-4da4-b051-a8d606a25a98 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:57.788179 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca425b69-5e5f-4da4-b051-a8d606a25a98 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:57.791472 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:57.797618 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b222b9e9-2eb2-4f4d-b285-a2b210af5b18 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:57.801027 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca425b69-5e5f-4da4-b051-a8d606a25a98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:15:57.807022 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-ca425b69-5e5f-4da4-b051-a8d606a25a98 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 01:15:57.807022 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:15:57.807022 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:15:57.807022 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:15:57.807022 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:15:57.807022 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:15:57.807022 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:15:57.807022 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:15:57.807022 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:15:57.807022 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:15:57.807022 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:15:57.807022 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:15:57.807022 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:15:57.807022 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:15:57.807022 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:15:57.807022 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:15:57.807931 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:15:57.807931 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:15:57.807931 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:15:57.807931 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:15:57.807931 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:15:57.807931 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:15:57.807931 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:15:57.807931 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:15:57.807931 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:15:57.807931 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:15:57.807931 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:15:57.807931 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:15:57.807931 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:15:57.807931 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:15:57.807931 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:15:57.807931 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:15:57.808709 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:15:57.808709 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:15:57.808709 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:15:57.808709 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:15:57.808709 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:15:57.808709 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:15:57.808709 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:15:57.808709 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:15:57.808709 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:15:57.808709 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:15:57.808709 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 01:15:57.808709 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:15:57.808709 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 95/196] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 30 01:15:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:15:57.808709 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca425b69-5e5f-4da4-b051-a8d606a25a98 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:57.841805 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d509445-ca51-40fb-ab67-faf5209f8d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:57.842421 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d509445-ca51-40fb-ab67-faf5209f8d2b None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:57.843006 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d509445-ca51-40fb-ab67-faf5209f8d2b None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:57.843113 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d509445-ca51-40fb-ab67-faf5209f8d2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:57.845983 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:57.919541 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d509445-ca51-40fb-ab67-faf5209f8d2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:57.921257 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d509445-ca51-40fb-ab67-faf5209f8d2b None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:57.936833 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca425b69-5e5f-4da4-b051-a8d606a25a98 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:57.975675 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaff4288-4e8f-407c-8751-7e4f27e4337f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:57.976638 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff4288-4e8f-407c-8751-7e4f27e4337f None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:57.977164 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff4288-4e8f-407c-8751-7e4f27e4337f None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:57.977634 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff4288-4e8f-407c-8751-7e4f27e4337f None admin] PATH_INFO: `/v3/users/f5a4141642da477eb51d90acd8b1a0e2` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:57.979086 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaff4288-4e8f-407c-8751-7e4f27e4337f None admin] RBAC: Authorizing `identity:get_user(user_id=f5a4141642da477eb51d90acd8b1a0e2)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:57.981040 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaff4288-4e8f-407c-8751-7e4f27e4337f None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:57.983247 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 96/197] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 30 01:15:57 2022] GET /identity/v3/users/f5a4141642da477eb51d90acd8b1a0e2 => generated 283 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:57.984420 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaff4288-4e8f-407c-8751-7e4f27e4337f None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:58.036679 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 102/198] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 30 01:15:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:58.036679 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d509445-ca51-40fb-ab67-faf5209f8d2b None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:58.062815 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:58.070691 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:58.108879 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaff4288-4e8f-407c-8751-7e4f27e4337f None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:58.152157 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d509445-ca51-40fb-ab67-faf5209f8d2b None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:58.153021 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b60386-f7c0-49f9-a87f-cd6a79f4b418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:58.153981 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b60386-f7c0-49f9-a87f-cd6a79f4b418 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:58.154554 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b60386-f7c0-49f9-a87f-cd6a79f4b418 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:58.154829 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b60386-f7c0-49f9-a87f-cd6a79f4b418 None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:58.155529 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b60386-f7c0-49f9-a87f-cd6a79f4b418 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:15:58.155839 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b60386-f7c0-49f9-a87f-cd6a79f4b418 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:58.157247 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b60386-f7c0-49f9-a87f-cd6a79f4b418 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:58.166426 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 97/199] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Aug 30 01:15:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:58.171678 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b60386-f7c0-49f9-a87f-cd6a79f4b418 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:58.188675 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39043e53-ab29-4b25-8e07-d3ff7ce49cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:58.189667 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39043e53-ab29-4b25-8e07-d3ff7ce49cb1 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:58.190236 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39043e53-ab29-4b25-8e07-d3ff7ce49cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:58.190705 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39043e53-ab29-4b25-8e07-d3ff7ce49cb1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:58.279455 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39043e53-ab29-4b25-8e07-d3ff7ce49cb1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:58.284713 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39043e53-ab29-4b25-8e07-d3ff7ce49cb1 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:58.288508 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b60386-f7c0-49f9-a87f-cd6a79f4b418 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:58.320522 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:58.322615 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:58.333170 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c0df6-fb56-4ca2-8ae1-156c38eec278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:58.333912 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c0df6-fb56-4ca2-8ae1-156c38eec278 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:58.334198 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c0df6-fb56-4ca2-8ae1-156c38eec278 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:58.334473 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c0df6-fb56-4ca2-8ae1-156c38eec278 None admin] PATH_INFO: `/v3/projects/32242e96e74d4bc797430f115ced8a19` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:58.335651 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8c0df6-fb56-4ca2-8ae1-156c38eec278 None admin] RBAC: Authorizing `identity:get_project(project_id=32242e96e74d4bc797430f115ced8a19)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:58.337308 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8c0df6-fb56-4ca2-8ae1-156c38eec278 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:58.339143 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 98/200] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 30 01:15:58 2022] GET /identity/v3/projects/32242e96e74d4bc797430f115ced8a19 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:58.344384 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c0df6-fb56-4ca2-8ae1-156c38eec278 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:58.402132 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 103/201] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 30 01:15:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:58.403172 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39043e53-ab29-4b25-8e07-d3ff7ce49cb1 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:58.469387 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c0df6-fb56-4ca2-8ae1-156c38eec278 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:58.510756 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39043e53-ab29-4b25-8e07-d3ff7ce49cb1 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:58.511874 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815ba054-bee4-46f9-a309-8d934075ffd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:58.512670 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ba054-bee4-46f9-a309-8d934075ffd7 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:58.512956 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ba054-bee4-46f9-a309-8d934075ffd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:58.513229 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ba054-bee4-46f9-a309-8d934075ffd7 None admin] PATH_INFO: `/v3/users/7a56bbfc21b54fcd8a7ff7c3c96fe853` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:58.515162 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815ba054-bee4-46f9-a309-8d934075ffd7 None admin] RBAC: Authorizing `identity:get_user(user_id=7a56bbfc21b54fcd8a7ff7c3c96fe853)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:58.516679 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815ba054-bee4-46f9-a309-8d934075ffd7 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:58.518269 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 99/202] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 30 01:15:58 2022] GET /identity/v3/users/7a56bbfc21b54fcd8a7ff7c3c96fe853 => generated 289 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:58.519028 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815ba054-bee4-46f9-a309-8d934075ffd7 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:58.554822 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b635f-29dc-406d-8f83-e1ccbc099b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:58.555581 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b635f-29dc-406d-8f83-e1ccbc099b23 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:58.556013 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b635f-29dc-406d-8f83-e1ccbc099b23 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:58.556353 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b635f-29dc-406d-8f83-e1ccbc099b23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:58.557241 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0b635f-29dc-406d-8f83-e1ccbc099b23 None admin] RBAC: Adding query filter params (role.id=f6bc03b6972e420eb338ee7fd1443974, scope.project.id=32242e96e74d4bc797430f115ced8a19, user.id=f5a4141642da477eb51d90acd8b1a0e2) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:15:58.557625 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0b635f-29dc-406d-8f83-e1ccbc099b23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:58.559189 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0b635f-29dc-406d-8f83-e1ccbc099b23 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:58.561280 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:58.569646 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 104/203] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 30 01:15:58 2022] GET /identity/v3/role_assignments?user.id=f5a4141642da477eb51d90acd8b1a0e2&scope.project.id=32242e96e74d4bc797430f115ced8a19&role.id=f6bc03b6972e420eb338ee7fd1443974 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:58.576454 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b635f-29dc-406d-8f83-e1ccbc099b23 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:58.609491 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:58.694175 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815ba054-bee4-46f9-a309-8d934075ffd7 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:58.770206 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f3e1a0-3834-4fec-857e-b6c4dd15a510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:58.770994 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f3e1a0-3834-4fec-857e-b6c4dd15a510 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:58.771156 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f3e1a0-3834-4fec-857e-b6c4dd15a510 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:58.771390 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f3e1a0-3834-4fec-857e-b6c4dd15a510 None admin] PATH_INFO: `/v3/projects/32242e96e74d4bc797430f115ced8a19` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:58.772605 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f3e1a0-3834-4fec-857e-b6c4dd15a510 None admin] RBAC: Authorizing `identity:get_project(project_id=32242e96e74d4bc797430f115ced8a19)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:58.774160 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f3e1a0-3834-4fec-857e-b6c4dd15a510 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:58.776193 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 100/204] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 30 01:15:58 2022] GET /identity/v3/projects/32242e96e74d4bc797430f115ced8a19 => generated 302 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:58.788344 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f3e1a0-3834-4fec-857e-b6c4dd15a510 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:58.816396 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b635f-29dc-406d-8f83-e1ccbc099b23 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:58.885814 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b11004-21c5-4acf-84f8-6db7bf4b18ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:58.886444 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b11004-21c5-4acf-84f8-6db7bf4b18ce None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:58.886726 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b11004-21c5-4acf-84f8-6db7bf4b18ce None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:58.887004 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b11004-21c5-4acf-84f8-6db7bf4b18ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:58.992549 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f3e1a0-3834-4fec-857e-b6c4dd15a510 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:59.015781 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:59.018478 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b11004-21c5-4acf-84f8-6db7bf4b18ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:59.020535 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b11004-21c5-4acf-84f8-6db7bf4b18ce None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:59.061392 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:59.075055 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12215dd4-f72b-41b4-b12a-51665085ba35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:59.075623 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12215dd4-f72b-41b4-b12a-51665085ba35 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:59.075906 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12215dd4-f72b-41b4-b12a-51665085ba35 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:59.076175 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12215dd4-f72b-41b4-b12a-51665085ba35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:59.076912 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12215dd4-f72b-41b4-b12a-51665085ba35 None admin] RBAC: Adding query filter params (role.id=449624f20ef248ef97aeceba5b22eccd, scope.project.id=32242e96e74d4bc797430f115ced8a19, user.id=f5a4141642da477eb51d90acd8b1a0e2) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:15:59.077220 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12215dd4-f72b-41b4-b12a-51665085ba35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:59.078674 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12215dd4-f72b-41b4-b12a-51665085ba35 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:59.087281 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 101/205] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 30 01:15:58 2022] GET /identity/v3/role_assignments?user.id=f5a4141642da477eb51d90acd8b1a0e2&scope.project.id=32242e96e74d4bc797430f115ced8a19&role.id=449624f20ef248ef97aeceba5b22eccd => generated 259 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:59.154476 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 105/206] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 30 01:15:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:59.160091 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12215dd4-f72b-41b4-b12a-51665085ba35 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:59.277589 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12215dd4-f72b-41b4-b12a-51665085ba35 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:59.313893 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d56f0b-3716-4a4e-b3d4-f5c8ea109c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:59.314534 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d56f0b-3716-4a4e-b3d4-f5c8ea109c8a None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:59.314816 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d56f0b-3716-4a4e-b3d4-f5c8ea109c8a None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:59.315090 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d56f0b-3716-4a4e-b3d4-f5c8ea109c8a None admin] PATH_INFO: `/v3/projects/023703a6c5664626b371621981c1b1ba` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:59.316844 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d56f0b-3716-4a4e-b3d4-f5c8ea109c8a None admin] RBAC: Authorizing `identity:get_project(project_id=023703a6c5664626b371621981c1b1ba)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:59.318310 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d56f0b-3716-4a4e-b3d4-f5c8ea109c8a None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:59.320310 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 102/207] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 30 01:15:59 2022] GET /identity/v3/projects/023703a6c5664626b371621981c1b1ba => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:59.326581 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b11004-21c5-4acf-84f8-6db7bf4b18ce None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:15:59.433372 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:59.437364 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b11004-21c5-4acf-84f8-6db7bf4b18ce None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:15:59.474708 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab23dd3-fdd7-4f6b-aeae-e3f9dc20c0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:15:59.475376 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab23dd3-fdd7-4f6b-aeae-e3f9dc20c0dc None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:59.475689 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab23dd3-fdd7-4f6b-aeae-e3f9dc20c0dc None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:59.475966 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab23dd3-fdd7-4f6b-aeae-e3f9dc20c0dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:59.476700 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab23dd3-fdd7-4f6b-aeae-e3f9dc20c0dc None admin] RBAC: Adding query filter params (role.id=c2266dd88cfd4bdbb73eea767bcd4bac, scope.project.id=023703a6c5664626b371621981c1b1ba, user.id=7a56bbfc21b54fcd8a7ff7c3c96fe853) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:15:59.477005 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab23dd3-fdd7-4f6b-aeae-e3f9dc20c0dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:15:59.478437 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab23dd3-fdd7-4f6b-aeae-e3f9dc20c0dc None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:15:59.484654 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 106/208] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 30 01:15:59 2022] GET /identity/v3/role_assignments?user.id=7a56bbfc21b54fcd8a7ff7c3c96fe853&scope.project.id=023703a6c5664626b371621981c1b1ba&role.id=c2266dd88cfd4bdbb73eea767bcd4bac => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:15:59.676713 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4527ad-f837-486d-b2f9-36c27d6075d9 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:59.677053 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4527ad-f837-486d-b2f9-36c27d6075d9 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:59.677263 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4527ad-f837-486d-b2f9-36c27d6075d9 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:59.678923 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 103/209] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:15:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:15:59.684429 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4871e-d912-43f9-8a8d-18632a8d3073 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:59.684717 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4871e-d912-43f9-8a8d-18632a8d3073 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:59.684996 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4871e-d912-43f9-8a8d-18632a8d3073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:59.704487 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-2da4871e-d912-43f9-8a8d-18632a8d3073 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:59.705700 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-2da4871e-d912-43f9-8a8d-18632a8d3073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:59.783323 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 107/210] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:15:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:15:59.865111 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151af30-ecab-4dc7-ab32-dccbaf710a02 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:59.865593 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151af30-ecab-4dc7-ab32-dccbaf710a02 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:59.865793 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151af30-ecab-4dc7-ab32-dccbaf710a02 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:59.867421 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 104/211] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:15:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:15:59.872568 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235d39d-8b97-4604-9ae2-2b097843cb69 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:15:59.872987 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235d39d-8b97-4604-9ae2-2b097843cb69 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:15:59.873156 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235d39d-8b97-4604-9ae2-2b097843cb69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:15:59.895519 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-0235d39d-8b97-4604-9ae2-2b097843cb69 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:15:59.896693 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-0235d39d-8b97-4604-9ae2-2b097843cb69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:15:59.977427 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 108/212] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:15:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:16:00.087522 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c151af30-ecab-4dc7-ab32-dccbaf710a02 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:00.154613 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:00.196356 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c151af30-ecab-4dc7-ab32-dccbaf710a02 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:00.231657 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67939f99-74a2-4696-9dcc-1fa414a6bb7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:00.232288 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67939f99-74a2-4696-9dcc-1fa414a6bb7e None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:00.232565 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67939f99-74a2-4696-9dcc-1fa414a6bb7e None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:00.232837 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67939f99-74a2-4696-9dcc-1fa414a6bb7e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:00.243888 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67939f99-74a2-4696-9dcc-1fa414a6bb7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:16:00.249474 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-67939f99-74a2-4696-9dcc-1fa414a6bb7e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 01:16:00.249474 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:00.249474 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:00.249474 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:00.249474 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:00.249474 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:00.249474 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:00.249474 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:00.249474 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:00.249474 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:00.249474 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:00.249474 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:00.249474 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:16:00.249474 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:16:00.249474 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:16:00.249474 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:16:00.250345 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:16:00.250345 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:16:00.250345 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:16:00.250345 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:16:00.250345 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:00.250345 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:00.250345 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:00.250345 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:00.250345 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:00.250345 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:00.250345 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:00.250345 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:00.250345 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:00.250345 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:00.250345 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:00.250345 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:00.251810 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:00.251810 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:00.251810 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:00.251810 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:00.251810 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:16:00.251810 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:16:00.251810 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:16:00.251810 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:16:00.251810 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:16:00.251810 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:16:00.251810 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 01:16:00.251810 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:16:00.252463 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0235d39d-8b97-4604-9ae2-2b097843cb69 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:00.252534 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 105/213] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 30 01:16:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:00.256630 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67939f99-74a2-4696-9dcc-1fa414a6bb7e None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:00.280067 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:00.361533 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67939f99-74a2-4696-9dcc-1fa414a6bb7e None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:00.384715 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0235d39d-8b97-4604-9ae2-2b097843cb69 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:00.390024 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:00.406854 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aee64a-2aab-4b5d-b6b6-dec0c4bc9913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:00.408358 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aee64a-2aab-4b5d-b6b6-dec0c4bc9913 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:00.408835 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aee64a-2aab-4b5d-b6b6-dec0c4bc9913 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:00.409583 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aee64a-2aab-4b5d-b6b6-dec0c4bc9913 None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:00.410801 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aee64a-2aab-4b5d-b6b6-dec0c4bc9913 None admin] RBAC: Adding query filter params (name=member) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:00.411761 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aee64a-2aab-4b5d-b6b6-dec0c4bc9913 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:00.413897 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aee64a-2aab-4b5d-b6b6-dec0c4bc9913 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:00.422084 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b77e24-a9f3-47c0-84c2-c0870bea2fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:00.422790 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b77e24-a9f3-47c0-84c2-c0870bea2fab None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:00.422987 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b77e24-a9f3-47c0-84c2-c0870bea2fab None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:00.423257 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b77e24-a9f3-47c0-84c2-c0870bea2fab None admin] PATH_INFO: `/v3/domains/default` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:00.424396 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b77e24-a9f3-47c0-84c2-c0870bea2fab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:00.425915 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b77e24-a9f3-47c0-84c2-c0870bea2fab None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:00.426124 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 106/214] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Aug 30 01:16:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:16:00.431706 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 109/215] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:16:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:16:00.433034 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b77e24-a9f3-47c0-84c2-c0870bea2fab None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:00.433231 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aee64a-2aab-4b5d-b6b6-dec0c4bc9913 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:00.539533 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:00.554231 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b77e24-a9f3-47c0-84c2-c0870bea2fab None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:00.563139 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aee64a-2aab-4b5d-b6b6-dec0c4bc9913 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:00.598370 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d148b7c5-4ac0-4a81-8c34-e75ba642a6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:00.599332 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148b7c5-4ac0-4a81-8c34-e75ba642a6e9 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:00.600104 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148b7c5-4ac0-4a81-8c34-e75ba642a6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:00.600496 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148b7c5-4ac0-4a81-8c34-e75ba642a6e9 None admin] PATH_INFO: `/v3/users/0d8447e04e974951a017da9d37c61124` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:00.612392 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ee3df-0201-4aec-84ef-15b320aeb9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:00.613720 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ee3df-0201-4aec-84ef-15b320aeb9e0 None admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:00.614670 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ee3df-0201-4aec-84ef-15b320aeb9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:00.615109 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ee3df-0201-4aec-84ef-15b320aeb9e0 None admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:00.616226 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4ee3df-0201-4aec-84ef-15b320aeb9e0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:00.618541 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4ee3df-0201-4aec-84ef-15b320aeb9e0 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:00.620622 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d148b7c5-4ac0-4a81-8c34-e75ba642a6e9 None admin] RBAC: Authorizing `identity:get_user(user_id=0d8447e04e974951a017da9d37c61124)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:00.622198 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d148b7c5-4ac0-4a81-8c34-e75ba642a6e9 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:00.629591 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 110/216] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 30 01:16:00 2022] GET /identity/v3/users/0d8447e04e974951a017da9d37c61124 => generated 297 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:00.631016 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d148b7c5-4ac0-4a81-8c34-e75ba642a6e9 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:00.655498 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 107/217] 10.222.0.60 () {60 vars in 1132 bytes} [Tue Aug 30 01:16:00 2022] POST /identity/v3/users => generated 297 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:16:00.760402 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d148b7c5-4ac0-4a81-8c34-e75ba642a6e9 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:00.797628 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f8c97-b0df-4211-ab2a-342ac1444975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:00.798615 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f8c97-b0df-4211-ab2a-342ac1444975 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:00.799144 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f8c97-b0df-4211-ab2a-342ac1444975 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:00.799752 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f8c97-b0df-4211-ab2a-342ac1444975 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:00.805998 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd766d-3fb6-4fdb-9dfc-9b3496584110 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:00.806297 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd766d-3fb6-4fdb-9dfc-9b3496584110 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:00.806556 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd766d-3fb6-4fdb-9dfc-9b3496584110 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:00.808319 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 108/218] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:16:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:16:00.813922 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bef11a-4f76-4cf6-9116-f080a9a9af99 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:00.814432 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bef11a-4f76-4cf6-9116-f080a9a9af99 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:00.814907 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bef11a-4f76-4cf6-9116-f080a9a9af99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:00.824694 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:00.835461 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-d9bef11a-4f76-4cf6-9116-f080a9a9af99 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:00.836874 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-d9bef11a-4f76-4cf6-9116-f080a9a9af99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:00.882990 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:00.892611 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1f8c97-b0df-4211-ab2a-342ac1444975 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:00.894172 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1f8c97-b0df-4211-ab2a-342ac1444975 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:00.936422 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 109/219] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:16:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 01:16:01.026249 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 111/220] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 30 01:16:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:01.031943 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bef11a-4f76-4cf6-9116-f080a9a9af99 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:01.141836 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bef11a-4f76-4cf6-9116-f080a9a9af99 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:01.178994 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3026242f-3c05-44bb-94fa-6dffd8e772e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:01.180007 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026242f-3c05-44bb-94fa-6dffd8e772e9 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:01.180496 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026242f-3c05-44bb-94fa-6dffd8e772e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:01.180946 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026242f-3c05-44bb-94fa-6dffd8e772e9 None admin] PATH_INFO: `/v3/projects/32242e96e74d4bc797430f115ced8a19` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:01.182266 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3026242f-3c05-44bb-94fa-6dffd8e772e9 None admin] RBAC: Authorizing `identity:get_project(project_id=32242e96e74d4bc797430f115ced8a19)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:01.183948 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3026242f-3c05-44bb-94fa-6dffd8e772e9 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:01.185769 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 110/221] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 30 01:16:01 2022] GET /identity/v3/projects/32242e96e74d4bc797430f115ced8a19 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:01.192374 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f8c97-b0df-4211-ab2a-342ac1444975 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:01.219759 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3026242f-3c05-44bb-94fa-6dffd8e772e9 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:01.245615 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:01.268246 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:01.341336 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f8c97-b0df-4211-ab2a-342ac1444975 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:01.368053 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3026242f-3c05-44bb-94fa-6dffd8e772e9 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:01.383124 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad063c63-91d5-4f9c-a5d9-7489b3be1952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:01.384311 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad063c63-91d5-4f9c-a5d9-7489b3be1952 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:01.385261 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad063c63-91d5-4f9c-a5d9-7489b3be1952 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:01.385722 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad063c63-91d5-4f9c-a5d9-7489b3be1952 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:01.387014 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad063c63-91d5-4f9c-a5d9-7489b3be1952 None admin] RBAC: Adding query filter params (role.id=5b38bd827c5847969c4ee48e27261f5b, scope.project.id=32242e96e74d4bc797430f115ced8a19, user.id=0d8447e04e974951a017da9d37c61124) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:01.387638 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad063c63-91d5-4f9c-a5d9-7489b3be1952 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:01.390177 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad063c63-91d5-4f9c-a5d9-7489b3be1952 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:01.398853 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 112/222] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 30 01:16:01 2022] GET /identity/v3/role_assignments?user.id=0d8447e04e974951a017da9d37c61124&scope.project.id=32242e96e74d4bc797430f115ced8a19&role.id=5b38bd827c5847969c4ee48e27261f5b => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:01.400854 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743b073-604d-450a-94bc-21ca28d86700 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:01.401389 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743b073-604d-450a-94bc-21ca28d86700 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:01.402502 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743b073-604d-450a-94bc-21ca28d86700 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:01.404119 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 113/223] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:16:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:16:01.413700 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7e9cd-1c6c-44fa-af35-ec5c89a649a2 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:01.414276 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7e9cd-1c6c-44fa-af35-ec5c89a649a2 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:01.414727 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7e9cd-1c6c-44fa-af35-ec5c89a649a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:01.420492 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb3c70-fb28-41c1-b21a-5039073a86de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:01.421533 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb3c70-fb28-41c1-b21a-5039073a86de None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:01.421996 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb3c70-fb28-41c1-b21a-5039073a86de None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:01.422447 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb3c70-fb28-41c1-b21a-5039073a86de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:01.452688 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-bdb7e9cd-1c6c-44fa-af35-ec5c89a649a2 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:01.455537 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-bdb7e9cd-1c6c-44fa-af35-ec5c89a649a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:01.456359 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb3c70-fb28-41c1-b21a-5039073a86de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:16:01.466340 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-27fb3c70-fb28-41c1-b21a-5039073a86de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:16:01.466340 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:01.466340 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:01.466340 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:01.466340 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:01.466340 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:01.466340 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:01.466340 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:01.466340 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:01.466340 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:01.466340 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:01.466340 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:01.466340 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:16:01.466340 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:16:01.466340 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:16:01.466340 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:16:01.467333 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:16:01.467333 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:16:01.467333 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:16:01.467333 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:16:01.467333 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:01.467333 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:01.467333 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:01.467333 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:01.467333 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:01.467333 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:01.467333 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:01.467333 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:01.467333 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:01.467333 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:01.467333 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:01.467333 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:01.468162 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:01.468162 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:01.468162 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:01.468162 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:01.468162 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:16:01.468162 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:16:01.468162 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:16:01.468162 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:16:01.468162 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:16:01.468162 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:16:01.468162 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:16:01.468162 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:16:01.469537 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 111/224] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 30 01:16:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:16:01.476378 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb3c70-fb28-41c1-b21a-5039073a86de None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:01.609367 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 114/225] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:16:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 01:16:01.650589 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:01.655413 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb3c70-fb28-41c1-b21a-5039073a86de None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:01.709753 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fbddb3-a295-4e70-a393-d9bff64890b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:01.710368 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fbddb3-a295-4e70-a393-d9bff64890b6 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:01.710783 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fbddb3-a295-4e70-a393-d9bff64890b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:01.711116 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fbddb3-a295-4e70-a393-d9bff64890b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:01.711814 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fbddb3-a295-4e70-a393-d9bff64890b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:01.712112 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fbddb3-a295-4e70-a393-d9bff64890b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:01.713496 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fbddb3-a295-4e70-a393-d9bff64890b6 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:01.722423 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 112/226] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 30 01:16:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:16:01.728817 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb7e9cd-1c6c-44fa-af35-ec5c89a649a2 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:01.772865 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:01.832799 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb7e9cd-1c6c-44fa-af35-ec5c89a649a2 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:01.871830 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7bc0ec-1b09-4839-ab06-f85dd97258b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:01.872380 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7bc0ec-1b09-4839-ab06-f85dd97258b0 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:01.872652 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7bc0ec-1b09-4839-ab06-f85dd97258b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:01.872918 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7bc0ec-1b09-4839-ab06-f85dd97258b0 None admin] PATH_INFO: `/v3/users/f5a4141642da477eb51d90acd8b1a0e2` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:01.874028 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7bc0ec-1b09-4839-ab06-f85dd97258b0 None admin] RBAC: Authorizing `identity:get_user(user_id=f5a4141642da477eb51d90acd8b1a0e2)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:01.875478 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7bc0ec-1b09-4839-ab06-f85dd97258b0 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:01.877046 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 115/227] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 30 01:16:01 2022] GET /identity/v3/users/f5a4141642da477eb51d90acd8b1a0e2 => generated 283 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:01.882917 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fbddb3-a295-4e70-a393-d9bff64890b6 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:02.003536 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7bc0ec-1b09-4839-ab06-f85dd97258b0 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:02.017592 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fbddb3-a295-4e70-a393-d9bff64890b6 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:02.063712 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63f100-f99b-47b6-9d83-076ca53b32eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:02.065918 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63f100-f99b-47b6-9d83-076ca53b32eb None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:02.066214 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63f100-f99b-47b6-9d83-076ca53b32eb None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:02.066635 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63f100-f99b-47b6-9d83-076ca53b32eb None admin] PATH_INFO: `/v3/projects/32242e96e74d4bc797430f115ced8a19` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:02.072633 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b63f100-f99b-47b6-9d83-076ca53b32eb None admin] RBAC: Authorizing `identity:get_project(project_id=32242e96e74d4bc797430f115ced8a19)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:02.074192 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b63f100-f99b-47b6-9d83-076ca53b32eb None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:02.076073 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 113/228] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 30 01:16:01 2022] GET /identity/v3/projects/32242e96e74d4bc797430f115ced8a19 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:02.096892 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63f100-f99b-47b6-9d83-076ca53b32eb None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:02.165829 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7bc0ec-1b09-4839-ab06-f85dd97258b0 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:02.175802 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:02.192394 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:02.202417 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310535b3-48ad-49fd-bbd5-33a82eb838dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:02.203063 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310535b3-48ad-49fd-bbd5-33a82eb838dc None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:02.203344 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310535b3-48ad-49fd-bbd5-33a82eb838dc None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:02.203793 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310535b3-48ad-49fd-bbd5-33a82eb838dc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:02.217272 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310535b3-48ad-49fd-bbd5-33a82eb838dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:16:02.223391 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-310535b3-48ad-49fd-bbd5-33a82eb838dc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 01:16:02.223391 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:02.223391 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:02.223391 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:02.223391 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:02.223391 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:02.223391 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:02.223391 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:02.223391 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:02.223391 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:02.223391 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:02.223391 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:02.223391 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:16:02.223391 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:16:02.223391 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:16:02.223391 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:16:02.224256 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:16:02.224256 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:16:02.224256 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:16:02.224256 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:16:02.224256 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:02.224256 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:02.224256 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:02.224256 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:02.224256 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:02.224256 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:02.224256 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:02.224256 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:02.224256 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:02.224256 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:02.224256 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:02.224256 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:02.225050 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:02.225050 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:02.225050 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:02.225050 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:02.225050 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:16:02.225050 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:16:02.225050 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:16:02.225050 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:16:02.225050 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:16:02.225050 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:16:02.225050 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 01:16:02.225050 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:16:02.225050 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 116/229] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Aug 30 01:16:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:02.231422 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310535b3-48ad-49fd-bbd5-33a82eb838dc None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:02.363100 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63f100-f99b-47b6-9d83-076ca53b32eb None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:02.380478 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310535b3-48ad-49fd-bbd5-33a82eb838dc None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:02.418803 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e23ae-7382-484a-8342-b44a30d5cc80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:02.419335 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e23ae-7382-484a-8342-b44a30d5cc80 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:02.419648 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e23ae-7382-484a-8342-b44a30d5cc80 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:02.419949 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e23ae-7382-484a-8342-b44a30d5cc80 None admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:02.420755 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305e23ae-7382-484a-8342-b44a30d5cc80 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:02.421059 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305e23ae-7382-484a-8342-b44a30d5cc80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:02.422496 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305e23ae-7382-484a-8342-b44a30d5cc80 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:02.431081 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 117/230] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 30 01:16:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:02.436533 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e23ae-7382-484a-8342-b44a30d5cc80 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:02.448129 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30699a8-7c32-4c8a-a584-dfad652a24e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:02.448812 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30699a8-7c32-4c8a-a584-dfad652a24e7 None admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:02.449101 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30699a8-7c32-4c8a-a584-dfad652a24e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:02.449386 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30699a8-7c32-4c8a-a584-dfad652a24e7 None admin] PATH_INFO: `/v3/projects/32242e96e74d4bc797430f115ced8a19/users/f5a4141642da477eb51d90acd8b1a0e2/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:02.456182 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30699a8-7c32-4c8a-a584-dfad652a24e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=32242e96e74d4bc797430f115ced8a19, user_id=f5a4141642da477eb51d90acd8b1a0e2, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:02.458208 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30699a8-7c32-4c8a-a584-dfad652a24e7 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:02.470310 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:02.488140 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 114/231] 10.222.0.60 () {58 vars in 1439 bytes} [Tue Aug 30 01:16:02 2022] PUT /identity/v3/projects/32242e96e74d4bc797430f115ced8a19/users/f5a4141642da477eb51d90acd8b1a0e2/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:16:02.562726 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e23ae-7382-484a-8342-b44a30d5cc80 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:02.600575 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dbd51b-06ef-4321-bbac-617c5972ae24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:02.603469 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dbd51b-06ef-4321-bbac-617c5972ae24 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:02.603469 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dbd51b-06ef-4321-bbac-617c5972ae24 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:02.603469 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dbd51b-06ef-4321-bbac-617c5972ae24 None admin] PATH_INFO: `/v3/users/f5a4141642da477eb51d90acd8b1a0e2` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:02.603469 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dbd51b-06ef-4321-bbac-617c5972ae24 None admin] RBAC: Authorizing `identity:get_user(user_id=f5a4141642da477eb51d90acd8b1a0e2)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:02.605982 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dbd51b-06ef-4321-bbac-617c5972ae24 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:02.605982 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 118/232] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 30 01:16:02 2022] GET /identity/v3/users/f5a4141642da477eb51d90acd8b1a0e2 => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:16:02.611648 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30699a8-7c32-4c8a-a584-dfad652a24e7 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:02.749120 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:02.767808 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30699a8-7c32-4c8a-a584-dfad652a24e7 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:02.804955 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8cc510-16ae-4b8f-9552-09caad16e34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:02.805658 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8cc510-16ae-4b8f-9552-09caad16e34b None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:02.805942 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8cc510-16ae-4b8f-9552-09caad16e34b None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:02.806214 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8cc510-16ae-4b8f-9552-09caad16e34b None admin] PATH_INFO: `/v3/projects/32242e96e74d4bc797430f115ced8a19` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:02.807405 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8cc510-16ae-4b8f-9552-09caad16e34b None admin] RBAC: Authorizing `identity:get_project(project_id=32242e96e74d4bc797430f115ced8a19)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:02.808926 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8cc510-16ae-4b8f-9552-09caad16e34b None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:02.810613 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 115/233] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 30 01:16:02 2022] GET /identity/v3/projects/32242e96e74d4bc797430f115ced8a19 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:02.816707 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dbd51b-06ef-4321-bbac-617c5972ae24 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:02.935836 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:02.939583 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dbd51b-06ef-4321-bbac-617c5972ae24 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:02.981647 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf49d2-dcbf-4129-8617-a5b503396abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:02.982317 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf49d2-dcbf-4129-8617-a5b503396abf None admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:02.982599 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf49d2-dcbf-4129-8617-a5b503396abf None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:02.982875 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf49d2-dcbf-4129-8617-a5b503396abf None admin] PATH_INFO: `/v3/projects/32242e96e74d4bc797430f115ced8a19/users/f5a4141642da477eb51d90acd8b1a0e2/roles/449624f20ef248ef97aeceba5b22eccd` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:02.985127 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cf49d2-dcbf-4129-8617-a5b503396abf None admin] RBAC: Authorizing `identity:create_grant(project_id=32242e96e74d4bc797430f115ced8a19, user_id=f5a4141642da477eb51d90acd8b1a0e2, role_id=449624f20ef248ef97aeceba5b22eccd)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:02.986666 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cf49d2-dcbf-4129-8617-a5b503396abf None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:03.011874 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 119/234] 10.222.0.60 () {58 vars in 1439 bytes} [Tue Aug 30 01:16:02 2022] PUT /identity/v3/projects/32242e96e74d4bc797430f115ced8a19/users/f5a4141642da477eb51d90acd8b1a0e2/roles/449624f20ef248ef97aeceba5b22eccd => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:16:03.296084 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c3b5e-48e7-4248-8401-bea9659078f3 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:03.297062 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c3b5e-48e7-4248-8401-bea9659078f3 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:03.297559 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c3b5e-48e7-4248-8401-bea9659078f3 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:03.299143 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 116/235] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:16:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:16:03.304862 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac34752-d1b4-4328-9fab-c5caa5c2fb38 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:03.305167 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac34752-d1b4-4328-9fab-c5caa5c2fb38 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:03.305397 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac34752-d1b4-4328-9fab-c5caa5c2fb38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:03.328463 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-bac34752-d1b4-4328-9fab-c5caa5c2fb38 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:03.329655 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-bac34752-d1b4-4328-9fab-c5caa5c2fb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:03.423832 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 120/236] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:16:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:16:03.554578 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d17ff-e688-448a-b20c-f1077fb84ded None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:03.554872 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d17ff-e688-448a-b20c-f1077fb84ded None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:03.555095 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d17ff-e688-448a-b20c-f1077fb84ded None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:03.556808 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 117/237] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:16:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:16:03.562182 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a28da-7737-44e0-949a-83022e8d4074 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:03.562471 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a28da-7737-44e0-949a-83022e8d4074 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:03.562743 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a28da-7737-44e0-949a-83022e8d4074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:03.590313 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-dc5a28da-7737-44e0-949a-83022e8d4074 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:03.590313 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-dc5a28da-7737-44e0-949a-83022e8d4074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:03.642143 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d12ca-d778-41ef-b804-83e112f336bf None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:03.642423 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d12ca-d778-41ef-b804-83e112f336bf None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:03.642696 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d12ca-d778-41ef-b804-83e112f336bf None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:03.644176 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 118/238] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:16:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:16:03.649843 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9bb33e-cbc9-41fa-bfb0-d5c3bea199f3 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:03.650125 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9bb33e-cbc9-41fa-bfb0-d5c3bea199f3 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:03.650402 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9bb33e-cbc9-41fa-bfb0-d5c3bea199f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:03.676336 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 121/239] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:16:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:16:03.686631 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-9e9bb33e-cbc9-41fa-bfb0-d5c3bea199f3 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:03.687873 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-9e9bb33e-cbc9-41fa-bfb0-d5c3bea199f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:03.761681 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 119/240] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:16:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 01:16:03.786416 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a28da-7737-44e0-949a-83022e8d4074 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:03.821426 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:03.907197 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a28da-7737-44e0-949a-83022e8d4074 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:03.952174 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b65611c-e6b7-4cf8-ab0c-5ff2c9d3f229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:03.952859 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65611c-e6b7-4cf8-ab0c-5ff2c9d3f229 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:03.953141 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65611c-e6b7-4cf8-ab0c-5ff2c9d3f229 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:03.953411 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65611c-e6b7-4cf8-ab0c-5ff2c9d3f229 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:03.970249 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b65611c-e6b7-4cf8-ab0c-5ff2c9d3f229 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:16:03.975250 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-6b65611c-e6b7-4cf8-ab0c-5ff2c9d3f229 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 01:16:03.975250 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:03.975250 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:03.975250 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:03.975250 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:03.975250 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:03.975250 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:03.975250 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:03.975250 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:03.975250 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:03.975250 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:03.975250 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:03.975250 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:16:03.975250 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:16:03.975250 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:16:03.975250 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:16:03.976149 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:16:03.976149 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:16:03.976149 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:16:03.976149 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:16:03.976149 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:03.976149 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:03.976149 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:03.976149 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:03.976149 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:03.976149 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:03.976149 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:03.976149 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:03.976149 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:03.976149 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:03.976149 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:03.976149 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:03.976928 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:03.976928 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:03.976928 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:03.976928 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:03.976928 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:16:03.976928 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:16:03.976928 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:16:03.976928 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:16:03.976928 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:16:03.976928 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:16:03.976928 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 01:16:03.976928 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:16:03.976928 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 122/241] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 30 01:16:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:03.983416 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9bb33e-cbc9-41fa-bfb0-d5c3bea199f3 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:04.001302 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b65611c-e6b7-4cf8-ab0c-5ff2c9d3f229 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:04.075605 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:04.094143 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9bb33e-cbc9-41fa-bfb0-d5c3bea199f3 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:04.139992 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb27915-5171-455f-8500-b5f844e59fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:04.140623 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb27915-5171-455f-8500-b5f844e59fff None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:04.140904 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb27915-5171-455f-8500-b5f844e59fff None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:04.141643 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb27915-5171-455f-8500-b5f844e59fff None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:04.142644 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb27915-5171-455f-8500-b5f844e59fff None admin] RBAC: Adding query filter params (name=reader) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:04.142960 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb27915-5171-455f-8500-b5f844e59fff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:04.145457 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:04.145997 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb27915-5171-455f-8500-b5f844e59fff None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:04.158584 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 120/242] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Aug 30 01:16:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:04.160013 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb27915-5171-455f-8500-b5f844e59fff None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:04.173637 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b65611c-e6b7-4cf8-ab0c-5ff2c9d3f229 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:04.222236 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe85e9c-ac7c-463e-95b8-a34c41a413e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:04.223385 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe85e9c-ac7c-463e-95b8-a34c41a413e0 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:04.223693 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe85e9c-ac7c-463e-95b8-a34c41a413e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:04.224015 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe85e9c-ac7c-463e-95b8-a34c41a413e0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:04.225379 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe85e9c-ac7c-463e-95b8-a34c41a413e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:04.227581 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe85e9c-ac7c-463e-95b8-a34c41a413e0 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:04.231521 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 123/243] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:16:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:16:04.232333 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe85e9c-ac7c-463e-95b8-a34c41a413e0 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:04.286769 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb27915-5171-455f-8500-b5f844e59fff None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:04.321836 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d445dd06-0a03-4003-8e93-aea8fbb9c1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:04.322593 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445dd06-0a03-4003-8e93-aea8fbb9c1f7 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:04.322754 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445dd06-0a03-4003-8e93-aea8fbb9c1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:04.322977 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445dd06-0a03-4003-8e93-aea8fbb9c1f7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:04.333933 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d445dd06-0a03-4003-8e93-aea8fbb9c1f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:16:04.340271 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-d445dd06-0a03-4003-8e93-aea8fbb9c1f7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 01:16:04.340271 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:04.340271 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:04.340271 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:04.340271 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:04.340271 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:04.340271 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:04.340271 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:04.340271 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:04.340271 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:04.340271 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:04.340271 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:04.340271 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:16:04.340271 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:16:04.340271 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:16:04.340271 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:16:04.342378 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:16:04.342378 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:16:04.342378 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:16:04.342378 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:16:04.342378 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:04.342378 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:04.342378 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:04.342378 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:04.342378 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:04.342378 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:04.342378 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:04.342378 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:04.342378 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:04.342378 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:04.342378 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:04.342378 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:04.344394 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:04.344394 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:04.344394 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:04.344394 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:04.344394 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:16:04.344394 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:16:04.344394 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:16:04.344394 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:16:04.344394 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:16:04.344394 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:16:04.344394 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 01:16:04.344394 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:16:04.344394 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 121/244] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 30 01:16:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:04.344394 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d445dd06-0a03-4003-8e93-aea8fbb9c1f7 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:04.346151 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe85e9c-ac7c-463e-95b8-a34c41a413e0 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:04.353297 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:04.380582 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc8254-deb4-4149-a43b-6a6cfff8b21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:04.380582 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc8254-deb4-4149-a43b-6a6cfff8b21f None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:04.380892 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc8254-deb4-4149-a43b-6a6cfff8b21f None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:04.381100 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc8254-deb4-4149-a43b-6a6cfff8b21f None admin] PATH_INFO: `/v3/users/a7c8bbd21082408e9f68600e19f14819` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:04.396286 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dc8254-deb4-4149-a43b-6a6cfff8b21f None admin] RBAC: Authorizing `identity:get_user(user_id=a7c8bbd21082408e9f68600e19f14819)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:04.397773 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dc8254-deb4-4149-a43b-6a6cfff8b21f None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:04.399920 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 124/245] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 30 01:16:04 2022] GET /identity/v3/users/a7c8bbd21082408e9f68600e19f14819 => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:04.400839 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc8254-deb4-4149-a43b-6a6cfff8b21f None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:04.409760 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:04.451495 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d445dd06-0a03-4003-8e93-aea8fbb9c1f7 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:04.487339 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4499c346-31eb-4256-9a63-a03bbe5405e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:04.488807 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4499c346-31eb-4256-9a63-a03bbe5405e8 None admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:04.489257 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4499c346-31eb-4256-9a63-a03bbe5405e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:04.489696 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4499c346-31eb-4256-9a63-a03bbe5405e8 None admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:04.490548 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4499c346-31eb-4256-9a63-a03bbe5405e8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:04.492315 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4499c346-31eb-4256-9a63-a03bbe5405e8 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:04.510209 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc8254-deb4-4149-a43b-6a6cfff8b21f None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:04.520949 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 122/246] 10.222.0.60 () {60 vars in 1132 bytes} [Tue Aug 30 01:16:04 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:16:04.522564 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4499c346-31eb-4256-9a63-a03bbe5405e8 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:04.550405 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2406d30b-c106-4299-bdac-11f485d5c855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:04.551568 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406d30b-c106-4299-bdac-11f485d5c855 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:04.551848 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406d30b-c106-4299-bdac-11f485d5c855 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:04.552118 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406d30b-c106-4299-bdac-11f485d5c855 None admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:04.552793 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2406d30b-c106-4299-bdac-11f485d5c855 None admin] RBAC: Adding query filter params (name=member) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:04.553093 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2406d30b-c106-4299-bdac-11f485d5c855 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:04.554524 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2406d30b-c106-4299-bdac-11f485d5c855 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:04.565581 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 125/247] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Aug 30 01:16:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:04.571056 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2406d30b-c106-4299-bdac-11f485d5c855 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:04.637586 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:04.667663 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:04.709356 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2406d30b-c106-4299-bdac-11f485d5c855 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:04.724153 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4499c346-31eb-4256-9a63-a03bbe5405e8 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:04.753579 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32d27f6-03e5-4bab-9bf5-984f1af010bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:04.753579 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d27f6-03e5-4bab-9bf5-984f1af010bf None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:04.753579 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d27f6-03e5-4bab-9bf5-984f1af010bf None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:04.753579 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d27f6-03e5-4bab-9bf5-984f1af010bf None admin] PATH_INFO: `/v3/users/0d8447e04e974951a017da9d37c61124` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:04.755910 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32d27f6-03e5-4bab-9bf5-984f1af010bf None admin] RBAC: Authorizing `identity:get_user(user_id=0d8447e04e974951a017da9d37c61124)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:04.757128 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32d27f6-03e5-4bab-9bf5-984f1af010bf None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:04.759033 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 126/248] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 30 01:16:04 2022] GET /identity/v3/users/0d8447e04e974951a017da9d37c61124 => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:04.764320 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32d27f6-03e5-4bab-9bf5-984f1af010bf None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:04.782609 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe3fcbd-8627-47cd-addd-bf813b5a61f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:04.783383 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3fcbd-8627-47cd-addd-bf813b5a61f4 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:04.783701 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3fcbd-8627-47cd-addd-bf813b5a61f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:04.784350 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3fcbd-8627-47cd-addd-bf813b5a61f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:04.878862 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe3fcbd-8627-47cd-addd-bf813b5a61f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:04.880696 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe3fcbd-8627-47cd-addd-bf813b5a61f4 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:04.891148 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32d27f6-03e5-4bab-9bf5-984f1af010bf None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:04.933440 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907900bd-fc20-4d96-b750-eeee681d9ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:04.936330 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907900bd-fc20-4d96-b750-eeee681d9ff1 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:04.936977 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907900bd-fc20-4d96-b750-eeee681d9ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:04.937464 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907900bd-fc20-4d96-b750-eeee681d9ff1 None admin] PATH_INFO: `/v3/projects/32242e96e74d4bc797430f115ced8a19` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:04.938894 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907900bd-fc20-4d96-b750-eeee681d9ff1 None admin] RBAC: Authorizing `identity:get_project(project_id=32242e96e74d4bc797430f115ced8a19)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:04.941919 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907900bd-fc20-4d96-b750-eeee681d9ff1 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:04.944156 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 127/249] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 30 01:16:04 2022] GET /identity/v3/projects/32242e96e74d4bc797430f115ced8a19 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:16:04.954130 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907900bd-fc20-4d96-b750-eeee681d9ff1 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:04.959748 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:04.964786 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:05.018413 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 123/250] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 30 01:16:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:05.025143 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe3fcbd-8627-47cd-addd-bf813b5a61f4 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:05.095100 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907900bd-fc20-4d96-b750-eeee681d9ff1 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:05.136946 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5367d2-9d62-473b-9d96-739cb76a58ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:05.137609 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5367d2-9d62-473b-9d96-739cb76a58ed None admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:05.137891 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5367d2-9d62-473b-9d96-739cb76a58ed None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:05.138164 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5367d2-9d62-473b-9d96-739cb76a58ed None admin] PATH_INFO: `/v3/projects/32242e96e74d4bc797430f115ced8a19/users/0d8447e04e974951a017da9d37c61124/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:05.140367 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5367d2-9d62-473b-9d96-739cb76a58ed None admin] RBAC: Authorizing `identity:create_grant(project_id=32242e96e74d4bc797430f115ced8a19, user_id=0d8447e04e974951a017da9d37c61124, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:05.141823 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5367d2-9d62-473b-9d96-739cb76a58ed None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:05.151012 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe3fcbd-8627-47cd-addd-bf813b5a61f4 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:05.158391 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 128/251] 10.222.0.60 () {58 vars in 1439 bytes} [Tue Aug 30 01:16:04 2022] PUT /identity/v3/projects/32242e96e74d4bc797430f115ced8a19/users/0d8447e04e974951a017da9d37c61124/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:16:05.159677 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84707b-1624-4de3-9b03-3ebb78cb7df6 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:05.160018 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84707b-1624-4de3-9b03-3ebb78cb7df6 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:05.160797 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84707b-1624-4de3-9b03-3ebb78cb7df6 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:05.162212 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 129/252] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:16:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:16:05.167670 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8d485-4713-4a41-bf85-f6a5d30beb9d None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:05.167957 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8d485-4713-4a41-bf85-f6a5d30beb9d None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:05.168234 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8d485-4713-4a41-bf85-f6a5d30beb9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:05.190908 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-5fb8d485-4713-4a41-bf85-f6a5d30beb9d None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:05.192218 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-5fb8d485-4713-4a41-bf85-f6a5d30beb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:05.226168 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1834a601-ac79-4bc6-abcf-dc4dd4ca8d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:05.227007 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834a601-ac79-4bc6-abcf-dc4dd4ca8d1c None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:05.227306 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834a601-ac79-4bc6-abcf-dc4dd4ca8d1c None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:05.227626 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834a601-ac79-4bc6-abcf-dc4dd4ca8d1c None admin] PATH_INFO: `/v3/projects/32242e96e74d4bc797430f115ced8a19` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:05.228898 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1834a601-ac79-4bc6-abcf-dc4dd4ca8d1c None admin] RBAC: Authorizing `identity:get_project(project_id=32242e96e74d4bc797430f115ced8a19)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:05.231158 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1834a601-ac79-4bc6-abcf-dc4dd4ca8d1c None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:05.239791 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 124/253] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 30 01:16:05 2022] GET /identity/v3/projects/32242e96e74d4bc797430f115ced8a19 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:05.252693 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1834a601-ac79-4bc6-abcf-dc4dd4ca8d1c None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:05.313607 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:05.332688 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:05.352839 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 130/254] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:16:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 01:16:05.417447 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1834a601-ac79-4bc6-abcf-dc4dd4ca8d1c None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:05.456270 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ca7fa1-db2b-4dd6-9460-0538da87ee64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:05.456919 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca7fa1-db2b-4dd6-9460-0538da87ee64 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:05.457200 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca7fa1-db2b-4dd6-9460-0538da87ee64 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:05.457469 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca7fa1-db2b-4dd6-9460-0538da87ee64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:05.458200 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ca7fa1-db2b-4dd6-9460-0538da87ee64 None admin] RBAC: Adding query filter params (role.id=c2266dd88cfd4bdbb73eea767bcd4bac, scope.project.id=32242e96e74d4bc797430f115ced8a19, user.id=a7c8bbd21082408e9f68600e19f14819) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:05.458503 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ca7fa1-db2b-4dd6-9460-0538da87ee64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:05.459982 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ca7fa1-db2b-4dd6-9460-0538da87ee64 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:05.471618 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 125/255] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 30 01:16:05 2022] GET /identity/v3/role_assignments?user.id=a7c8bbd21082408e9f68600e19f14819&scope.project.id=32242e96e74d4bc797430f115ced8a19&role.id=c2266dd88cfd4bdbb73eea767bcd4bac => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:16:05.671323 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a518d8a-3c36-4b01-bae2-f7d3542d1758 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:05.671549 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a518d8a-3c36-4b01-bae2-f7d3542d1758 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:05.671826 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a518d8a-3c36-4b01-bae2-f7d3542d1758 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:05.673179 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 131/256] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:16:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:16:05.678867 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65abcdfa-5363-4537-8609-913be9422dc3 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:05.679293 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65abcdfa-5363-4537-8609-913be9422dc3 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:05.679701 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65abcdfa-5363-4537-8609-913be9422dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:05.701458 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-65abcdfa-5363-4537-8609-913be9422dc3 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:05.702974 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-65abcdfa-5363-4537-8609-913be9422dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:05.793462 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 126/257] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:16:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:16:05.835934 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a518d8a-3c36-4b01-bae2-f7d3542d1758 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:05.970724 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a518d8a-3c36-4b01-bae2-f7d3542d1758 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:06.007283 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a7b323-572d-4b88-a0b9-84bacaa39e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:06.007948 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7b323-572d-4b88-a0b9-84bacaa39e24 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:06.008230 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7b323-572d-4b88-a0b9-84bacaa39e24 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:06.008501 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7b323-572d-4b88-a0b9-84bacaa39e24 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:06.019025 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a7b323-572d-4b88-a0b9-84bacaa39e24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:16:06.024029 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-66a7b323-572d-4b88-a0b9-84bacaa39e24 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:16:06.024029 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:06.024029 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:06.024029 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:06.024029 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:06.024029 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:06.024029 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:06.024029 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:06.024029 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:06.024029 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:06.024029 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:06.024029 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:06.024029 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:16:06.024029 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:16:06.024029 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:16:06.024029 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:16:06.024884 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:16:06.024884 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:16:06.024884 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:16:06.024884 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:16:06.024884 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:06.024884 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:06.024884 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:06.024884 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:06.024884 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:06.024884 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:06.024884 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:06.024884 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:06.024884 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:06.024884 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:06.024884 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:06.024884 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:06.025664 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:06.025664 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:06.025664 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:06.025664 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:06.025664 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:16:06.025664 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:16:06.025664 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:16:06.025664 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:16:06.025664 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:16:06.025664 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:16:06.025664 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:16:06.025664 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:16:06.029954 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 132/258] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 30 01:16:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:06.031327 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65abcdfa-5363-4537-8609-913be9422dc3 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:06.077336 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:06.168301 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65abcdfa-5363-4537-8609-913be9422dc3 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:06.218274 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d8f14-2872-4ea2-8345-2cdab5c9a9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:06.219267 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d8f14-2872-4ea2-8345-2cdab5c9a9fd None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:06.219764 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d8f14-2872-4ea2-8345-2cdab5c9a9fd None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:06.220226 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d8f14-2872-4ea2-8345-2cdab5c9a9fd None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:06.221131 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34d8f14-2872-4ea2-8345-2cdab5c9a9fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:06.221636 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34d8f14-2872-4ea2-8345-2cdab5c9a9fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:06.223834 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34d8f14-2872-4ea2-8345-2cdab5c9a9fd None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:06.239915 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 127/259] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 30 01:16:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:06.240679 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a7b323-572d-4b88-a0b9-84bacaa39e24 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:06.246225 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d8f14-2872-4ea2-8345-2cdab5c9a9fd None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:06.339022 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:06.408093 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a7b323-572d-4b88-a0b9-84bacaa39e24 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:06.462368 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed98fca-c5b2-48e4-a94a-35a1fbc3f778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:06.463162 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed98fca-c5b2-48e4-a94a-35a1fbc3f778 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:06.463463 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed98fca-c5b2-48e4-a94a-35a1fbc3f778 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:06.463755 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed98fca-c5b2-48e4-a94a-35a1fbc3f778 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:06.479090 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:06.483126 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed98fca-c5b2-48e4-a94a-35a1fbc3f778 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:16:06.490015 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-2ed98fca-c5b2-48e4-a94a-35a1fbc3f778 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 01:16:06.490015 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:06.490015 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:06.490015 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:06.490015 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:06.490015 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:06.490015 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:06.490015 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:06.490015 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:06.490015 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:06.490015 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:06.490015 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:06.490015 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:16:06.490015 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:16:06.490015 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:16:06.490015 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:16:06.491218 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:16:06.491218 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:16:06.491218 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:16:06.491218 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:16:06.491218 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:06.491218 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:06.491218 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:06.491218 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:06.491218 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:06.491218 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:06.491218 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:06.491218 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:06.491218 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:06.491218 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:06.491218 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:06.491218 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:06.492229 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:06.492229 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:06.492229 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:06.492229 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:06.492229 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:16:06.492229 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:16:06.492229 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:16:06.492229 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:16:06.492229 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:16:06.492229 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:16:06.492229 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 01:16:06.492229 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:16:06.495094 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 133/260] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Aug 30 01:16:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:06.501108 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed98fca-c5b2-48e4-a94a-35a1fbc3f778 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:06.532076 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d8f14-2872-4ea2-8345-2cdab5c9a9fd None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:06.648188 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed7dea-9b3c-4899-9875-01a607c9852f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:06.648856 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed7dea-9b3c-4899-9875-01a607c9852f None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:06.649142 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed7dea-9b3c-4899-9875-01a607c9852f None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:06.649419 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed7dea-9b3c-4899-9875-01a607c9852f None admin] PATH_INFO: `/v3/users/f5a4141642da477eb51d90acd8b1a0e2` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:06.651859 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ed7dea-9b3c-4899-9875-01a607c9852f None admin] RBAC: Authorizing `identity:get_user(user_id=f5a4141642da477eb51d90acd8b1a0e2)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:06.653329 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ed7dea-9b3c-4899-9875-01a607c9852f None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:06.653520 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed98fca-c5b2-48e4-a94a-35a1fbc3f778 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:06.655241 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 128/261] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 30 01:16:06 2022] GET /identity/v3/users/f5a4141642da477eb51d90acd8b1a0e2 => generated 283 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:16:06.660665 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed7dea-9b3c-4899-9875-01a607c9852f None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:06.684525 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:06.737544 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17873914-ce07-4121-90ad-186b8d6ae20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:06.739034 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17873914-ce07-4121-90ad-186b8d6ae20f None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:06.739550 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17873914-ce07-4121-90ad-186b8d6ae20f None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:06.740094 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17873914-ce07-4121-90ad-186b8d6ae20f None admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:06.740953 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17873914-ce07-4121-90ad-186b8d6ae20f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:06.741451 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17873914-ce07-4121-90ad-186b8d6ae20f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:06.743104 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17873914-ce07-4121-90ad-186b8d6ae20f None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:06.762564 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 134/262] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 30 01:16:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:16:06.770266 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17873914-ce07-4121-90ad-186b8d6ae20f None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:06.886829 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed7dea-9b3c-4899-9875-01a607c9852f None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:06.927021 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eab15d-cab8-498b-97c7-4e2c24d40794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:06.927673 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eab15d-cab8-498b-97c7-4e2c24d40794 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:06.928012 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eab15d-cab8-498b-97c7-4e2c24d40794 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:06.928289 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eab15d-cab8-498b-97c7-4e2c24d40794 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:06.957436 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:07.013832 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17873914-ce07-4121-90ad-186b8d6ae20f None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:07.027496 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eab15d-cab8-498b-97c7-4e2c24d40794 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:07.027496 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eab15d-cab8-498b-97c7-4e2c24d40794 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:07.080133 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5121fa8-a2c8-43cb-b06e-197979091b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:07.081022 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5121fa8-a2c8-43cb-b06e-197979091b94 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:07.081443 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5121fa8-a2c8-43cb-b06e-197979091b94 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:07.081911 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5121fa8-a2c8-43cb-b06e-197979091b94 None admin] PATH_INFO: `/v3/users/f5a4141642da477eb51d90acd8b1a0e2` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:07.083222 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5121fa8-a2c8-43cb-b06e-197979091b94 None admin] RBAC: Authorizing `identity:get_user(user_id=f5a4141642da477eb51d90acd8b1a0e2)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:07.084861 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5121fa8-a2c8-43cb-b06e-197979091b94 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:07.086883 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 135/263] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 30 01:16:06 2022] GET /identity/v3/users/f5a4141642da477eb51d90acd8b1a0e2 => generated 283 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:07.093536 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5121fa8-a2c8-43cb-b06e-197979091b94 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:07.199320 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:07.212990 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 129/264] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 30 01:16:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:07.220431 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eab15d-cab8-498b-97c7-4e2c24d40794 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:07.321400 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5121fa8-a2c8-43cb-b06e-197979091b94 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:07.340814 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:07.380523 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e14b6b3-0705-4430-94f3-659be3eae824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:07.381195 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14b6b3-0705-4430-94f3-659be3eae824 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:07.381474 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14b6b3-0705-4430-94f3-659be3eae824 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:07.381794 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14b6b3-0705-4430-94f3-659be3eae824 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:07.420916 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eab15d-cab8-498b-97c7-4e2c24d40794 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:07.498441 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b962d1-b8ed-4c13-bb32-dc1276f7984f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:07.499064 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b962d1-b8ed-4c13-bb32-dc1276f7984f None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:07.499348 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b962d1-b8ed-4c13-bb32-dc1276f7984f None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:07.499645 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b962d1-b8ed-4c13-bb32-dc1276f7984f None admin] PATH_INFO: `/v3/projects/32242e96e74d4bc797430f115ced8a19` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:07.501393 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b962d1-b8ed-4c13-bb32-dc1276f7984f None admin] RBAC: Authorizing `identity:get_project(project_id=32242e96e74d4bc797430f115ced8a19)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:07.502859 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b962d1-b8ed-4c13-bb32-dc1276f7984f None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:07.504561 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 130/265] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 30 01:16:07 2022] GET /identity/v3/projects/32242e96e74d4bc797430f115ced8a19 => generated 302 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:16:07.511906 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b962d1-b8ed-4c13-bb32-dc1276f7984f None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:07.526845 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e14b6b3-0705-4430-94f3-659be3eae824 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:07.528571 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e14b6b3-0705-4430-94f3-659be3eae824 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:07.625934 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:07.715299 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b962d1-b8ed-4c13-bb32-dc1276f7984f None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:07.719322 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 136/266] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 30 01:16:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 626 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:07.720456 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c83f4d-41c4-47ef-aa3e-276b81ad8c1a None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:07.720736 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c83f4d-41c4-47ef-aa3e-276b81ad8c1a None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:07.721821 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c83f4d-41c4-47ef-aa3e-276b81ad8c1a None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:07.723818 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 137/267] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:16:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:16:07.729004 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c83f4d-41c4-47ef-aa3e-276b81ad8c1a None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:07.759108 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:07.772757 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1864698b-825c-4a05-895b-d5472141de29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:07.774161 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864698b-825c-4a05-895b-d5472141de29 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:07.774625 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864698b-825c-4a05-895b-d5472141de29 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:07.775070 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864698b-825c-4a05-895b-d5472141de29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:07.776466 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1864698b-825c-4a05-895b-d5472141de29 None admin] RBAC: Adding query filter params (role.id=f6bc03b6972e420eb338ee7fd1443974, scope.project.id=32242e96e74d4bc797430f115ced8a19, user.id=f5a4141642da477eb51d90acd8b1a0e2) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:07.777095 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1864698b-825c-4a05-895b-d5472141de29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:07.778798 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1864698b-825c-4a05-895b-d5472141de29 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:07.786740 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 131/268] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 30 01:16:07 2022] GET /identity/v3/role_assignments?user.id=f5a4141642da477eb51d90acd8b1a0e2&scope.project.id=32242e96e74d4bc797430f115ced8a19&role.id=f6bc03b6972e420eb338ee7fd1443974 => generated 608 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:07.788590 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b608fe-db10-4cf6-a90a-076aa1c9fe74 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:07.789051 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b608fe-db10-4cf6-a90a-076aa1c9fe74 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:07.789473 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b608fe-db10-4cf6-a90a-076aa1c9fe74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:07.813650 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-c1b608fe-db10-4cf6-a90a-076aa1c9fe74 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:07.815849 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-c1b608fe-db10-4cf6-a90a-076aa1c9fe74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:07.859839 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c83f4d-41c4-47ef-aa3e-276b81ad8c1a None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:07.899699 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca031b-3ed8-46ea-b108-0aa5e3dd7fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:07.900786 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca031b-3ed8-46ea-b108-0aa5e3dd7fd9 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:07.901271 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca031b-3ed8-46ea-b108-0aa5e3dd7fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:07.901796 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca031b-3ed8-46ea-b108-0aa5e3dd7fd9 None admin] PATH_INFO: `/v3/projects/32242e96e74d4bc797430f115ced8a19` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:07.903163 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cca031b-3ed8-46ea-b108-0aa5e3dd7fd9 None admin] RBAC: Authorizing `identity:get_project(project_id=32242e96e74d4bc797430f115ced8a19)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:07.905300 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cca031b-3ed8-46ea-b108-0aa5e3dd7fd9 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:07.911665 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 138/269] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 30 01:16:07 2022] GET /identity/v3/projects/32242e96e74d4bc797430f115ced8a19 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:07.913527 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98bdce5-ab70-4c4d-817b-c6f250beedfe None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:07.914035 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98bdce5-ab70-4c4d-817b-c6f250beedfe None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:07.914512 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98bdce5-ab70-4c4d-817b-c6f250beedfe None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:07.916298 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 139/270] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:16:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:16:07.920911 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 132/271] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:16:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:16:07.921232 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98bdce5-ab70-4c4d-817b-c6f250beedfe None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:07.929923 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328e17b-051e-4cd7-99e4-fe40ac5e3e62 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:07.930207 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328e17b-051e-4cd7-99e4-fe40ac5e3e62 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:07.930479 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328e17b-051e-4cd7-99e4-fe40ac5e3e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:07.952705 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:07.967572 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-3328e17b-051e-4cd7-99e4-fe40ac5e3e62 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:07.969135 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-3328e17b-051e-4cd7-99e4-fe40ac5e3e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:08.108133 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 133/272] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:16:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:16:08.132733 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98bdce5-ab70-4c4d-817b-c6f250beedfe None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:08.179400 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed90b1fc-5613-41b3-adb4-fd456de116bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:08.180045 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90b1fc-5613-41b3-adb4-fd456de116bc None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:08.180321 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90b1fc-5613-41b3-adb4-fd456de116bc None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:08.180590 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90b1fc-5613-41b3-adb4-fd456de116bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:08.181329 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed90b1fc-5613-41b3-adb4-fd456de116bc None admin] RBAC: Adding query filter params (role.id=449624f20ef248ef97aeceba5b22eccd, scope.project.id=32242e96e74d4bc797430f115ced8a19, user.id=f5a4141642da477eb51d90acd8b1a0e2) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:08.181633 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed90b1fc-5613-41b3-adb4-fd456de116bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:08.183088 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed90b1fc-5613-41b3-adb4-fd456de116bc None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:08.185453 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acffc5f-9c15-492f-a41a-f79df983917a None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:08.185735 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acffc5f-9c15-492f-a41a-f79df983917a None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:08.186002 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acffc5f-9c15-492f-a41a-f79df983917a None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:08.187552 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 134/273] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:16:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:16:08.193141 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 140/274] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 30 01:16:07 2022] GET /identity/v3/role_assignments?user.id=f5a4141642da477eb51d90acd8b1a0e2&scope.project.id=32242e96e74d4bc797430f115ced8a19&role.id=449624f20ef248ef97aeceba5b22eccd => generated 608 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:08.201032 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc2048-1a3b-40d7-bdcc-4608c3265954 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:08.201344 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc2048-1a3b-40d7-bdcc-4608c3265954 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:08.201563 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc2048-1a3b-40d7-bdcc-4608c3265954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:08.221472 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-38fc2048-1a3b-40d7-bdcc-4608c3265954 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:08.223238 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-38fc2048-1a3b-40d7-bdcc-4608c3265954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:08.271418 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:08.307324 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 135/275] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:16:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:16:08.343052 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed90b1fc-5613-41b3-adb4-fd456de116bc None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:08.428925 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:08.467315 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed90b1fc-5613-41b3-adb4-fd456de116bc None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:08.475937 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fc2048-1a3b-40d7-bdcc-4608c3265954 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:08.515317 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6546119a-9e66-45f6-a9af-3333f668d975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:08.516024 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546119a-9e66-45f6-a9af-3333f668d975 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:08.516296 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546119a-9e66-45f6-a9af-3333f668d975 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:08.516560 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546119a-9e66-45f6-a9af-3333f668d975 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:08.517653 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6546119a-9e66-45f6-a9af-3333f668d975 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:08.519092 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6546119a-9e66-45f6-a9af-3333f668d975 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:08.521602 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 141/276] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:16:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:08.521821 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8501e-9846-47ed-aa2f-b11c1ab94070 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:08.522096 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8501e-9846-47ed-aa2f-b11c1ab94070 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:08.522365 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8501e-9846-47ed-aa2f-b11c1ab94070 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:08.525800 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 142/277] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:16:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:16:08.526772 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8501e-9846-47ed-aa2f-b11c1ab94070 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:08.621155 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fc2048-1a3b-40d7-bdcc-4608c3265954 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:08.658727 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe6cde-65d6-4cb0-8c2c-63be60c543e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:08.659361 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe6cde-65d6-4cb0-8c2c-63be60c543e1 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:08.659662 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe6cde-65d6-4cb0-8c2c-63be60c543e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:08.659961 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8501e-9846-47ed-aa2f-b11c1ab94070 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:08.660074 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe6cde-65d6-4cb0-8c2c-63be60c543e1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:08.670798 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebe6cde-65d6-4cb0-8c2c-63be60c543e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:16:08.675816 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-7ebe6cde-65d6-4cb0-8c2c-63be60c543e1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 01:16:08.675816 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:08.675816 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:08.675816 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:08.675816 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:08.675816 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:08.675816 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:08.675816 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:08.675816 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:08.675816 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:08.675816 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:08.675816 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:08.675816 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:16:08.675816 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:16:08.675816 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:16:08.675816 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:16:08.676771 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:16:08.676771 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:16:08.676771 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:16:08.676771 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:16:08.676771 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:08.676771 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:08.676771 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:08.676771 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:08.676771 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:08.676771 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:08.676771 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:08.676771 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:08.676771 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:08.676771 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:08.676771 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:08.676771 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:08.677632 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:08.677632 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:08.677632 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:08.677632 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:08.677632 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:16:08.677632 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:16:08.677632 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:16:08.677632 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:16:08.677632 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:16:08.677632 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:16:08.677632 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 01:16:08.677632 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:16:08.677632 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 136/278] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 30 01:16:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:16:08.679071 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7640c1-9862-4b34-aa52-d9506d71144e None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:08.679284 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7640c1-9862-4b34-aa52-d9506d71144e None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:08.679671 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7640c1-9862-4b34-aa52-d9506d71144e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:08.697311 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-ed7640c1-9862-4b34-aa52-d9506d71144e None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:08.698502 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-ed7640c1-9862-4b34-aa52-d9506d71144e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:08.700424 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf82430-fe0b-4072-8efa-277a92d4cb6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:08.701041 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf82430-fe0b-4072-8efa-277a92d4cb6d None admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:08.701323 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf82430-fe0b-4072-8efa-277a92d4cb6d None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:08.701597 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf82430-fe0b-4072-8efa-277a92d4cb6d None admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:08.702251 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf82430-fe0b-4072-8efa-277a92d4cb6d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:08.703709 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf82430-fe0b-4072-8efa-277a92d4cb6d None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:08.722188 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:08.731757 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 143/279] 10.222.0.60 () {60 vars in 1132 bytes} [Tue Aug 30 01:16:08 2022] POST /identity/v3/users => generated 293 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:16:08.732719 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf82430-fe0b-4072-8efa-277a92d4cb6d None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:08.734086 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:08.777412 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 137/280] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:16:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:16:08.778809 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7640c1-9862-4b34-aa52-d9506d71144e None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:08.869111 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf82430-fe0b-4072-8efa-277a92d4cb6d None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:08.917112 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d961c-74b9-44aa-84dc-046123ccd637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:08.918017 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d961c-74b9-44aa-84dc-046123ccd637 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:08.918017 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d961c-74b9-44aa-84dc-046123ccd637 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:08.918285 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d961c-74b9-44aa-84dc-046123ccd637 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:08.931260 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228d961c-74b9-44aa-84dc-046123ccd637 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:16:08.931405 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7640c1-9862-4b34-aa52-d9506d71144e None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:08.937732 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-228d961c-74b9-44aa-84dc-046123ccd637 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 01:16:08.937732 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:08.937732 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:08.937732 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:08.937732 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:08.937732 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:08.937732 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:08.937732 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:08.937732 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:08.937732 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:08.937732 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:08.937732 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:08.937732 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:16:08.937732 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:16:08.937732 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:16:08.937732 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:16:08.938679 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:16:08.938679 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:16:08.938679 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:16:08.938679 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:16:08.938679 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:08.938679 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:08.938679 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:08.938679 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:08.938679 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:08.938679 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:08.938679 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:08.938679 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:08.938679 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:08.938679 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:08.938679 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:08.938679 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:08.940005 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:08.940005 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:08.940005 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:08.940005 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:08.940005 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:16:08.940005 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:16:08.940005 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:16:08.940005 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:16:08.940005 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:16:08.940005 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:16:08.940005 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 01:16:08.940005 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:16:08.940005 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 144/281] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 30 01:16:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:08.945629 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d961c-74b9-44aa-84dc-046123ccd637 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:08.975907 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4fff2-7558-4754-a1af-d62bcc7e1e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:08.976896 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4fff2-7558-4754-a1af-d62bcc7e1e80 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:08.977222 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4fff2-7558-4754-a1af-d62bcc7e1e80 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:08.977501 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4fff2-7558-4754-a1af-d62bcc7e1e80 None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:08.978177 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da4fff2-7558-4754-a1af-d62bcc7e1e80 None admin] RBAC: Adding query filter params (name=member) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:08.978482 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da4fff2-7558-4754-a1af-d62bcc7e1e80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:08.980144 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da4fff2-7558-4754-a1af-d62bcc7e1e80 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:08.990302 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 138/282] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Aug 30 01:16:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:08.996037 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4fff2-7558-4754-a1af-d62bcc7e1e80 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:09.020392 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:09.042300 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:09.075042 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d961c-74b9-44aa-84dc-046123ccd637 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:09.122426 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4fff2-7558-4754-a1af-d62bcc7e1e80 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:09.122621 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985321e3-8125-48a7-8ab9-1e54e5385ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:09.123079 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985321e3-8125-48a7-8ab9-1e54e5385ed2 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:09.123353 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985321e3-8125-48a7-8ab9-1e54e5385ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:09.123648 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985321e3-8125-48a7-8ab9-1e54e5385ed2 None admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:09.124513 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985321e3-8125-48a7-8ab9-1e54e5385ed2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:09.125624 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985321e3-8125-48a7-8ab9-1e54e5385ed2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:09.127019 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985321e3-8125-48a7-8ab9-1e54e5385ed2 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:09.137739 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 145/283] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Aug 30 01:16:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:09.138841 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985321e3-8125-48a7-8ab9-1e54e5385ed2 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:09.167754 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b60301-60db-4417-9f3b-96680bcdf8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:09.168443 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b60301-60db-4417-9f3b-96680bcdf8ee None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:09.168836 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b60301-60db-4417-9f3b-96680bcdf8ee None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:09.169106 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b60301-60db-4417-9f3b-96680bcdf8ee None admin] PATH_INFO: `/v3/users/26b0cdd349dd4786882627d635733493` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:09.185503 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b60301-60db-4417-9f3b-96680bcdf8ee None admin] RBAC: Authorizing `identity:get_user(user_id=26b0cdd349dd4786882627d635733493)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:09.186926 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b60301-60db-4417-9f3b-96680bcdf8ee None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:09.188873 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 139/284] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 30 01:16:08 2022] GET /identity/v3/users/26b0cdd349dd4786882627d635733493 => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:16:09.189643 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b60301-60db-4417-9f3b-96680bcdf8ee None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:09.251286 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985321e3-8125-48a7-8ab9-1e54e5385ed2 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:09.275259 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:09.287736 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187d4250-0cc4-460e-af87-09499ccc81e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:09.288622 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d4250-0cc4-460e-af87-09499ccc81e0 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:09.289282 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d4250-0cc4-460e-af87-09499ccc81e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:09.289626 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d4250-0cc4-460e-af87-09499ccc81e0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:09.290464 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:09.303085 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187d4250-0cc4-460e-af87-09499ccc81e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:16:09.304360 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b60301-60db-4417-9f3b-96680bcdf8ee None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:09.309379 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-187d4250-0cc4-460e-af87-09499ccc81e0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 01:16:09.309379 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:09.309379 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:09.309379 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:09.309379 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:09.309379 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:09.309379 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:09.309379 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:09.309379 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:09.309379 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:09.309379 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:09.309379 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:09.309379 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:16:09.309379 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:16:09.309379 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:16:09.309379 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:16:09.310267 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:16:09.310267 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:16:09.310267 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:16:09.310267 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:16:09.310267 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:09.310267 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:09.310267 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:09.310267 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:09.310267 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:09.310267 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:09.310267 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:09.310267 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:09.310267 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:09.310267 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:09.310267 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:09.310267 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:09.311060 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:09.311060 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:09.311060 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:09.311060 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:09.311060 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:16:09.311060 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:16:09.311060 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:16:09.311060 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:16:09.311060 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:16:09.311060 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:16:09.311060 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 01:16:09.311060 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:16:09.313377 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 146/285] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 30 01:16:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:09.314404 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187d4250-0cc4-460e-af87-09499ccc81e0 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:09.341651 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b0c23e-fd1a-4545-b6dd-4d2f47b24250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:09.342340 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0c23e-fd1a-4545-b6dd-4d2f47b24250 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:09.342557 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0c23e-fd1a-4545-b6dd-4d2f47b24250 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:09.342835 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0c23e-fd1a-4545-b6dd-4d2f47b24250 None admin] PATH_INFO: `/v3/users/0d8447e04e974951a017da9d37c61124` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:09.344031 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b0c23e-fd1a-4545-b6dd-4d2f47b24250 None admin] RBAC: Authorizing `identity:get_user(user_id=0d8447e04e974951a017da9d37c61124)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:09.345764 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b0c23e-fd1a-4545-b6dd-4d2f47b24250 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:09.347950 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 140/286] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 30 01:16:09 2022] GET /identity/v3/users/0d8447e04e974951a017da9d37c61124 => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:09.348805 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b0c23e-fd1a-4545-b6dd-4d2f47b24250 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:09.436323 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187d4250-0cc4-460e-af87-09499ccc81e0 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:09.478598 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b0c23e-fd1a-4545-b6dd-4d2f47b24250 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:09.487222 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49568fa-adcb-4918-bfa0-f55a4c10ec8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:09.487868 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49568fa-adcb-4918-bfa0-f55a4c10ec8a None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:09.488815 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49568fa-adcb-4918-bfa0-f55a4c10ec8a None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:09.489268 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49568fa-adcb-4918-bfa0-f55a4c10ec8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:09.490592 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49568fa-adcb-4918-bfa0-f55a4c10ec8a None admin] RBAC: Adding query filter params (role.id=5b38bd827c5847969c4ee48e27261f5b, user.id=26b0cdd349dd4786882627d635733493, scope.system=all) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:09.491147 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49568fa-adcb-4918-bfa0-f55a4c10ec8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:09.493691 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49568fa-adcb-4918-bfa0-f55a4c10ec8a None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:09.502133 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 147/287] 10.222.0.60 () {56 vars in 1308 bytes} [Tue Aug 30 01:16:09 2022] GET /identity/v3/role_assignments?user.id=26b0cdd349dd4786882627d635733493&scope.system=all&role.id=5b38bd827c5847969c4ee48e27261f5b => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:09.502935 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49568fa-adcb-4918-bfa0-f55a4c10ec8a None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:09.533703 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9902c766-d470-4938-813c-b8336acb5357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:09.534703 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902c766-d470-4938-813c-b8336acb5357 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:09.535231 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902c766-d470-4938-813c-b8336acb5357 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:09.535755 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902c766-d470-4938-813c-b8336acb5357 None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:09.536631 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9902c766-d470-4938-813c-b8336acb5357 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:09.537127 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9902c766-d470-4938-813c-b8336acb5357 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:09.538863 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9902c766-d470-4938-813c-b8336acb5357 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:09.549558 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 141/288] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Aug 30 01:16:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:09.556047 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9902c766-d470-4938-813c-b8336acb5357 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:09.597867 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:09.617256 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:09.705816 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49568fa-adcb-4918-bfa0-f55a4c10ec8a None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:09.731901 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9902c766-d470-4938-813c-b8336acb5357 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:09.775206 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b1885e-63f5-4829-ab5a-8be8098ae7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:09.775869 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1885e-63f5-4829-ab5a-8be8098ae7e7 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:09.776147 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1885e-63f5-4829-ab5a-8be8098ae7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:09.776419 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1885e-63f5-4829-ab5a-8be8098ae7e7 None admin] PATH_INFO: `/v3/users/a7c8bbd21082408e9f68600e19f14819` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:09.780523 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b1885e-63f5-4829-ab5a-8be8098ae7e7 None admin] RBAC: Authorizing `identity:get_user(user_id=a7c8bbd21082408e9f68600e19f14819)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:09.781999 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b1885e-63f5-4829-ab5a-8be8098ae7e7 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:09.784949 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 142/289] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 30 01:16:09 2022] GET /identity/v3/users/a7c8bbd21082408e9f68600e19f14819 => generated 297 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:09.790028 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb2fc30-2968-4420-afae-06040a2fb48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:09.790928 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb2fc30-2968-4420-afae-06040a2fb48c None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:09.791427 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb2fc30-2968-4420-afae-06040a2fb48c None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:09.791923 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb2fc30-2968-4420-afae-06040a2fb48c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:09.792368 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b1885e-63f5-4829-ab5a-8be8098ae7e7 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:09.873087 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb2fc30-2968-4420-afae-06040a2fb48c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:09.874999 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb2fc30-2968-4420-afae-06040a2fb48c None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:09.927732 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:09.987912 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 148/290] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 30 01:16:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:09.994895 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb2fc30-2968-4420-afae-06040a2fb48c None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:10.034270 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:10.055678 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b1885e-63f5-4829-ab5a-8be8098ae7e7 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:10.101438 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a59f3f4-6d93-4cbc-8eab-0e2e65bda8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:10.102083 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a59f3f4-6d93-4cbc-8eab-0e2e65bda8c1 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:10.102362 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a59f3f4-6d93-4cbc-8eab-0e2e65bda8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:10.102632 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a59f3f4-6d93-4cbc-8eab-0e2e65bda8c1 None admin] PATH_INFO: `/v3/projects/32242e96e74d4bc797430f115ced8a19` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:10.103999 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a59f3f4-6d93-4cbc-8eab-0e2e65bda8c1 None admin] RBAC: Authorizing `identity:get_project(project_id=32242e96e74d4bc797430f115ced8a19)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:10.105479 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a59f3f4-6d93-4cbc-8eab-0e2e65bda8c1 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:10.107204 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 143/291] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 30 01:16:09 2022] GET /identity/v3/projects/32242e96e74d4bc797430f115ced8a19 => generated 302 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:10.121278 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a59f3f4-6d93-4cbc-8eab-0e2e65bda8c1 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:10.199184 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb2fc30-2968-4420-afae-06040a2fb48c None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:10.265557 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b9f46-2aeb-47f8-9ab0-f9796a61b34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:10.266116 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b9f46-2aeb-47f8-9ab0-f9796a61b34b None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:10.266393 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b9f46-2aeb-47f8-9ab0-f9796a61b34b None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:10.266659 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b9f46-2aeb-47f8-9ab0-f9796a61b34b None admin] PATH_INFO: `/v3/projects/32242e96e74d4bc797430f115ced8a19` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:10.267827 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038b9f46-2aeb-47f8-9ab0-f9796a61b34b None admin] RBAC: Authorizing `identity:get_project(project_id=32242e96e74d4bc797430f115ced8a19)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:10.269804 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038b9f46-2aeb-47f8-9ab0-f9796a61b34b None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:10.271445 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 149/292] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 30 01:16:09 2022] GET /identity/v3/projects/32242e96e74d4bc797430f115ced8a19 => generated 302 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:10.278053 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b9f46-2aeb-47f8-9ab0-f9796a61b34b None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:10.310439 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:10.318961 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a59f3f4-6d93-4cbc-8eab-0e2e65bda8c1 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:10.386638 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df561e-c138-4e3e-982c-ff163cf98844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:10.387300 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df561e-c138-4e3e-982c-ff163cf98844 None admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:10.387616 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df561e-c138-4e3e-982c-ff163cf98844 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:10.387886 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df561e-c138-4e3e-982c-ff163cf98844 None admin] PATH_INFO: `/v3/projects/32242e96e74d4bc797430f115ced8a19/users/a7c8bbd21082408e9f68600e19f14819/roles/c2266dd88cfd4bdbb73eea767bcd4bac` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:10.391387 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19df561e-c138-4e3e-982c-ff163cf98844 None admin] RBAC: Authorizing `identity:create_grant(project_id=32242e96e74d4bc797430f115ced8a19, user_id=a7c8bbd21082408e9f68600e19f14819, role_id=c2266dd88cfd4bdbb73eea767bcd4bac)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:10.392870 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19df561e-c138-4e3e-982c-ff163cf98844 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:10.439363 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 144/293] 10.222.0.60 () {58 vars in 1439 bytes} [Tue Aug 30 01:16:10 2022] PUT /identity/v3/projects/32242e96e74d4bc797430f115ced8a19/users/a7c8bbd21082408e9f68600e19f14819/roles/c2266dd88cfd4bdbb73eea767bcd4bac => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:16:10.445366 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b9f46-2aeb-47f8-9ab0-f9796a61b34b None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:10.482357 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a0eece-c0ab-493f-a9ca-9285494ce9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:10.482988 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0eece-c0ab-493f-a9ca-9285494ce9bb None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:10.483272 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0eece-c0ab-493f-a9ca-9285494ce9bb None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:10.483579 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0eece-c0ab-493f-a9ca-9285494ce9bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:10.484410 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a0eece-c0ab-493f-a9ca-9285494ce9bb None admin] RBAC: Adding query filter params (role.id=5b38bd827c5847969c4ee48e27261f5b, scope.project.id=32242e96e74d4bc797430f115ced8a19, user.id=0d8447e04e974951a017da9d37c61124) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:10.484725 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a0eece-c0ab-493f-a9ca-9285494ce9bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:10.486290 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a0eece-c0ab-493f-a9ca-9285494ce9bb None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:10.493769 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 150/294] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 30 01:16:10 2022] GET /identity/v3/role_assignments?user.id=0d8447e04e974951a017da9d37c61124&scope.project.id=32242e96e74d4bc797430f115ced8a19&role.id=5b38bd827c5847969c4ee48e27261f5b => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:10.939448 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6df30a-c986-4b3b-a95b-3adaed5233a2 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:10.939949 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6df30a-c986-4b3b-a95b-3adaed5233a2 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:10.940022 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6df30a-c986-4b3b-a95b-3adaed5233a2 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:10.941747 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 145/295] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:16:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:16:10.947072 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a6a6f-f86c-47fd-aced-3688ed82348d None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:10.947349 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a6a6f-f86c-47fd-aced-3688ed82348d None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:10.947652 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a6a6f-f86c-47fd-aced-3688ed82348d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:10.975302 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-453a6a6f-f86c-47fd-aced-3688ed82348d None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:10.976549 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-453a6a6f-f86c-47fd-aced-3688ed82348d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:11.048187 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 151/296] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:16:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 01:16:11.126805 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf64356-fbe9-49e8-ac06-d9d0b14c63de None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:11.127135 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf64356-fbe9-49e8-ac06-d9d0b14c63de None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:11.127352 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf64356-fbe9-49e8-ac06-d9d0b14c63de None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:11.128992 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 146/297] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:16:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:16:11.134276 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33648f62-e859-4184-981d-92b02483e56e None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:11.134567 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33648f62-e859-4184-981d-92b02483e56e None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:11.134847 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33648f62-e859-4184-981d-92b02483e56e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:11.153931 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-33648f62-e859-4184-981d-92b02483e56e None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:11.155184 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-33648f62-e859-4184-981d-92b02483e56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:11.157265 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:11.230724 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 152/298] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:16:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:16:11.318413 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf64356-fbe9-49e8-ac06-d9d0b14c63de None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:11.335961 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:11.424389 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf64356-fbe9-49e8-ac06-d9d0b14c63de None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:11.458986 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1647c391-9778-4355-a381-bedc080797f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:11.459974 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647c391-9778-4355-a381-bedc080797f5 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:11.460553 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647c391-9778-4355-a381-bedc080797f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:11.461020 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647c391-9778-4355-a381-bedc080797f5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:11.472884 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1647c391-9778-4355-a381-bedc080797f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:16:11.478503 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-1647c391-9778-4355-a381-bedc080797f5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 01:16:11.478503 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:11.478503 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:11.478503 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:11.478503 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:11.478503 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:11.478503 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:11.478503 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:11.478503 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:11.478503 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:11.478503 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:11.478503 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:11.478503 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:16:11.478503 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:16:11.478503 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:16:11.478503 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:16:11.479361 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:16:11.479361 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:16:11.479361 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:16:11.479361 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:16:11.479361 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:11.479361 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:11.479361 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:11.479361 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:11.479361 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:11.479361 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:11.479361 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:11.479361 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:11.479361 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:11.479361 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:11.479361 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:11.479361 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:11.480208 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:11.480208 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:11.480208 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:11.480208 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:11.480208 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:16:11.480208 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:16:11.480208 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:16:11.480208 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:16:11.480208 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:16:11.480208 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:16:11.480208 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 01:16:11.480208 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:16:11.482769 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 147/299] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 30 01:16:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:11.488792 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33648f62-e859-4184-981d-92b02483e56e None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:11.508556 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1647c391-9778-4355-a381-bedc080797f5 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:11.598577 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:11.611471 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33648f62-e859-4184-981d-92b02483e56e None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:11.633717 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1647c391-9778-4355-a381-bedc080797f5 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:11.648339 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6541565-1fb9-4e1c-8967-a4311e10713e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:11.648936 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6541565-1fb9-4e1c-8967-a4311e10713e None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:11.649217 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6541565-1fb9-4e1c-8967-a4311e10713e None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:11.649490 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6541565-1fb9-4e1c-8967-a4311e10713e None admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:11.650167 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6541565-1fb9-4e1c-8967-a4311e10713e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:11.650470 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6541565-1fb9-4e1c-8967-a4311e10713e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:11.651884 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6541565-1fb9-4e1c-8967-a4311e10713e None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:11.657290 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:11.661928 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 153/300] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Aug 30 01:16:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:11.663569 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca69f42-d63e-4028-953c-f8314dfc27d8 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:11.664079 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca69f42-d63e-4028-953c-f8314dfc27d8 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:11.664555 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca69f42-d63e-4028-953c-f8314dfc27d8 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:11.666339 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 154/301] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:16:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:16:11.669429 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca69f42-d63e-4028-953c-f8314dfc27d8 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:11.679006 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3273d659-632a-4499-841c-d6360d4ba70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:11.679688 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3273d659-632a-4499-841c-d6360d4ba70c None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:11.679969 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3273d659-632a-4499-841c-d6360d4ba70c None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:11.680241 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3273d659-632a-4499-841c-d6360d4ba70c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:11.681354 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3273d659-632a-4499-841c-d6360d4ba70c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:11.682821 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3273d659-632a-4499-841c-d6360d4ba70c None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:11.685097 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 148/302] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:16:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:16:11.687493 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53305408-ad50-4c2a-8b34-57460823846e None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:11.687493 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53305408-ad50-4c2a-8b34-57460823846e None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:11.687493 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53305408-ad50-4c2a-8b34-57460823846e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:11.706092 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-53305408-ad50-4c2a-8b34-57460823846e None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:11.707863 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-53305408-ad50-4c2a-8b34-57460823846e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:11.778874 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 149/303] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:16:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:16:11.784353 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53305408-ad50-4c2a-8b34-57460823846e None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:11.793857 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca69f42-d63e-4028-953c-f8314dfc27d8 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:11.833869 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f506111-0909-4fe8-ac6b-ce0eb3936a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:11.834891 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f506111-0909-4fe8-ac6b-ce0eb3936a43 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:11.835421 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f506111-0909-4fe8-ac6b-ce0eb3936a43 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:11.835907 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f506111-0909-4fe8-ac6b-ce0eb3936a43 None admin] PATH_INFO: `/v3/users/4d264cbbd0854434b4b72b10abc0881f` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:11.854584 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f506111-0909-4fe8-ac6b-ce0eb3936a43 None admin] RBAC: Authorizing `identity:get_user(user_id=4d264cbbd0854434b4b72b10abc0881f)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:11.856326 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f506111-0909-4fe8-ac6b-ce0eb3936a43 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:11.863495 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 155/304] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 30 01:16:11 2022] GET /identity/v3/users/4d264cbbd0854434b4b72b10abc0881f => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:16:11.864899 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f506111-0909-4fe8-ac6b-ce0eb3936a43 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:11.876071 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:11.922144 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53305408-ad50-4c2a-8b34-57460823846e None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:11.934360 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:11.966124 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c51e56-a06b-4092-b940-aa3a5e2a5558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:11.967666 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c51e56-a06b-4092-b940-aa3a5e2a5558 None admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:11.968399 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c51e56-a06b-4092-b940-aa3a5e2a5558 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:11.969266 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c51e56-a06b-4092-b940-aa3a5e2a5558 None admin] PATH_INFO: `/v3/groups` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:11.970147 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c51e56-a06b-4092-b940-aa3a5e2a5558 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:11.971886 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c51e56-a06b-4092-b940-aa3a5e2a5558 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:11.986496 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f506111-0909-4fe8-ac6b-ce0eb3936a43 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:12.000054 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 150/305] 10.222.0.60 () {60 vars in 1134 bytes} [Tue Aug 30 01:16:11 2022] POST /identity/v3/groups => generated 229 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:16:12.031548 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bad9cc-3c47-45e9-b6af-7e0ec15af970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:12.032203 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bad9cc-3c47-45e9-b6af-7e0ec15af970 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:12.032488 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bad9cc-3c47-45e9-b6af-7e0ec15af970 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:12.032761 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bad9cc-3c47-45e9-b6af-7e0ec15af970 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:12.033508 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bad9cc-3c47-45e9-b6af-7e0ec15af970 None admin] RBAC: Adding query filter params (role.id=c2266dd88cfd4bdbb73eea767bcd4bac, user.id=4d264cbbd0854434b4b72b10abc0881f, scope.system=all) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:12.033821 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bad9cc-3c47-45e9-b6af-7e0ec15af970 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:12.035330 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bad9cc-3c47-45e9-b6af-7e0ec15af970 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:12.041657 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 156/306] 10.222.0.60 () {56 vars in 1308 bytes} [Tue Aug 30 01:16:11 2022] GET /identity/v3/role_assignments?user.id=4d264cbbd0854434b4b72b10abc0881f&scope.system=all&role.id=c2266dd88cfd4bdbb73eea767bcd4bac => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:16:12.048724 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c51e56-a06b-4092-b940-aa3a5e2a5558 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:12.179015 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c51e56-a06b-4092-b940-aa3a5e2a5558 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:12.213668 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:12.219934 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc3365-0ef7-4489-bcb8-b82403af8303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:12.220688 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc3365-0ef7-4489-bcb8-b82403af8303 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:12.220977 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc3365-0ef7-4489-bcb8-b82403af8303 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:12.221254 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc3365-0ef7-4489-bcb8-b82403af8303 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:12.233830 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bc3365-0ef7-4489-bcb8-b82403af8303 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:16:12.239847 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-60bc3365-0ef7-4489-bcb8-b82403af8303 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 01:16:12.239847 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:12.239847 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:12.239847 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:12.239847 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:12.239847 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:12.239847 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:12.239847 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:12.239847 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:12.239847 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:12.239847 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:12.239847 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:12.239847 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:16:12.239847 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:16:12.239847 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:16:12.239847 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:16:12.240967 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:16:12.240967 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:16:12.240967 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:16:12.240967 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:16:12.240967 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:12.240967 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:12.240967 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:12.240967 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:12.240967 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:12.240967 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:12.240967 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:12.240967 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:12.240967 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:12.240967 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:12.240967 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:12.240967 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:12.242037 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:12.242037 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:12.242037 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:12.242037 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:12.242037 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:16:12.242037 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:16:12.242037 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:16:12.242037 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:16:12.242037 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:16:12.242037 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:16:12.242037 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 01:16:12.242037 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:16:12.242037 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 151/307] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 30 01:16:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:12.247991 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bad9cc-3c47-45e9-b6af-7e0ec15af970 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:12.359270 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bad9cc-3c47-45e9-b6af-7e0ec15af970 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:12.383353 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:12.395362 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b69140f-e530-46a7-abf6-553fd360bed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:12.396502 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69140f-e530-46a7-abf6-553fd360bed8 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:12.397019 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69140f-e530-46a7-abf6-553fd360bed8 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:12.397682 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69140f-e530-46a7-abf6-553fd360bed8 None admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:12.398430 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b69140f-e530-46a7-abf6-553fd360bed8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:12.398803 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b69140f-e530-46a7-abf6-553fd360bed8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:12.400278 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b69140f-e530-46a7-abf6-553fd360bed8 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:12.408981 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 157/308] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Aug 30 01:16:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:12.415208 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc3365-0ef7-4489-bcb8-b82403af8303 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:12.525129 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc3365-0ef7-4489-bcb8-b82403af8303 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:12.562022 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d026c7-d518-4e32-965f-eee4ce3ec9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:12.562656 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d026c7-d518-4e32-965f-eee4ce3ec9e5 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:12.562936 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d026c7-d518-4e32-965f-eee4ce3ec9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:12.563208 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d026c7-d518-4e32-965f-eee4ce3ec9e5 None admin] PATH_INFO: `/v3/users/26b0cdd349dd4786882627d635733493` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:12.564425 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d026c7-d518-4e32-965f-eee4ce3ec9e5 None admin] RBAC: Authorizing `identity:get_user(user_id=26b0cdd349dd4786882627d635733493)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:12.565935 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d026c7-d518-4e32-965f-eee4ce3ec9e5 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:12.568532 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 152/309] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 30 01:16:12 2022] GET /identity/v3/users/26b0cdd349dd4786882627d635733493 => generated 293 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:12.573775 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b69140f-e530-46a7-abf6-553fd360bed8 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:12.624935 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df06a1-9120-4344-8e21-e15e85f81d02 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:12.625216 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df06a1-9120-4344-8e21-e15e85f81d02 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:12.625397 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df06a1-9120-4344-8e21-e15e85f81d02 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:12.626866 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 153/310] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:16:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:16:12.634105 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f081299-5e39-4c1e-9d24-1d28e9c94096 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:12.634633 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f081299-5e39-4c1e-9d24-1d28e9c94096 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:12.635095 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f081299-5e39-4c1e-9d24-1d28e9c94096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:12.658627 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-4f081299-5e39-4c1e-9d24-1d28e9c94096 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:12.660354 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-4f081299-5e39-4c1e-9d24-1d28e9c94096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:12.689167 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b69140f-e530-46a7-abf6-553fd360bed8 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:12.729509 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9616d1-9ffc-4af8-b80a-59e11d7399b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:12.730284 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9616d1-9ffc-4af8-b80a-59e11d7399b3 None admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:12.730568 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9616d1-9ffc-4af8-b80a-59e11d7399b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:12.730845 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9616d1-9ffc-4af8-b80a-59e11d7399b3 None admin] PATH_INFO: `/v3/system/users/26b0cdd349dd4786882627d635733493/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:12.732309 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9616d1-9ffc-4af8-b80a-59e11d7399b3 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=26b0cdd349dd4786882627d635733493, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:12.733690 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9616d1-9ffc-4af8-b80a-59e11d7399b3 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:12.734845 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:12.747076 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 158/311] 10.222.0.60 () {58 vars in 1334 bytes} [Tue Aug 30 01:16:12 2022] PUT /identity/v3/system/users/26b0cdd349dd4786882627d635733493/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:16:12.760340 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 154/312] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:16:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 01:16:13.027382 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9616d1-9ffc-4af8-b80a-59e11d7399b3 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:13.080303 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:13.137536 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9616d1-9ffc-4af8-b80a-59e11d7399b3 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:13.172897 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c41c87a-2268-4ca6-ac74-fa97cc0f5ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:13.173893 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41c87a-2268-4ca6-ac74-fa97cc0f5ec3 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:13.174364 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41c87a-2268-4ca6-ac74-fa97cc0f5ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:13.174887 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41c87a-2268-4ca6-ac74-fa97cc0f5ec3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:13.186410 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c41c87a-2268-4ca6-ac74-fa97cc0f5ec3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:16:13.192638 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-9c41c87a-2268-4ca6-ac74-fa97cc0f5ec3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 01:16:13.192638 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:13.192638 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:13.192638 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:13.192638 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:13.192638 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:13.192638 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:13.192638 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:13.192638 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:13.192638 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:13.192638 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:13.192638 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:13.192638 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:16:13.192638 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:16:13.192638 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:16:13.192638 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:16:13.193512 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:16:13.193512 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:16:13.193512 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:16:13.193512 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:16:13.193512 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:13.193512 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:13.193512 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:13.193512 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:13.193512 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:13.193512 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:13.193512 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:13.193512 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:13.193512 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:13.193512 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:13.193512 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:13.193512 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:13.194290 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:13.194290 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:13.194290 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:13.194290 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:13.194290 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:16:13.194290 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:16:13.194290 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:16:13.194290 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:16:13.194290 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:16:13.194290 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:16:13.194290 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 01:16:13.194290 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:16:13.197201 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 159/313] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 30 01:16:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:13.203031 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f081299-5e39-4c1e-9d24-1d28e9c94096 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:13.308025 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f081299-5e39-4c1e-9d24-1d28e9c94096 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:13.342867 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b6a30-071d-426c-b6a4-520da5aa4aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:13.343490 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b6a30-071d-426c-b6a4-520da5aa4aed None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:13.343767 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b6a30-071d-426c-b6a4-520da5aa4aed None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:13.344032 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b6a30-071d-426c-b6a4-520da5aa4aed None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:13.344685 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98b6a30-071d-426c-b6a4-520da5aa4aed None admin] RBAC: Adding query filter params (name=reader) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:13.344980 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98b6a30-071d-426c-b6a4-520da5aa4aed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:13.346356 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98b6a30-071d-426c-b6a4-520da5aa4aed None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:13.355260 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 155/314] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Aug 30 01:16:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:13.360794 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c41c87a-2268-4ca6-ac74-fa97cc0f5ec3 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:13.465455 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c41c87a-2268-4ca6-ac74-fa97cc0f5ec3 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:13.474588 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:13.501032 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c62083-f852-441d-a49b-0df59a96ab76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:13.501673 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c62083-f852-441d-a49b-0df59a96ab76 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:13.501944 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c62083-f852-441d-a49b-0df59a96ab76 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:13.502209 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c62083-f852-441d-a49b-0df59a96ab76 None admin] PATH_INFO: `/v3/users/a7c8bbd21082408e9f68600e19f14819` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:13.503418 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c62083-f852-441d-a49b-0df59a96ab76 None admin] RBAC: Authorizing `identity:get_user(user_id=a7c8bbd21082408e9f68600e19f14819)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:13.508996 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c62083-f852-441d-a49b-0df59a96ab76 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:13.508996 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 160/315] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 30 01:16:13 2022] GET /identity/v3/users/a7c8bbd21082408e9f68600e19f14819 => generated 297 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:13.513022 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b6a30-071d-426c-b6a4-520da5aa4aed None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:13.572013 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:13.630467 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b6a30-071d-426c-b6a4-520da5aa4aed None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:13.666079 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b199de80-5917-4fef-890b-616dead6ca1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:13.666692 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199de80-5917-4fef-890b-616dead6ca1e None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:13.666965 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199de80-5917-4fef-890b-616dead6ca1e None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:13.667232 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199de80-5917-4fef-890b-616dead6ca1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:13.740544 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b199de80-5917-4fef-890b-616dead6ca1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:13.742130 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b199de80-5917-4fef-890b-616dead6ca1e None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:13.796629 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:13.847833 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 156/316] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 30 01:16:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:13.853355 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c62083-f852-441d-a49b-0df59a96ab76 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:13.959166 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c62083-f852-441d-a49b-0df59a96ab76 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:13.994183 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19fc68-9268-4cb0-9e71-28c54b2c33f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:13.994819 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19fc68-9268-4cb0-9e71-28c54b2c33f7 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:13.995411 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19fc68-9268-4cb0-9e71-28c54b2c33f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:13.995707 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19fc68-9268-4cb0-9e71-28c54b2c33f7 None admin] PATH_INFO: `/v3/projects/32242e96e74d4bc797430f115ced8a19` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:13.996880 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e19fc68-9268-4cb0-9e71-28c54b2c33f7 None admin] RBAC: Authorizing `identity:get_project(project_id=32242e96e74d4bc797430f115ced8a19)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:13.998329 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e19fc68-9268-4cb0-9e71-28c54b2c33f7 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:14.000265 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 161/317] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 30 01:16:13 2022] GET /identity/v3/projects/32242e96e74d4bc797430f115ced8a19 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:14.006187 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b199de80-5917-4fef-890b-616dead6ca1e None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:14.052221 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc0d53-bd37-4d1f-8b23-b39964385dce None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:14.052777 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc0d53-bd37-4d1f-8b23-b39964385dce None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:14.053054 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc0d53-bd37-4d1f-8b23-b39964385dce None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:14.055552 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 162/318] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:16:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:16:14.060397 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b495a-8fcc-42c6-862b-4b835d1490c7 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:14.060675 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b495a-8fcc-42c6-862b-4b835d1490c7 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:14.060942 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b495a-8fcc-42c6-862b-4b835d1490c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:14.084528 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-580b495a-8fcc-42c6-862b-4b835d1490c7 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:14.086136 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-580b495a-8fcc-42c6-862b-4b835d1490c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:14.120983 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b199de80-5917-4fef-890b-616dead6ca1e None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:14.142302 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:14.157124 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd6e08-f683-47ab-8c9f-e70a91d41d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:14.157963 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd6e08-f683-47ab-8c9f-e70a91d41d8f None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:14.158074 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd6e08-f683-47ab-8c9f-e70a91d41d8f None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:14.158303 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd6e08-f683-47ab-8c9f-e70a91d41d8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:14.159020 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fd6e08-f683-47ab-8c9f-e70a91d41d8f None admin] RBAC: Adding query filter params (role.id=c2266dd88cfd4bdbb73eea767bcd4bac, scope.project.id=32242e96e74d4bc797430f115ced8a19, user.id=a7c8bbd21082408e9f68600e19f14819) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:14.159318 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fd6e08-f683-47ab-8c9f-e70a91d41d8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:14.161464 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fd6e08-f683-47ab-8c9f-e70a91d41d8f None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:14.167466 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 157/319] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 30 01:16:14 2022] GET /identity/v3/role_assignments?user.id=a7c8bbd21082408e9f68600e19f14819&scope.project.id=32242e96e74d4bc797430f115ced8a19&role.id=c2266dd88cfd4bdbb73eea767bcd4bac => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:14.173407 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 163/320] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:16:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:16:14.183461 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec44d2a7-7170-446c-a292-698ddbb96e7b None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:14.183461 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec44d2a7-7170-446c-a292-698ddbb96e7b None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:14.183461 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec44d2a7-7170-446c-a292-698ddbb96e7b None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:14.183461 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 158/321] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:16:14 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:16:14.184643 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999c37c-e2df-49ad-a6c6-8e4071793d74 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:14.184934 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999c37c-e2df-49ad-a6c6-8e4071793d74 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:14.185210 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999c37c-e2df-49ad-a6c6-8e4071793d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:14.209519 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-8999c37c-e2df-49ad-a6c6-8e4071793d74 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:14.211073 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-8999c37c-e2df-49ad-a6c6-8e4071793d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:14.287321 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 164/322] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:16:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:16:14.454431 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec44d2a7-7170-446c-a292-698ddbb96e7b None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:14.473965 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:14.557795 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8999c37c-e2df-49ad-a6c6-8e4071793d74 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:14.561379 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec44d2a7-7170-446c-a292-698ddbb96e7b None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:14.608224 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf0574a-7f57-4bae-8e81-690c9a164853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:14.609377 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0574a-7f57-4bae-8e81-690c9a164853 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:14.609815 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0574a-7f57-4bae-8e81-690c9a164853 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:14.610084 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0574a-7f57-4bae-8e81-690c9a164853 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:14.620877 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf0574a-7f57-4bae-8e81-690c9a164853 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:16:14.626203 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-bdf0574a-7f57-4bae-8e81-690c9a164853 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 01:16:14.626203 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:14.626203 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:14.626203 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:14.626203 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:14.626203 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:14.626203 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:14.626203 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:14.626203 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:14.626203 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:14.626203 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:14.626203 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:14.626203 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:16:14.626203 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:16:14.626203 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:16:14.626203 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:16:14.627082 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:16:14.627082 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:16:14.627082 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:16:14.627082 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:16:14.627082 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:14.627082 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:14.627082 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:14.627082 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:14.627082 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:14.627082 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:14.627082 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:14.627082 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:14.627082 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:14.627082 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:14.627082 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:14.627082 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:14.627919 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:14.627919 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:14.627919 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:14.627919 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:14.627919 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:16:14.627919 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:16:14.627919 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:16:14.627919 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:16:14.627919 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:16:14.627919 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:16:14.627919 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 01:16:14.627919 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:16:14.632271 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 159/323] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 30 01:16:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:14.633105 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf0574a-7f57-4bae-8e81-690c9a164853 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:14.667269 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8999c37c-e2df-49ad-a6c6-8e4071793d74 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:14.669680 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:14.705733 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cad66a1-49f2-4ad8-8be6-2a7628adfd55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:14.706274 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad66a1-49f2-4ad8-8be6-2a7628adfd55 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:14.706546 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad66a1-49f2-4ad8-8be6-2a7628adfd55 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:14.707018 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad66a1-49f2-4ad8-8be6-2a7628adfd55 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:14.708575 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cad66a1-49f2-4ad8-8be6-2a7628adfd55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:14.710247 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:14.711185 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cad66a1-49f2-4ad8-8be6-2a7628adfd55 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:14.713486 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 165/324] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:16:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:14.719282 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cad66a1-49f2-4ad8-8be6-2a7628adfd55 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:14.736738 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf0574a-7f57-4bae-8e81-690c9a164853 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:14.771062 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79bdc9c-52d8-4a72-9300-5f37c26389e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:14.771686 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79bdc9c-52d8-4a72-9300-5f37c26389e8 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:14.771962 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79bdc9c-52d8-4a72-9300-5f37c26389e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:14.772229 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79bdc9c-52d8-4a72-9300-5f37c26389e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:14.772889 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79bdc9c-52d8-4a72-9300-5f37c26389e8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:14.773185 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79bdc9c-52d8-4a72-9300-5f37c26389e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:14.774575 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79bdc9c-52d8-4a72-9300-5f37c26389e8 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:14.782503 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 160/325] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Aug 30 01:16:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:16:14.784063 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc3883-72a6-476b-a97d-c5c625d56a58 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:14.784350 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc3883-72a6-476b-a97d-c5c625d56a58 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:14.784619 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc3883-72a6-476b-a97d-c5c625d56a58 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:14.786395 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 161/326] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:16:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:16:14.791263 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc3883-72a6-476b-a97d-c5c625d56a58 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:14.822766 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cad66a1-49f2-4ad8-8be6-2a7628adfd55 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:14.858751 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6814f4-8eaa-43fe-8dc9-6091fdcf2c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:14.859372 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6814f4-8eaa-43fe-8dc9-6091fdcf2c7f None admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:14.859655 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6814f4-8eaa-43fe-8dc9-6091fdcf2c7f None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:14.859927 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6814f4-8eaa-43fe-8dc9-6091fdcf2c7f None admin] PATH_INFO: `/v3/groups` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:14.860553 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6814f4-8eaa-43fe-8dc9-6091fdcf2c7f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:14.862252 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6814f4-8eaa-43fe-8dc9-6091fdcf2c7f None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:14.877928 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 166/327] 10.222.0.60 () {60 vars in 1134 bytes} [Tue Aug 30 01:16:14 2022] POST /identity/v3/groups => generated 226 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:16:14.879221 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65eb18d-ad92-4db6-841c-cb1512881733 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:14.879547 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65eb18d-ad92-4db6-841c-cb1512881733 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:14.879821 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65eb18d-ad92-4db6-841c-cb1512881733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:14.898573 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc3883-72a6-476b-a97d-c5c625d56a58 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:14.899804 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-e65eb18d-ad92-4db6-841c-cb1512881733 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:14.901514 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-e65eb18d-ad92-4db6-841c-cb1512881733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:14.933756 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:14.942587 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b3f32-7f22-4532-958f-743f4812f8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:14.943384 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b3f32-7f22-4532-958f-743f4812f8dd None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:14.943848 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b3f32-7f22-4532-958f-743f4812f8dd None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:14.944267 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b3f32-7f22-4532-958f-743f4812f8dd None admin] PATH_INFO: `/v3/users/4d264cbbd0854434b4b72b10abc0881f` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:14.945576 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304b3f32-7f22-4532-958f-743f4812f8dd None admin] RBAC: Authorizing `identity:get_user(user_id=4d264cbbd0854434b4b72b10abc0881f)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:14.947168 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304b3f32-7f22-4532-958f-743f4812f8dd None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:14.949218 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 162/328] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 30 01:16:14 2022] GET /identity/v3/users/4d264cbbd0854434b4b72b10abc0881f => generated 293 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:14.954833 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b3f32-7f22-4532-958f-743f4812f8dd None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:14.965314 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:14.986345 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 167/329] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:16:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:16:15.078029 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b3f32-7f22-4532-958f-743f4812f8dd None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:15.114681 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16399b76-f914-43ff-901a-f7cb8a1cd86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:15.115547 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16399b76-f914-43ff-901a-f7cb8a1cd86c None admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:15.115928 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16399b76-f914-43ff-901a-f7cb8a1cd86c None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:15.116772 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16399b76-f914-43ff-901a-f7cb8a1cd86c None admin] PATH_INFO: `/v3/system/users/4d264cbbd0854434b4b72b10abc0881f/roles/c2266dd88cfd4bdbb73eea767bcd4bac` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:15.117807 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16399b76-f914-43ff-901a-f7cb8a1cd86c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4d264cbbd0854434b4b72b10abc0881f, role_id=c2266dd88cfd4bdbb73eea767bcd4bac)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:15.119234 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16399b76-f914-43ff-901a-f7cb8a1cd86c None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:15.129748 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 163/330] 10.222.0.60 () {58 vars in 1334 bytes} [Tue Aug 30 01:16:14 2022] PUT /identity/v3/system/users/4d264cbbd0854434b4b72b10abc0881f/roles/c2266dd88cfd4bdbb73eea767bcd4bac => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:16:15.262259 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65eb18d-ad92-4db6-841c-cb1512881733 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:15.373100 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65eb18d-ad92-4db6-841c-cb1512881733 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:15.408270 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281152fb-a297-4e3a-87b3-377e4661bf8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:15.408907 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281152fb-a297-4e3a-87b3-377e4661bf8d None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:15.409183 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281152fb-a297-4e3a-87b3-377e4661bf8d None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:15.409455 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281152fb-a297-4e3a-87b3-377e4661bf8d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:15.420813 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281152fb-a297-4e3a-87b3-377e4661bf8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:16:15.426327 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-281152fb-a297-4e3a-87b3-377e4661bf8d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 01:16:15.426327 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:15.426327 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:15.426327 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:15.426327 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:15.426327 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:15.426327 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:15.426327 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:15.426327 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:15.426327 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:15.426327 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:15.426327 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:15.426327 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:16:15.426327 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:16:15.426327 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:16:15.426327 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:16:15.427378 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:16:15.427378 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:16:15.427378 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:16:15.427378 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:16:15.427378 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:15.427378 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:15.427378 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:15.427378 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:15.427378 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:15.427378 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:15.427378 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:15.427378 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:15.427378 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:15.427378 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:15.427378 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:15.427378 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:15.428386 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:15.428386 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:15.428386 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:15.428386 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:15.428386 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:16:15.428386 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:16:15.428386 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:16:15.428386 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:16:15.428386 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:16:15.428386 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:16:15.428386 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 01:16:15.428386 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:16:15.428386 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 168/331] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 30 01:16:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:15.435077 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16399b76-f914-43ff-901a-f7cb8a1cd86c None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:15.530010 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:15.576956 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16399b76-f914-43ff-901a-f7cb8a1cd86c None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:15.615047 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f2a64f-5af5-410e-8b72-a0a2d5636976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:15.615931 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2a64f-5af5-410e-8b72-a0a2d5636976 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:15.616346 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2a64f-5af5-410e-8b72-a0a2d5636976 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:15.616749 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2a64f-5af5-410e-8b72-a0a2d5636976 None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:15.617577 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f2a64f-5af5-410e-8b72-a0a2d5636976 None admin] RBAC: Adding query filter params (name=member) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:15.618056 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f2a64f-5af5-410e-8b72-a0a2d5636976 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:15.621790 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f2a64f-5af5-410e-8b72-a0a2d5636976 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:15.635480 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 164/332] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Aug 30 01:16:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:15.641358 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281152fb-a297-4e3a-87b3-377e4661bf8d None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:15.670923 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:15.756195 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281152fb-a297-4e3a-87b3-377e4661bf8d None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:15.793467 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373d8a58-8937-46d5-b492-5a9a737da2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:15.794318 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d8a58-8937-46d5-b492-5a9a737da2d7 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:15.794734 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d8a58-8937-46d5-b492-5a9a737da2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:15.795141 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d8a58-8937-46d5-b492-5a9a737da2d7 None admin] PATH_INFO: `/v3/users/26b0cdd349dd4786882627d635733493` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:15.796819 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373d8a58-8937-46d5-b492-5a9a737da2d7 None admin] RBAC: Authorizing `identity:get_user(user_id=26b0cdd349dd4786882627d635733493)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:15.798475 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373d8a58-8937-46d5-b492-5a9a737da2d7 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:15.801472 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 169/333] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 30 01:16:15 2022] GET /identity/v3/users/26b0cdd349dd4786882627d635733493 => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:15.807547 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f2a64f-5af5-410e-8b72-a0a2d5636976 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:15.913475 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f2a64f-5af5-410e-8b72-a0a2d5636976 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:15.943419 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:15.948305 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcba2af-2479-424f-9661-73620f79a270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:15.948918 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcba2af-2479-424f-9661-73620f79a270 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:15.949500 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcba2af-2479-424f-9661-73620f79a270 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:15.949762 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcba2af-2479-424f-9661-73620f79a270 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:15.950541 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcba2af-2479-424f-9661-73620f79a270 None admin] RBAC: Adding query filter params (role.id=5b38bd827c5847969c4ee48e27261f5b, user.id=26b0cdd349dd4786882627d635733493, scope.system=all) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:15.950846 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcba2af-2479-424f-9661-73620f79a270 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:15.952374 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcba2af-2479-424f-9661-73620f79a270 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:15.967022 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 165/334] 10.222.0.60 () {56 vars in 1308 bytes} [Tue Aug 30 01:16:15 2022] GET /identity/v3/role_assignments?user.id=26b0cdd349dd4786882627d635733493&scope.system=all&role.id=5b38bd827c5847969c4ee48e27261f5b => generated 510 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:17.448673 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc0268-14d3-49dc-9442-10ec6f99dea7 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:17.449511 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc0268-14d3-49dc-9442-10ec6f99dea7 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:17.449924 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc0268-14d3-49dc-9442-10ec6f99dea7 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:17.451680 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 170/335] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:16:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:16:17.469591 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2e0b2-8e51-472d-8da5-6c58b018df33 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:17.470444 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2e0b2-8e51-472d-8da5-6c58b018df33 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:17.471060 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2e0b2-8e51-472d-8da5-6c58b018df33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:17.500458 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-64f2e0b2-8e51-472d-8da5-6c58b018df33 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:17.501666 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-64f2e0b2-8e51-472d-8da5-6c58b018df33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:17.534326 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef8c78-4297-4069-9785-89619545762c None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:17.535198 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef8c78-4297-4069-9785-89619545762c None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:17.535411 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef8c78-4297-4069-9785-89619545762c None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:17.540997 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 171/336] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:16:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:16:17.542672 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a144dca8-3ca0-4a48-bd56-e5e65b8ed0e9 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:17.543155 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a144dca8-3ca0-4a48-bd56-e5e65b8ed0e9 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:17.543642 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a144dca8-3ca0-4a48-bd56-e5e65b8ed0e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:17.580406 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-a144dca8-3ca0-4a48-bd56-e5e65b8ed0e9 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:17.582371 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-a144dca8-3ca0-4a48-bd56-e5e65b8ed0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:17.583044 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 166/337] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:16:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 01:16:17.696881 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 172/338] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:16:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:16:18.039630 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee4e95-38b6-43dc-8610-142dd5a44f6b None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:18.040009 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee4e95-38b6-43dc-8610-142dd5a44f6b None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:18.040187 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee4e95-38b6-43dc-8610-142dd5a44f6b None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:18.041808 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 167/339] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:16:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:16:18.047198 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda0e2c-c421-49bc-9516-757d1d50f1bf None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:18.047756 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda0e2c-c421-49bc-9516-757d1d50f1bf None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:18.048240 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda0e2c-c421-49bc-9516-757d1d50f1bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:18.072467 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-9cda0e2c-c421-49bc-9516-757d1d50f1bf None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:18.073973 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-9cda0e2c-c421-49bc-9516-757d1d50f1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:18.094071 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:18.103135 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee4e95-38b6-43dc-8610-142dd5a44f6b None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:18.186138 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 173/340] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:16:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:16:18.187450 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb2ccc-b6f8-4460-9436-687db02ef0ff None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:18.187757 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb2ccc-b6f8-4460-9436-687db02ef0ff None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:18.188024 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb2ccc-b6f8-4460-9436-687db02ef0ff None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:18.189553 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 174/341] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:16:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:16:18.192367 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb2ccc-b6f8-4460-9436-687db02ef0ff None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:18.248205 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee4e95-38b6-43dc-8610-142dd5a44f6b None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:18.296016 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:18.323388 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f683ba47-d83c-4831-af88-13b53d0188e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:18.324049 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683ba47-d83c-4831-af88-13b53d0188e9 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:18.324326 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683ba47-d83c-4831-af88-13b53d0188e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:18.324594 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683ba47-d83c-4831-af88-13b53d0188e9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:18.345186 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f683ba47-d83c-4831-af88-13b53d0188e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:16:18.350967 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-f683ba47-d83c-4831-af88-13b53d0188e9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 01:16:18.350967 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:18.350967 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:18.350967 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:18.350967 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:18.350967 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:18.350967 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:18.350967 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:18.350967 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:18.350967 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:18.350967 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:18.350967 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:18.350967 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:16:18.350967 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:16:18.350967 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:16:18.350967 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:16:18.351899 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:16:18.351899 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:16:18.351899 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:16:18.351899 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:16:18.351899 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:18.351899 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:18.351899 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:18.351899 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:18.351899 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:18.351899 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:18.351899 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:18.351899 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:18.351899 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:18.351899 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:18.351899 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:18.351899 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:18.352685 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:18.352685 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:18.352685 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:18.352685 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:18.352685 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:16:18.352685 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:16:18.352685 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:16:18.352685 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:16:18.352685 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:16:18.352685 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:16:18.352685 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 01:16:18.352685 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:16:18.352685 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 168/342] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Aug 30 01:16:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:18.353574 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73061b3a-b995-4917-8a02-00a25429c5f0 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:18.353857 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73061b3a-b995-4917-8a02-00a25429c5f0 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:18.354133 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73061b3a-b995-4917-8a02-00a25429c5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:18.393020 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-73061b3a-b995-4917-8a02-00a25429c5f0 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:18.394294 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-73061b3a-b995-4917-8a02-00a25429c5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:18.402557 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb2ccc-b6f8-4460-9436-687db02ef0ff None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:18.449281 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d67e9-e79e-4711-a355-a34c7b66f87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:18.450038 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d67e9-e79e-4711-a355-a34c7b66f87e None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:18.450226 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d67e9-e79e-4711-a355-a34c7b66f87e None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:18.450489 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d67e9-e79e-4711-a355-a34c7b66f87e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:18.464192 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673d67e9-e79e-4711-a355-a34c7b66f87e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:16:18.469458 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-673d67e9-e79e-4711-a355-a34c7b66f87e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 01:16:18.469458 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:18.469458 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:18.469458 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:18.469458 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:18.469458 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:18.469458 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:18.469458 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:18.469458 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:18.469458 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:18.469458 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:18.469458 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:18.469458 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:16:18.469458 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:16:18.469458 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:16:18.469458 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:16:18.470334 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:16:18.470334 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:16:18.470334 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:16:18.470334 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:16:18.470334 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:18.470334 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:18.470334 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:18.470334 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:18.470334 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:18.470334 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:18.470334 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:18.470334 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:18.470334 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:18.470334 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:18.470334 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:18.470334 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:18.471112 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:18.471112 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:18.471112 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:18.471112 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:18.471112 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:16:18.471112 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:16:18.471112 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:16:18.471112 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:16:18.471112 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:16:18.471112 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:16:18.471112 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 01:16:18.471112 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:16:18.471112 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 175/343] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 30 01:16:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:16:18.471782 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d67e9-e79e-4711-a355-a34c7b66f87e None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:18.496182 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:18.518700 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 169/344] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:16:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:16:18.521187 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73061b3a-b995-4917-8a02-00a25429c5f0 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:18.638943 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73061b3a-b995-4917-8a02-00a25429c5f0 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:18.650863 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:18.684810 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008533c-b698-455f-b3e5-c4de63c15428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:18.684810 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008533c-b698-455f-b3e5-c4de63c15428 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:18.684810 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008533c-b698-455f-b3e5-c4de63c15428 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:18.685169 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008533c-b698-455f-b3e5-c4de63c15428 None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:18.685734 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9008533c-b698-455f-b3e5-c4de63c15428 None admin] RBAC: Adding query filter params (name=member) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:18.685870 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9008533c-b698-455f-b3e5-c4de63c15428 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:18.687299 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9008533c-b698-455f-b3e5-c4de63c15428 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:18.710302 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 170/345] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Aug 30 01:16:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:18.711186 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008533c-b698-455f-b3e5-c4de63c15428 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:18.712673 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d67e9-e79e-4711-a355-a34c7b66f87e None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:18.767840 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a7110-fd07-493b-bc3c-4555c3db534f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:18.770155 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a7110-fd07-493b-bc3c-4555c3db534f None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:18.770585 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a7110-fd07-493b-bc3c-4555c3db534f None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:18.772555 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a7110-fd07-493b-bc3c-4555c3db534f None admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:18.773381 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a7110-fd07-493b-bc3c-4555c3db534f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:18.773856 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a7110-fd07-493b-bc3c-4555c3db534f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:18.775407 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a7110-fd07-493b-bc3c-4555c3db534f None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:18.796647 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 176/346] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 30 01:16:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:18.802764 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a7110-fd07-493b-bc3c-4555c3db534f None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:18.896992 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:18.902805 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008533c-b698-455f-b3e5-c4de63c15428 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:18.936792 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a7110-fd07-493b-bc3c-4555c3db534f None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:18.938092 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc28e0b4-d6fa-4a6b-a37e-58e3d00149c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:18.938948 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28e0b4-d6fa-4a6b-a37e-58e3d00149c4 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:18.939422 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28e0b4-d6fa-4a6b-a37e-58e3d00149c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:18.940013 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28e0b4-d6fa-4a6b-a37e-58e3d00149c4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:18.951969 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc28e0b4-d6fa-4a6b-a37e-58e3d00149c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:16:18.957911 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-cc28e0b4-d6fa-4a6b-a37e-58e3d00149c4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 01:16:18.957911 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:18.957911 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:18.957911 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:18.957911 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:18.957911 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:18.957911 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:18.957911 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:18.957911 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:18.957911 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:18.957911 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:18.957911 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:18.957911 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:16:18.957911 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:16:18.957911 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:16:18.957911 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:16:18.958816 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:16:18.958816 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:16:18.958816 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:16:18.958816 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:16:18.958816 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:18.958816 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:18.958816 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:18.958816 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:18.958816 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:18.958816 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:18.958816 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:18.958816 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:18.958816 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:18.958816 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:18.958816 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:18.958816 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:18.959761 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:18.959761 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:18.959761 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:18.959761 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:18.959761 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:16:18.959761 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:16:18.959761 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:16:18.959761 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:16:18.959761 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:16:18.959761 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:16:18.959761 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 01:16:18.959761 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:16:18.962395 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 171/347] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 30 01:16:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:18.963544 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc28e0b4-d6fa-4a6b-a37e-58e3d00149c4 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:18.984540 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a7cd7-72df-4b4b-8a76-6f6abfb2ed20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:18.985171 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a7cd7-72df-4b4b-8a76-6f6abfb2ed20 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:18.985457 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a7cd7-72df-4b4b-8a76-6f6abfb2ed20 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:18.985727 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a7cd7-72df-4b4b-8a76-6f6abfb2ed20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:19.011234 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:19.088054 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439a7cd7-72df-4b4b-8a76-6f6abfb2ed20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:19.089783 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439a7cd7-72df-4b4b-8a76-6f6abfb2ed20 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:19.095682 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc28e0b4-d6fa-4a6b-a37e-58e3d00149c4 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:19.141747 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb4253c-ebb3-4bd6-b8d6-67a3a779b663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:19.142376 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb4253c-ebb3-4bd6-b8d6-67a3a779b663 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:19.142656 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb4253c-ebb3-4bd6-b8d6-67a3a779b663 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:19.142928 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb4253c-ebb3-4bd6-b8d6-67a3a779b663 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:19.180658 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:19.216992 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 177/348] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 30 01:16:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:19.218033 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a7cd7-72df-4b4b-8a76-6f6abfb2ed20 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:19.233342 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb4253c-ebb3-4bd6-b8d6-67a3a779b663 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:19.234812 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb4253c-ebb3-4bd6-b8d6-67a3a779b663 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:19.277008 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:19.361613 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a7cd7-72df-4b4b-8a76-6f6abfb2ed20 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:19.369642 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 172/349] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 30 01:16:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:19.370870 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb4253c-ebb3-4bd6-b8d6-67a3a779b663 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:19.401628 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e161ad5d-b446-4875-9535-45e12e19dd1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:19.402382 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161ad5d-b446-4875-9535-45e12e19dd1e None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:19.402662 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161ad5d-b446-4875-9535-45e12e19dd1e None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:19.402938 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161ad5d-b446-4875-9535-45e12e19dd1e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:19.414566 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e161ad5d-b446-4875-9535-45e12e19dd1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:16:19.419865 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-e161ad5d-b446-4875-9535-45e12e19dd1e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 01:16:19.419865 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:19.419865 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:19.419865 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:19.419865 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:19.419865 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:19.419865 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:19.419865 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:19.419865 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:19.419865 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:19.419865 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:19.419865 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:19.419865 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:16:19.419865 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:16:19.419865 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:16:19.419865 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:16:19.420752 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:16:19.420752 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:16:19.420752 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:16:19.420752 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:16:19.420752 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:19.420752 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:19.420752 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:19.420752 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:19.420752 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:19.420752 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:19.420752 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:19.420752 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:19.420752 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:19.420752 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:19.420752 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:19.420752 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:19.421546 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:19.421546 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:19.421546 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:19.421546 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:19.421546 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:16:19.421546 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:16:19.421546 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:16:19.421546 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:16:19.421546 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:16:19.421546 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:16:19.421546 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 01:16:19.421546 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:16:19.421546 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 178/350] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 30 01:16:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:19.422681 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e16201-a372-40f4-9107-cc361cb44afc None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:19.422776 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e16201-a372-40f4-9107-cc361cb44afc None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:19.422999 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e16201-a372-40f4-9107-cc361cb44afc None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:19.427531 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 179/351] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:16:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:16:19.427531 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e16201-a372-40f4-9107-cc361cb44afc None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:19.473343 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:19.504946 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb4253c-ebb3-4bd6-b8d6-67a3a779b663 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:19.549652 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:19.555073 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6326fd9e-a847-4300-9928-22965bdd60f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:19.555973 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326fd9e-a847-4300-9928-22965bdd60f4 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:19.556257 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326fd9e-a847-4300-9928-22965bdd60f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:19.556591 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326fd9e-a847-4300-9928-22965bdd60f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:19.557259 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6326fd9e-a847-4300-9928-22965bdd60f4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:19.557567 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6326fd9e-a847-4300-9928-22965bdd60f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:19.559793 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6326fd9e-a847-4300-9928-22965bdd60f4 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:19.570920 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 173/352] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Aug 30 01:16:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:19.571840 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e16201-a372-40f4-9107-cc361cb44afc None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:19.571952 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6326fd9e-a847-4300-9928-22965bdd60f4 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:19.622894 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d5d63c-3c8e-4b8d-8aaf-39535030cf0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:19.624040 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5d63c-3c8e-4b8d-8aaf-39535030cf0b None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:19.624040 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5d63c-3c8e-4b8d-8aaf-39535030cf0b None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:19.624206 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5d63c-3c8e-4b8d-8aaf-39535030cf0b None admin] PATH_INFO: `/v3/projects/023703a6c5664626b371621981c1b1ba` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:19.626122 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d5d63c-3c8e-4b8d-8aaf-39535030cf0b None admin] RBAC: Authorizing `identity:get_project(project_id=023703a6c5664626b371621981c1b1ba)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:19.627596 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d5d63c-3c8e-4b8d-8aaf-39535030cf0b None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:19.629738 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 180/353] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 30 01:16:19 2022] GET /identity/v3/projects/023703a6c5664626b371621981c1b1ba => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:19.630860 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef64b7b-0711-4c05-b8c2-073ab86aca8e None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:19.631136 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef64b7b-0711-4c05-b8c2-073ab86aca8e None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:19.631400 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef64b7b-0711-4c05-b8c2-073ab86aca8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:19.651236 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-2ef64b7b-0711-4c05-b8c2-073ab86aca8e None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:19.652604 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-2ef64b7b-0711-4c05-b8c2-073ab86aca8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:19.705317 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6326fd9e-a847-4300-9928-22965bdd60f4 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:19.735193 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 181/354] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:16:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:16:19.735998 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef64b7b-0711-4c05-b8c2-073ab86aca8e None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:19.747660 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b9953-82d6-46cc-a9e0-99f08d02ca18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:19.748606 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b9953-82d6-46cc-a9e0-99f08d02ca18 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:19.749067 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b9953-82d6-46cc-a9e0-99f08d02ca18 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:19.749880 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b9953-82d6-46cc-a9e0-99f08d02ca18 None admin] PATH_INFO: `/v3/projects/023703a6c5664626b371621981c1b1ba` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:19.750890 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301b9953-82d6-46cc-a9e0-99f08d02ca18 None admin] RBAC: Authorizing `identity:get_project(project_id=023703a6c5664626b371621981c1b1ba)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:19.752387 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301b9953-82d6-46cc-a9e0-99f08d02ca18 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:19.754724 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 174/355] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 30 01:16:19 2022] GET /identity/v3/projects/023703a6c5664626b371621981c1b1ba => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:19.755321 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b9953-82d6-46cc-a9e0-99f08d02ca18 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:19.777905 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:19.838189 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:19.872942 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef64b7b-0711-4c05-b8c2-073ab86aca8e None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:19.894619 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b9953-82d6-46cc-a9e0-99f08d02ca18 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:19.915571 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce166dd6-d5cd-40a9-8de2-44077dd45114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:19.916471 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce166dd6-d5cd-40a9-8de2-44077dd45114 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:19.916939 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce166dd6-d5cd-40a9-8de2-44077dd45114 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:19.917483 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce166dd6-d5cd-40a9-8de2-44077dd45114 None admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:19.918158 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce166dd6-d5cd-40a9-8de2-44077dd45114 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:19.918458 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce166dd6-d5cd-40a9-8de2-44077dd45114 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:19.920004 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce166dd6-d5cd-40a9-8de2-44077dd45114 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:19.931826 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 182/356] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Aug 30 01:16:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:19.933201 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63532a05-9342-4d04-af2e-389f9edcdb89 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:19.933489 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63532a05-9342-4d04-af2e-389f9edcdb89 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:19.933776 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63532a05-9342-4d04-af2e-389f9edcdb89 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:19.934584 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ee6a9-bbae-4647-8f93-c7718768bb79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:19.935419 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ee6a9-bbae-4647-8f93-c7718768bb79 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:19.935609 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 183/357] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:16:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:16:19.936088 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ee6a9-bbae-4647-8f93-c7718768bb79 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:19.936295 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63532a05-9342-4d04-af2e-389f9edcdb89 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:19.936769 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ee6a9-bbae-4647-8f93-c7718768bb79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:20.032390 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23ee6a9-bbae-4647-8f93-c7718768bb79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:20.034192 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23ee6a9-bbae-4647-8f93-c7718768bb79 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:20.047293 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:20.061626 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63532a05-9342-4d04-af2e-389f9edcdb89 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:20.103228 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:20.108934 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172733d0-cc27-4128-b4ec-a44d3ecea5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:20.109792 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172733d0-cc27-4128-b4ec-a44d3ecea5b4 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:20.110221 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172733d0-cc27-4128-b4ec-a44d3ecea5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:20.110491 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172733d0-cc27-4128-b4ec-a44d3ecea5b4 None admin] PATH_INFO: `/v3/groups/9b88dce51cb24fb2b09ad4487e61997e` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:20.120304 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172733d0-cc27-4128-b4ec-a44d3ecea5b4 None admin] RBAC: Authorizing `identity:get_group(group_id=9b88dce51cb24fb2b09ad4487e61997e)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:20.121775 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172733d0-cc27-4128-b4ec-a44d3ecea5b4 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:20.123463 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 184/358] 10.222.0.60 () {56 vars in 1180 bytes} [Tue Aug 30 01:16:19 2022] GET /identity/v3/groups/9b88dce51cb24fb2b09ad4487e61997e => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:20.124926 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172733d0-cc27-4128-b4ec-a44d3ecea5b4 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:20.151838 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 175/359] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 30 01:16:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:20.152687 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ee6a9-bbae-4647-8f93-c7718768bb79 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:20.241253 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172733d0-cc27-4128-b4ec-a44d3ecea5b4 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:20.277316 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ee6a9-bbae-4647-8f93-c7718768bb79 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:20.284943 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc47219-f78a-4c79-a67d-80d408c01f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:20.285896 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc47219-f78a-4c79-a67d-80d408c01f75 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:20.285896 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc47219-f78a-4c79-a67d-80d408c01f75 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:20.286121 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc47219-f78a-4c79-a67d-80d408c01f75 None admin] PATH_INFO: `/v3/groups/9b88dce51cb24fb2b09ad4487e61997e` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:20.288137 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc47219-f78a-4c79-a67d-80d408c01f75 None admin] RBAC: Authorizing `identity:get_group(group_id=9b88dce51cb24fb2b09ad4487e61997e)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:20.289615 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc47219-f78a-4c79-a67d-80d408c01f75 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:20.291229 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 185/360] 10.222.0.60 () {56 vars in 1180 bytes} [Tue Aug 30 01:16:20 2022] GET /identity/v3/groups/9b88dce51cb24fb2b09ad4487e61997e => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:20.292534 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e91511-b930-4367-aa5a-413c7284ea7b None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:20.292818 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e91511-b930-4367-aa5a-413c7284ea7b None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:20.293095 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e91511-b930-4367-aa5a-413c7284ea7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:20.312850 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-a2e91511-b930-4367-aa5a-413c7284ea7b None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:20.314035 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-a2e91511-b930-4367-aa5a-413c7284ea7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:20.322074 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f7083-0f47-4f09-aae9-0e5ddbaa664c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:20.322964 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f7083-0f47-4f09-aae9-0e5ddbaa664c None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:20.323244 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f7083-0f47-4f09-aae9-0e5ddbaa664c None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:20.323544 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f7083-0f47-4f09-aae9-0e5ddbaa664c None admin] PATH_INFO: `/v3/users/4d264cbbd0854434b4b72b10abc0881f` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:20.324695 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858f7083-0f47-4f09-aae9-0e5ddbaa664c None admin] RBAC: Authorizing `identity:get_user(user_id=4d264cbbd0854434b4b72b10abc0881f)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:20.326205 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858f7083-0f47-4f09-aae9-0e5ddbaa664c None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:20.327883 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 176/361] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 30 01:16:20 2022] GET /identity/v3/users/4d264cbbd0854434b4b72b10abc0881f => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:20.328652 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f7083-0f47-4f09-aae9-0e5ddbaa664c None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:20.337323 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:20.363111 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:20.400428 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 186/362] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:16:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:16:20.401868 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e91511-b930-4367-aa5a-413c7284ea7b None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:20.457617 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f7083-0f47-4f09-aae9-0e5ddbaa664c None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:20.499144 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10af0b89-3ba7-47d9-a2d8-47719924fce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:20.499914 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af0b89-3ba7-47d9-a2d8-47719924fce3 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:20.500192 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af0b89-3ba7-47d9-a2d8-47719924fce3 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:20.503055 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af0b89-3ba7-47d9-a2d8-47719924fce3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:20.515862 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10af0b89-3ba7-47d9-a2d8-47719924fce3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:16:20.521370 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-10af0b89-3ba7-47d9-a2d8-47719924fce3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 01:16:20.521370 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:20.521370 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:20.521370 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:20.521370 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:20.521370 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:20.521370 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:20.521370 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:20.521370 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:20.521370 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:20.521370 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:20.521370 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:20.521370 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:16:20.521370 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:16:20.521370 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:16:20.521370 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:16:20.522457 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:16:20.522457 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:16:20.522457 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:16:20.522457 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:16:20.522457 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:20.522457 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:20.522457 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:20.522457 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:20.522457 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:20.522457 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:20.522457 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:20.522457 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:20.522457 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:20.522457 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:20.522457 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:20.522457 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:20.523323 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:20.523323 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:20.523323 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:20.523323 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:20.523323 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:16:20.523323 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:16:20.523323 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:16:20.523323 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:16:20.523323 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:16:20.523323 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:16:20.523323 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 01:16:20.523323 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:16:20.523323 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 177/363] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Aug 30 01:16:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:20.523323 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10af0b89-3ba7-47d9-a2d8-47719924fce3 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:20.533278 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e91511-b930-4367-aa5a-413c7284ea7b None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:20.573220 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae61f6-97e6-4c37-ab78-5a652197152b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:20.573763 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae61f6-97e6-4c37-ab78-5a652197152b None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:20.574043 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae61f6-97e6-4c37-ab78-5a652197152b None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:20.574318 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae61f6-97e6-4c37-ab78-5a652197152b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:20.575055 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dae61f6-97e6-4c37-ab78-5a652197152b None admin] RBAC: Adding query filter params (group.id=9b88dce51cb24fb2b09ad4487e61997e, role.id=5b38bd827c5847969c4ee48e27261f5b, scope.project.id=023703a6c5664626b371621981c1b1ba) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:20.575365 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dae61f6-97e6-4c37-ab78-5a652197152b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:20.578394 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dae61f6-97e6-4c37-ab78-5a652197152b None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:20.595935 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 187/364] 10.222.0.60 () {56 vars in 1376 bytes} [Tue Aug 30 01:16:20 2022] GET /identity/v3/role_assignments?group.id=9b88dce51cb24fb2b09ad4487e61997e&scope.project.id=023703a6c5664626b371621981c1b1ba&role.id=5b38bd827c5847969c4ee48e27261f5b => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:20.596628 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae61f6-97e6-4c37-ab78-5a652197152b None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:20.640514 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:20.651632 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:20.667194 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10af0b89-3ba7-47d9-a2d8-47719924fce3 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:20.717445 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc7123-bf62-4fb5-af20-3bc1a120f5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:20.718450 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc7123-bf62-4fb5-af20-3bc1a120f5a8 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:20.718731 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc7123-bf62-4fb5-af20-3bc1a120f5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:20.719054 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc7123-bf62-4fb5-af20-3bc1a120f5a8 None admin] PATH_INFO: `/v3/projects/32242e96e74d4bc797430f115ced8a19` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:20.720299 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dc7123-bf62-4fb5-af20-3bc1a120f5a8 None admin] RBAC: Authorizing `identity:get_project(project_id=32242e96e74d4bc797430f115ced8a19)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:20.721775 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dc7123-bf62-4fb5-af20-3bc1a120f5a8 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:20.727547 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 178/365] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 30 01:16:20 2022] GET /identity/v3/projects/32242e96e74d4bc797430f115ced8a19 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:20.727547 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc7123-bf62-4fb5-af20-3bc1a120f5a8 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:20.752753 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae61f6-97e6-4c37-ab78-5a652197152b None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:20.789404 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83ade89-5483-4b6b-b5cb-f3c7341ed1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:20.790018 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ade89-5483-4b6b-b5cb-f3c7341ed1b1 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:20.790295 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ade89-5483-4b6b-b5cb-f3c7341ed1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:20.790564 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ade89-5483-4b6b-b5cb-f3c7341ed1b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:20.791283 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83ade89-5483-4b6b-b5cb-f3c7341ed1b1 None admin] RBAC: Adding query filter params (group.id=9b88dce51cb24fb2b09ad4487e61997e, role.id=449624f20ef248ef97aeceba5b22eccd, scope.project.id=023703a6c5664626b371621981c1b1ba) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:20.791708 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83ade89-5483-4b6b-b5cb-f3c7341ed1b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:20.793142 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83ade89-5483-4b6b-b5cb-f3c7341ed1b1 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:20.799894 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 188/366] 10.222.0.60 () {56 vars in 1376 bytes} [Tue Aug 30 01:16:20 2022] GET /identity/v3/role_assignments?group.id=9b88dce51cb24fb2b09ad4487e61997e&scope.project.id=023703a6c5664626b371621981c1b1ba&role.id=449624f20ef248ef97aeceba5b22eccd => generated 260 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:20.801833 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83ade89-5483-4b6b-b5cb-f3c7341ed1b1 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:20.871020 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc7123-bf62-4fb5-af20-3bc1a120f5a8 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:20.931345 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:20.939685 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72626bd-fdf9-4044-979d-d4f7eff1b515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:20.940322 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72626bd-fdf9-4044-979d-d4f7eff1b515 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:20.940600 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72626bd-fdf9-4044-979d-d4f7eff1b515 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:20.940936 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72626bd-fdf9-4044-979d-d4f7eff1b515 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:20.943760 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72626bd-fdf9-4044-979d-d4f7eff1b515 None admin] RBAC: Adding query filter params (role.id=c2266dd88cfd4bdbb73eea767bcd4bac, user.id=4d264cbbd0854434b4b72b10abc0881f, scope.system=all) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:20.943760 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72626bd-fdf9-4044-979d-d4f7eff1b515 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:20.944045 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72626bd-fdf9-4044-979d-d4f7eff1b515 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:20.961143 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83ade89-5483-4b6b-b5cb-f3c7341ed1b1 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:20.962471 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 179/367] 10.222.0.60 () {56 vars in 1308 bytes} [Tue Aug 30 01:16:20 2022] GET /identity/v3/role_assignments?user.id=4d264cbbd0854434b4b72b10abc0881f&scope.system=all&role.id=c2266dd88cfd4bdbb73eea767bcd4bac => generated 510 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:20.963608 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72626bd-fdf9-4044-979d-d4f7eff1b515 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:20.987348 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:21.015169 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3718805c-3f0e-46bf-afe1-9cc3bacdb909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:21.015899 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718805c-3f0e-46bf-afe1-9cc3bacdb909 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:21.016186 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718805c-3f0e-46bf-afe1-9cc3bacdb909 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:21.016523 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718805c-3f0e-46bf-afe1-9cc3bacdb909 None admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:21.017217 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3718805c-3f0e-46bf-afe1-9cc3bacdb909 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:21.017519 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3718805c-3f0e-46bf-afe1-9cc3bacdb909 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:21.019487 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3718805c-3f0e-46bf-afe1-9cc3bacdb909 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:21.032349 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 189/368] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 30 01:16:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:21.033233 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3718805c-3f0e-46bf-afe1-9cc3bacdb909 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:21.101609 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72626bd-fdf9-4044-979d-d4f7eff1b515 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:21.152856 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad6c47-ea71-412e-b7c3-8c74ce0ba834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:21.154100 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad6c47-ea71-412e-b7c3-8c74ce0ba834 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:21.154398 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad6c47-ea71-412e-b7c3-8c74ce0ba834 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:21.154666 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad6c47-ea71-412e-b7c3-8c74ce0ba834 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:21.170979 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ad6c47-ea71-412e-b7c3-8c74ce0ba834 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:16:21.177802 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-e2ad6c47-ea71-412e-b7c3-8c74ce0ba834 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:16:21.177802 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:21.177802 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:21.177802 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:21.177802 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:21.177802 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:21.177802 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:21.177802 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:21.177802 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:21.177802 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:21.177802 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:21.177802 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:21.177802 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:16:21.177802 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:16:21.177802 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:16:21.177802 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:16:21.178763 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:16:21.178763 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:16:21.178763 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:16:21.178763 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:16:21.178763 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:21.178763 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:21.178763 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:21.178763 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:21.178763 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:21.178763 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:21.178763 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:21.178763 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:21.178763 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:21.178763 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:21.178763 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:21.178763 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:21.179638 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:21.179638 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:21.179638 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:21.179638 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:21.179638 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:16:21.179638 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:16:21.179638 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:16:21.179638 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:16:21.179638 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:16:21.179638 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:16:21.179638 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:16:21.179638 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:16:21.179638 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 180/369] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 30 01:16:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:21.180301 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad6c47-ea71-412e-b7c3-8c74ce0ba834 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:21.181477 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3718805c-3f0e-46bf-afe1-9cc3bacdb909 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:21.232789 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b946c88-dbf2-40f6-9b7c-d97295c98019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:21.233431 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b946c88-dbf2-40f6-9b7c-d97295c98019 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:21.233707 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b946c88-dbf2-40f6-9b7c-d97295c98019 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:21.233977 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b946c88-dbf2-40f6-9b7c-d97295c98019 None admin] PATH_INFO: `/v3/groups/9b88dce51cb24fb2b09ad4487e61997e` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:21.235094 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b946c88-dbf2-40f6-9b7c-d97295c98019 None admin] RBAC: Authorizing `identity:get_group(group_id=9b88dce51cb24fb2b09ad4487e61997e)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:21.237123 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b946c88-dbf2-40f6-9b7c-d97295c98019 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:21.240055 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 190/370] 10.222.0.60 () {56 vars in 1180 bytes} [Tue Aug 30 01:16:21 2022] GET /identity/v3/groups/9b88dce51cb24fb2b09ad4487e61997e => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:21.241406 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b946c88-dbf2-40f6-9b7c-d97295c98019 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:21.273636 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:21.287391 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:21.326767 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad6c47-ea71-412e-b7c3-8c74ce0ba834 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:21.378920 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ee2d05-52dd-4921-9119-a5e52ad62bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:21.379563 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee2d05-52dd-4921-9119-a5e52ad62bde None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:21.379844 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee2d05-52dd-4921-9119-a5e52ad62bde None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:21.380115 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee2d05-52dd-4921-9119-a5e52ad62bde None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:21.390734 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b946c88-dbf2-40f6-9b7c-d97295c98019 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:21.427981 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8caa884-ee42-4c32-92c5-cae80926a737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:21.428914 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8caa884-ee42-4c32-92c5-cae80926a737 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:21.429414 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8caa884-ee42-4c32-92c5-cae80926a737 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:21.429936 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8caa884-ee42-4c32-92c5-cae80926a737 None admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:21.430819 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8caa884-ee42-4c32-92c5-cae80926a737 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:21.431357 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8caa884-ee42-4c32-92c5-cae80926a737 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:21.432965 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8caa884-ee42-4c32-92c5-cae80926a737 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:21.442587 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 191/371] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 30 01:16:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:21.443921 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8caa884-ee42-4c32-92c5-cae80926a737 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:21.460224 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ee2d05-52dd-4921-9119-a5e52ad62bde None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:21.461718 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ee2d05-52dd-4921-9119-a5e52ad62bde None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:21.528457 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:21.542138 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:21.559195 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8caa884-ee42-4c32-92c5-cae80926a737 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:21.569125 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 181/372] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 30 01:16:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:21.570156 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ee2d05-52dd-4921-9119-a5e52ad62bde None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:21.607600 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654f7a18-7bb3-43fd-a5a7-f8a9992b8afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:21.608295 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f7a18-7bb3-43fd-a5a7-f8a9992b8afc None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:21.608671 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f7a18-7bb3-43fd-a5a7-f8a9992b8afc None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:21.609600 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f7a18-7bb3-43fd-a5a7-f8a9992b8afc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:21.609868 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654f7a18-7bb3-43fd-a5a7-f8a9992b8afc None admin] RBAC: Adding query filter params (group.id=9b88dce51cb24fb2b09ad4487e61997e, role.id=5b38bd827c5847969c4ee48e27261f5b, scope.project.id=32242e96e74d4bc797430f115ced8a19) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:21.610284 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654f7a18-7bb3-43fd-a5a7-f8a9992b8afc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:21.611850 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654f7a18-7bb3-43fd-a5a7-f8a9992b8afc None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:21.618532 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 192/373] 10.222.0.60 () {56 vars in 1376 bytes} [Tue Aug 30 01:16:21 2022] GET /identity/v3/role_assignments?group.id=9b88dce51cb24fb2b09ad4487e61997e&scope.project.id=32242e96e74d4bc797430f115ced8a19&role.id=5b38bd827c5847969c4ee48e27261f5b => generated 260 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:21.619552 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654f7a18-7bb3-43fd-a5a7-f8a9992b8afc None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:21.708642 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ee2d05-52dd-4921-9119-a5e52ad62bde None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:21.738971 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654f7a18-7bb3-43fd-a5a7-f8a9992b8afc None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:21.749349 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b4c3c-e570-4af9-b3ab-84ecf7643177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:21.750215 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b4c3c-e570-4af9-b3ab-84ecf7643177 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:21.750701 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b4c3c-e570-4af9-b3ab-84ecf7643177 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:21.751148 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b4c3c-e570-4af9-b3ab-84ecf7643177 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:21.779008 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7196de2-8dea-43b6-ad9a-4c2919e80246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:21.779788 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7196de2-8dea-43b6-ad9a-4c2919e80246 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:21.780133 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7196de2-8dea-43b6-ad9a-4c2919e80246 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:21.780466 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7196de2-8dea-43b6-ad9a-4c2919e80246 None admin] PATH_INFO: `/v3/projects/32242e96e74d4bc797430f115ced8a19` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:21.781711 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7196de2-8dea-43b6-ad9a-4c2919e80246 None admin] RBAC: Authorizing `identity:get_project(project_id=32242e96e74d4bc797430f115ced8a19)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:21.783213 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7196de2-8dea-43b6-ad9a-4c2919e80246 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:21.785482 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 193/374] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 30 01:16:21 2022] GET /identity/v3/projects/32242e96e74d4bc797430f115ced8a19 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:21.791570 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7196de2-8dea-43b6-ad9a-4c2919e80246 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:21.805286 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:21.812816 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:21.844454 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01b4c3c-e570-4af9-b3ab-84ecf7643177 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:21.846844 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01b4c3c-e570-4af9-b3ab-84ecf7643177 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:21.935016 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7196de2-8dea-43b6-ad9a-4c2919e80246 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:21.981722 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3d818-20f4-44dc-a0a0-e990ad3668ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:21.982895 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3d818-20f4-44dc-a0a0-e990ad3668ad None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:21.983976 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3d818-20f4-44dc-a0a0-e990ad3668ad None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:21.984606 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3d818-20f4-44dc-a0a0-e990ad3668ad None admin] PATH_INFO: `/v3/groups/9b88dce51cb24fb2b09ad4487e61997e` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:21.987697 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 182/375] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 30 01:16:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:21.989077 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea3d818-20f4-44dc-a0a0-e990ad3668ad None admin] RBAC: Authorizing `identity:get_group(group_id=9b88dce51cb24fb2b09ad4487e61997e)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:21.990536 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea3d818-20f4-44dc-a0a0-e990ad3668ad None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:21.992345 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 194/376] 10.222.0.60 () {56 vars in 1180 bytes} [Tue Aug 30 01:16:21 2022] GET /identity/v3/groups/9b88dce51cb24fb2b09ad4487e61997e => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:16:21.998037 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3d818-20f4-44dc-a0a0-e990ad3668ad None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:21.998386 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b4c3c-e570-4af9-b3ab-84ecf7643177 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:22.099883 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:22.100379 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:22.134893 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3d818-20f4-44dc-a0a0-e990ad3668ad None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:22.148316 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b4c3c-e570-4af9-b3ab-84ecf7643177 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:22.203309 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b01034-6238-424c-ae39-638bb21555c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:22.203981 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b01034-6238-424c-ae39-638bb21555c8 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:22.204256 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b01034-6238-424c-ae39-638bb21555c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:22.204526 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b01034-6238-424c-ae39-638bb21555c8 None admin] PATH_INFO: `/v3/projects/9a06ede3df8449d487fb53c388e91ca5` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:22.208858 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b01034-6238-424c-ae39-638bb21555c8 None admin] RBAC: Authorizing `identity:get_project(project_id=9a06ede3df8449d487fb53c388e91ca5)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:22.210315 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b01034-6238-424c-ae39-638bb21555c8 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:22.212031 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 195/377] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 30 01:16:21 2022] GET /identity/v3/projects/9a06ede3df8449d487fb53c388e91ca5 => generated 344 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:22.213440 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c9058b-f95e-4cec-a906-aabbd527a504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:22.214065 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9058b-f95e-4cec-a906-aabbd527a504 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:22.214343 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9058b-f95e-4cec-a906-aabbd527a504 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:22.214611 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9058b-f95e-4cec-a906-aabbd527a504 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:22.215633 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c9058b-f95e-4cec-a906-aabbd527a504 None admin] RBAC: Adding query filter params (group.id=9b88dce51cb24fb2b09ad4487e61997e, role.id=449624f20ef248ef97aeceba5b22eccd, scope.project.id=32242e96e74d4bc797430f115ced8a19) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:22.215941 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c9058b-f95e-4cec-a906-aabbd527a504 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:22.217375 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c9058b-f95e-4cec-a906-aabbd527a504 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:22.220191 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b01034-6238-424c-ae39-638bb21555c8 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:22.234236 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 183/378] 10.222.0.60 () {56 vars in 1376 bytes} [Tue Aug 30 01:16:21 2022] GET /identity/v3/role_assignments?group.id=9b88dce51cb24fb2b09ad4487e61997e&scope.project.id=32242e96e74d4bc797430f115ced8a19&role.id=449624f20ef248ef97aeceba5b22eccd => generated 260 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:22.412494 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b01034-6238-424c-ae39-638bb21555c8 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:22.474993 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d66e98a-6b1a-42d4-b047-dc07a85e1251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:22.475684 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66e98a-6b1a-42d4-b047-dc07a85e1251 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:22.475959 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66e98a-6b1a-42d4-b047-dc07a85e1251 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:22.476229 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66e98a-6b1a-42d4-b047-dc07a85e1251 None admin] PATH_INFO: `/v3/groups/b152cf09f00641fcbf63855b200c0117` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:22.488635 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d66e98a-6b1a-42d4-b047-dc07a85e1251 None admin] RBAC: Authorizing `identity:get_group(group_id=b152cf09f00641fcbf63855b200c0117)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:22.490048 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d66e98a-6b1a-42d4-b047-dc07a85e1251 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:22.492291 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 196/379] 10.222.0.60 () {56 vars in 1180 bytes} [Tue Aug 30 01:16:22 2022] GET /identity/v3/groups/b152cf09f00641fcbf63855b200c0117 => generated 229 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:22.501779 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c9058b-f95e-4cec-a906-aabbd527a504 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:22.786634 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c9058b-f95e-4cec-a906-aabbd527a504 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:22.812802 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157cdbe2-4149-490b-8c30-6c7e15dadb7e None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:22.813557 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157cdbe2-4149-490b-8c30-6c7e15dadb7e None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:22.813557 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157cdbe2-4149-490b-8c30-6c7e15dadb7e None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:22.814876 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 197/380] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:16:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:16:22.820532 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa375d-68f1-4358-a501-1e074cca1dfd None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:22.820821 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa375d-68f1-4358-a501-1e074cca1dfd None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:22.821082 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa375d-68f1-4358-a501-1e074cca1dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:22.839149 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:22.851659 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-b5aa375d-68f1-4358-a501-1e074cca1dfd None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:22.852849 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-b5aa375d-68f1-4358-a501-1e074cca1dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:22.867238 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab66240-9725-4bdf-abbe-02805a463a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:22.867870 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab66240-9725-4bdf-abbe-02805a463a36 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:22.868145 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab66240-9725-4bdf-abbe-02805a463a36 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:22.868411 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab66240-9725-4bdf-abbe-02805a463a36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:22.869129 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab66240-9725-4bdf-abbe-02805a463a36 None admin] RBAC: Adding query filter params (group.id=b152cf09f00641fcbf63855b200c0117, role.id=f6bc03b6972e420eb338ee7fd1443974, scope.project.id=9a06ede3df8449d487fb53c388e91ca5) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:22.869432 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab66240-9725-4bdf-abbe-02805a463a36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:22.870872 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab66240-9725-4bdf-abbe-02805a463a36 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:22.876525 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 184/381] 10.222.0.60 () {56 vars in 1376 bytes} [Tue Aug 30 01:16:22 2022] GET /identity/v3/role_assignments?group.id=b152cf09f00641fcbf63855b200c0117&scope.project.id=9a06ede3df8449d487fb53c388e91ca5&role.id=f6bc03b6972e420eb338ee7fd1443974 => generated 260 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:23.012203 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 198/382] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:16:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 01:16:23.402723 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab66240-9725-4bdf-abbe-02805a463a36 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:23.413176 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:23.615975 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f929c-d068-45be-abe8-cde7a6119b22 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:23.616385 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f929c-d068-45be-abe8-cde7a6119b22 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:23.616627 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f929c-d068-45be-abe8-cde7a6119b22 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:23.618164 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 199/383] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:16:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:16:23.624064 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4b475-7810-4780-97d5-4720cef0b299 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:23.624370 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4b475-7810-4780-97d5-4720cef0b299 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:23.624615 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4b475-7810-4780-97d5-4720cef0b299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:23.635814 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab66240-9725-4bdf-abbe-02805a463a36 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:23.660205 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-3de4b475-7810-4780-97d5-4720cef0b299 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:23.660205 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-3de4b475-7810-4780-97d5-4720cef0b299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:23.686075 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bab295c-1a6d-4502-90bb-45d1addf4957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:23.686702 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab295c-1a6d-4502-90bb-45d1addf4957 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:23.686976 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab295c-1a6d-4502-90bb-45d1addf4957 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:23.687243 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab295c-1a6d-4502-90bb-45d1addf4957 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:23.698101 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bab295c-1a6d-4502-90bb-45d1addf4957 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:16:23.703658 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-8bab295c-1a6d-4502-90bb-45d1addf4957 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 01:16:23.703658 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:23.703658 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:23.703658 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:23.703658 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:23.703658 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:23.703658 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:23.703658 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:23.703658 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:23.703658 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:23.703658 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:23.703658 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:23.703658 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:16:23.703658 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:16:23.703658 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:16:23.703658 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:16:23.704550 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:16:23.704550 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:16:23.704550 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:16:23.704550 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:16:23.704550 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:23.704550 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:23.704550 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:23.704550 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:23.704550 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:23.704550 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:23.704550 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:23.704550 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:23.704550 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:23.704550 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:23.704550 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:23.704550 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:23.705360 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:23.705360 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:23.705360 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:23.705360 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:23.705360 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:16:23.705360 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:16:23.705360 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:16:23.705360 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:16:23.705360 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:16:23.705360 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:16:23.705360 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 01:16:23.705360 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:16:23.705360 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 185/384] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 30 01:16:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:23.712338 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bab295c-1a6d-4502-90bb-45d1addf4957 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:23.815844 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:23.819726 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 200/385] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:16:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 01:16:23.864313 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bab295c-1a6d-4502-90bb-45d1addf4957 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:23.917179 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c544cf-5de8-4841-8e41-11159c53e904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:23.917897 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c544cf-5de8-4841-8e41-11159c53e904 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:23.918177 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c544cf-5de8-4841-8e41-11159c53e904 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:23.918449 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c544cf-5de8-4841-8e41-11159c53e904 None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:23.919108 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c544cf-5de8-4841-8e41-11159c53e904 None admin] RBAC: Adding query filter params (name=member) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:23.919410 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c544cf-5de8-4841-8e41-11159c53e904 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:23.920831 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c544cf-5de8-4841-8e41-11159c53e904 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:23.931231 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 186/386] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Aug 30 01:16:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:23.936992 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de4b475-7810-4780-97d5-4720cef0b299 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:24.067847 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:24.099181 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de4b475-7810-4780-97d5-4720cef0b299 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:24.135107 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4e48bd-365f-4721-9042-8515b7c6bcde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:24.135785 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e48bd-365f-4721-9042-8515b7c6bcde None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:24.136066 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e48bd-365f-4721-9042-8515b7c6bcde None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:24.136338 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e48bd-365f-4721-9042-8515b7c6bcde None admin] PATH_INFO: `/v3/groups/9b88dce51cb24fb2b09ad4487e61997e` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:24.137450 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4e48bd-365f-4721-9042-8515b7c6bcde None admin] RBAC: Authorizing `identity:get_group(group_id=9b88dce51cb24fb2b09ad4487e61997e)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:24.138898 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4e48bd-365f-4721-9042-8515b7c6bcde None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:24.140852 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 201/387] 10.222.0.60 () {56 vars in 1180 bytes} [Tue Aug 30 01:16:23 2022] GET /identity/v3/groups/9b88dce51cb24fb2b09ad4487e61997e => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:24.146268 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c544cf-5de8-4841-8e41-11159c53e904 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:24.294151 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4e48bd-365f-4721-9042-8515b7c6bcde None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:24.338968 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c544cf-5de8-4841-8e41-11159c53e904 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:24.387205 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:24.404869 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfad27e-6476-4b2d-85b0-991a0204d7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:24.406647 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfad27e-6476-4b2d-85b0-991a0204d7fe None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:24.406928 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfad27e-6476-4b2d-85b0-991a0204d7fe None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:24.407198 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfad27e-6476-4b2d-85b0-991a0204d7fe None admin] PATH_INFO: `/v3/projects/023703a6c5664626b371621981c1b1ba` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:24.409403 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfad27e-6476-4b2d-85b0-991a0204d7fe None admin] RBAC: Authorizing `identity:get_project(project_id=023703a6c5664626b371621981c1b1ba)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:24.411872 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfad27e-6476-4b2d-85b0-991a0204d7fe None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:24.413685 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 187/388] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 30 01:16:24 2022] GET /identity/v3/projects/023703a6c5664626b371621981c1b1ba => generated 298 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:24.420275 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfad27e-6476-4b2d-85b0-991a0204d7fe None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:24.453381 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4e48bd-365f-4721-9042-8515b7c6bcde None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:24.518798 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc95b40-3aa7-4d99-ac5d-f8468ee46379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:24.519487 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc95b40-3aa7-4d99-ac5d-f8468ee46379 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:24.519773 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc95b40-3aa7-4d99-ac5d-f8468ee46379 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:24.520151 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc95b40-3aa7-4d99-ac5d-f8468ee46379 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:24.521999 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:24.533068 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc95b40-3aa7-4d99-ac5d-f8468ee46379 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:16:24.536041 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfad27e-6476-4b2d-85b0-991a0204d7fe None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:24.539165 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-3bc95b40-3aa7-4d99-ac5d-f8468ee46379 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 01:16:24.539165 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:24.539165 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:24.539165 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:24.539165 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:24.539165 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:24.539165 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:24.539165 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:24.539165 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:24.539165 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:24.539165 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:24.539165 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:24.539165 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:16:24.539165 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:16:24.539165 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:16:24.539165 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:16:24.540144 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:16:24.540144 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:16:24.540144 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:16:24.540144 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:16:24.540144 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:24.540144 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:24.540144 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:24.540144 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:24.540144 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:24.540144 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:24.540144 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:24.540144 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:24.540144 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:24.540144 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:24.540144 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:24.540144 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:24.540967 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:24.540967 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:24.540967 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:24.540967 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:24.540967 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:16:24.540967 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:16:24.540967 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:16:24.540967 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:16:24.540967 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:16:24.540967 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:16:24.540967 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 01:16:24.540967 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:16:24.540967 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 202/389] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Aug 30 01:16:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:16:24.542110 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d041a1-5dc4-4ee0-a851-102a4904d838 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:24.542110 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d041a1-5dc4-4ee0-a851-102a4904d838 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:24.542409 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d041a1-5dc4-4ee0-a851-102a4904d838 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:24.543890 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 203/390] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:16:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:16:24.548597 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d041a1-5dc4-4ee0-a851-102a4904d838 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:24.585864 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57b87e7-7c8e-4266-a6a7-a9c7228b4ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:24.586718 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b87e7-7c8e-4266-a6a7-a9c7228b4ddf None admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:24.587000 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b87e7-7c8e-4266-a6a7-a9c7228b4ddf None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:24.591825 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b87e7-7c8e-4266-a6a7-a9c7228b4ddf None admin] PATH_INFO: `/v3/projects/023703a6c5664626b371621981c1b1ba/groups/9b88dce51cb24fb2b09ad4487e61997e/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:24.602977 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57b87e7-7c8e-4266-a6a7-a9c7228b4ddf None admin] RBAC: Authorizing `identity:create_grant(project_id=023703a6c5664626b371621981c1b1ba, group_id=9b88dce51cb24fb2b09ad4487e61997e, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:24.604548 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57b87e7-7c8e-4266-a6a7-a9c7228b4ddf None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:24.622220 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 188/391] 10.222.0.60 () {58 vars in 1442 bytes} [Tue Aug 30 01:16:24 2022] PUT /identity/v3/projects/023703a6c5664626b371621981c1b1ba/groups/9b88dce51cb24fb2b09ad4487e61997e/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:16:24.623713 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc759fc-ab80-4490-96f9-88a9bb4f1d60 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:24.624048 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc759fc-ab80-4490-96f9-88a9bb4f1d60 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:24.624331 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc759fc-ab80-4490-96f9-88a9bb4f1d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:24.644842 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-bcc759fc-ab80-4490-96f9-88a9bb4f1d60 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:24.646184 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-bcc759fc-ab80-4490-96f9-88a9bb4f1d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:24.689428 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d041a1-5dc4-4ee0-a851-102a4904d838 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:24.702436 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:24.725133 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 189/392] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:16:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:16:24.744250 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe391310-26fc-40e9-8821-69f21b847f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:24.745189 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe391310-26fc-40e9-8821-69f21b847f84 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:24.745636 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe391310-26fc-40e9-8821-69f21b847f84 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:24.746086 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe391310-26fc-40e9-8821-69f21b847f84 None admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:24.746928 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe391310-26fc-40e9-8821-69f21b847f84 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:24.747379 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe391310-26fc-40e9-8821-69f21b847f84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:24.749089 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe391310-26fc-40e9-8821-69f21b847f84 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:24.764165 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 204/393] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 30 01:16:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:24.770501 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc759fc-ab80-4490-96f9-88a9bb4f1d60 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:24.898459 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc759fc-ab80-4490-96f9-88a9bb4f1d60 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:24.940661 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb96e4e0-17a0-4c90-b061-a40d42311497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:24.941894 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96e4e0-17a0-4c90-b061-a40d42311497 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:24.942171 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96e4e0-17a0-4c90-b061-a40d42311497 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:24.942492 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96e4e0-17a0-4c90-b061-a40d42311497 None admin] PATH_INFO: `/v3/groups/9b88dce51cb24fb2b09ad4487e61997e` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:24.944403 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb96e4e0-17a0-4c90-b061-a40d42311497 None admin] RBAC: Authorizing `identity:get_group(group_id=9b88dce51cb24fb2b09ad4487e61997e)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:24.945983 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb96e4e0-17a0-4c90-b061-a40d42311497 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:24.947976 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 190/394] 10.222.0.60 () {56 vars in 1180 bytes} [Tue Aug 30 01:16:24 2022] GET /identity/v3/groups/9b88dce51cb24fb2b09ad4487e61997e => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:24.953593 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe391310-26fc-40e9-8821-69f21b847f84 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:25.040429 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:25.090528 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb96e4e0-17a0-4c90-b061-a40d42311497 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:25.102530 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe391310-26fc-40e9-8821-69f21b847f84 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:25.147617 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d2c4c3-e510-40e0-af2d-0bd1a0ab2ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:25.148667 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d2c4c3-e510-40e0-af2d-0bd1a0ab2ccb None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:25.149179 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d2c4c3-e510-40e0-af2d-0bd1a0ab2ccb None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:25.149616 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d2c4c3-e510-40e0-af2d-0bd1a0ab2ccb None admin] PATH_INFO: `/v3/projects/023703a6c5664626b371621981c1b1ba` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:25.150963 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d2c4c3-e510-40e0-af2d-0bd1a0ab2ccb None admin] RBAC: Authorizing `identity:get_project(project_id=023703a6c5664626b371621981c1b1ba)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:25.152639 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d2c4c3-e510-40e0-af2d-0bd1a0ab2ccb None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:25.154661 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 205/395] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 30 01:16:24 2022] GET /identity/v3/projects/023703a6c5664626b371621981c1b1ba => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:25.156272 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0022c4-fdb5-4a8c-8580-59e07577929d None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:25.156758 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0022c4-fdb5-4a8c-8580-59e07577929d None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:25.157219 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0022c4-fdb5-4a8c-8580-59e07577929d None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:25.158888 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 206/396] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:16:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:16:25.159003 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:25.160900 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0022c4-fdb5-4a8c-8580-59e07577929d None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:25.221760 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb96e4e0-17a0-4c90-b061-a40d42311497 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:25.265330 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a34ba60-d062-4c29-a171-435cdf6b4211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:25.266544 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34ba60-d062-4c29-a171-435cdf6b4211 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:25.267237 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34ba60-d062-4c29-a171-435cdf6b4211 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:25.267694 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34ba60-d062-4c29-a171-435cdf6b4211 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:25.276492 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0022c4-fdb5-4a8c-8580-59e07577929d None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:25.288558 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a34ba60-d062-4c29-a171-435cdf6b4211 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:16:25.295632 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-0a34ba60-d062-4c29-a171-435cdf6b4211 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 01:16:25.295632 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:25.295632 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:25.295632 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:25.295632 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:25.295632 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:25.295632 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:25.295632 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:25.295632 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:25.295632 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:25.295632 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:25.295632 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:25.295632 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:16:25.295632 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:16:25.295632 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:16:25.295632 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:16:25.296750 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:16:25.296750 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:16:25.296750 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:16:25.296750 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:16:25.296750 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:25.296750 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:25.296750 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:25.296750 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:25.296750 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:25.296750 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:25.296750 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:25.296750 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:25.296750 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:25.296750 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:25.296750 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:25.296750 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:25.297816 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:25.297816 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:25.297816 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:25.297816 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:25.297816 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:16:25.297816 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:16:25.297816 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:16:25.297816 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:16:25.297816 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:16:25.297816 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:16:25.297816 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 01:16:25.297816 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:16:25.305733 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 191/397] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 30 01:16:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:16:25.305733 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92519e3-a3b6-4fd4-817a-1baab506e4c3 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:25.305733 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92519e3-a3b6-4fd4-817a-1baab506e4c3 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:25.305733 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92519e3-a3b6-4fd4-817a-1baab506e4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:25.311320 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:25.326999 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf0537-42df-47d6-a9ba-3a0d9f7478a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:25.327415 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-c92519e3-a3b6-4fd4-817a-1baab506e4c3 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:25.327703 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf0537-42df-47d6-a9ba-3a0d9f7478a2 None admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:25.327976 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf0537-42df-47d6-a9ba-3a0d9f7478a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:25.328242 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf0537-42df-47d6-a9ba-3a0d9f7478a2 None admin] PATH_INFO: `/v3/projects/023703a6c5664626b371621981c1b1ba/groups/9b88dce51cb24fb2b09ad4487e61997e/roles/449624f20ef248ef97aeceba5b22eccd` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:25.329652 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-c92519e3-a3b6-4fd4-817a-1baab506e4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:25.330355 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daf0537-42df-47d6-a9ba-3a0d9f7478a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=023703a6c5664626b371621981c1b1ba, group_id=9b88dce51cb24fb2b09ad4487e61997e, role_id=449624f20ef248ef97aeceba5b22eccd)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:25.332349 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daf0537-42df-47d6-a9ba-3a0d9f7478a2 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:25.350987 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 207/398] 10.222.0.60 () {58 vars in 1442 bytes} [Tue Aug 30 01:16:25 2022] PUT /identity/v3/projects/023703a6c5664626b371621981c1b1ba/groups/9b88dce51cb24fb2b09ad4487e61997e/roles/449624f20ef248ef97aeceba5b22eccd => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:16:25.352030 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf0537-42df-47d6-a9ba-3a0d9f7478a2 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:25.410974 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 192/399] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:16:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:16:25.412975 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa1d1a-9dbc-4c39-9762-c2b0b6bdbab6 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:25.413495 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa1d1a-9dbc-4c39-9762-c2b0b6bdbab6 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:25.414034 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa1d1a-9dbc-4c39-9762-c2b0b6bdbab6 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:25.416181 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 193/400] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:16:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:16:25.421294 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87be90-2ee9-4367-b3c8-d1ef91a7866a None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:25.423035 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87be90-2ee9-4367-b3c8-d1ef91a7866a None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:25.424183 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87be90-2ee9-4367-b3c8-d1ef91a7866a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:25.460596 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-5f87be90-2ee9-4367-b3c8-d1ef91a7866a None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:25.464541 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-5f87be90-2ee9-4367-b3c8-d1ef91a7866a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:25.523412 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf0537-42df-47d6-a9ba-3a0d9f7478a2 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:25.533342 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:25.567067 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f6816-de94-4692-8c73-73d25719ac4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:25.567703 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f6816-de94-4692-8c73-73d25719ac4b None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:25.567969 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f6816-de94-4692-8c73-73d25719ac4b None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:25.568238 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f6816-de94-4692-8c73-73d25719ac4b None admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:25.568905 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800f6816-de94-4692-8c73-73d25719ac4b None admin] RBAC: Adding query filter params (name=member) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:25.569221 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800f6816-de94-4692-8c73-73d25719ac4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:25.570575 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800f6816-de94-4692-8c73-73d25719ac4b None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:25.572896 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 194/401] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:16:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:16:25.581723 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 208/402] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Aug 30 01:16:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:25.592743 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f87be90-2ee9-4367-b3c8-d1ef91a7866a None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:25.703367 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f6816-de94-4692-8c73-73d25719ac4b None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:25.703957 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f87be90-2ee9-4367-b3c8-d1ef91a7866a None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:25.742018 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b5922-7deb-4383-890e-70c62d459f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:25.742912 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b5922-7deb-4383-890e-70c62d459f4f None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:25.743350 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b5922-7deb-4383-890e-70c62d459f4f None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:25.743792 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b5922-7deb-4383-890e-70c62d459f4f None admin] PATH_INFO: `/v3/groups/9b88dce51cb24fb2b09ad4487e61997e` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:25.745159 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6b5922-7deb-4383-890e-70c62d459f4f None admin] RBAC: Authorizing `identity:get_group(group_id=9b88dce51cb24fb2b09ad4487e61997e)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:25.746754 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6b5922-7deb-4383-890e-70c62d459f4f None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:25.753060 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 195/403] 10.222.0.60 () {56 vars in 1180 bytes} [Tue Aug 30 01:16:25 2022] GET /identity/v3/groups/9b88dce51cb24fb2b09ad4487e61997e => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:25.754927 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b5922-7deb-4383-890e-70c62d459f4f None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:25.799681 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:25.812560 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:25.865898 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b5922-7deb-4383-890e-70c62d459f4f None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:25.903029 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee8731-6d74-459d-8409-ab38995ba447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:25.904483 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee8731-6d74-459d-8409-ab38995ba447 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:25.904910 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee8731-6d74-459d-8409-ab38995ba447 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:25.905320 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee8731-6d74-459d-8409-ab38995ba447 None admin] PATH_INFO: `/v3/projects/32242e96e74d4bc797430f115ced8a19` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:25.906636 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ee8731-6d74-459d-8409-ab38995ba447 None admin] RBAC: Authorizing `identity:get_project(project_id=32242e96e74d4bc797430f115ced8a19)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:25.908396 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ee8731-6d74-459d-8409-ab38995ba447 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:25.915557 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f6816-de94-4692-8c73-73d25719ac4b None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:25.915906 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 196/404] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 30 01:16:25 2022] GET /identity/v3/projects/32242e96e74d4bc797430f115ced8a19 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:16:25.917018 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee8731-6d74-459d-8409-ab38995ba447 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:25.952191 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c0198d-8b60-47b9-88a2-9704ec8514fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:25.952906 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0198d-8b60-47b9-88a2-9704ec8514fe None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:25.953280 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0198d-8b60-47b9-88a2-9704ec8514fe None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:25.953705 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0198d-8b60-47b9-88a2-9704ec8514fe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:25.964821 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c0198d-8b60-47b9-88a2-9704ec8514fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:16:25.971080 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-39c0198d-8b60-47b9-88a2-9704ec8514fe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 01:16:25.971080 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:25.971080 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:25.971080 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:25.971080 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:25.971080 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:25.971080 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:25.971080 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:25.971080 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:25.971080 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:25.971080 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:25.971080 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:25.971080 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:16:25.971080 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:16:25.971080 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:16:25.971080 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:16:25.972240 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:16:25.972240 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:16:25.972240 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:16:25.972240 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:16:25.972240 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:25.972240 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:25.972240 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:25.972240 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:25.972240 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:25.972240 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:25.972240 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:25.972240 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:25.972240 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:25.972240 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:25.972240 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:25.972240 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:25.973226 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:25.973226 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:25.973226 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:25.973226 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:25.973226 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:16:25.973226 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:16:25.973226 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:16:25.973226 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:16:25.973226 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:16:25.973226 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:16:25.973226 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 01:16:25.973226 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:16:25.975247 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 209/405] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Aug 30 01:16:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:16:25.976276 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c0198d-8b60-47b9-88a2-9704ec8514fe None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:26.033197 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee8731-6d74-459d-8409-ab38995ba447 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:26.044187 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:26.071392 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c0c49a-dc26-40b3-8210-4248f023c6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:26.072349 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c0c49a-dc26-40b3-8210-4248f023c6ea None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:26.072478 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c0c49a-dc26-40b3-8210-4248f023c6ea None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:26.072703 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c0c49a-dc26-40b3-8210-4248f023c6ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:26.084409 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c0c49a-dc26-40b3-8210-4248f023c6ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:16:26.089047 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c0198d-8b60-47b9-88a2-9704ec8514fe None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:26.089706 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-19c0c49a-dc26-40b3-8210-4248f023c6ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:16:26.089706 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:26.089706 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:26.089706 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:26.089706 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:26.089706 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:26.089706 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:26.089706 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:26.089706 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:26.089706 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:26.089706 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:26.089706 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:26.089706 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:16:26.089706 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:16:26.089706 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:16:26.089706 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:16:26.090869 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:16:26.090869 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:16:26.090869 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:16:26.090869 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:16:26.090869 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:26.090869 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:26.090869 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:26.090869 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:26.090869 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:26.090869 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:26.090869 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:26.090869 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:26.090869 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:26.090869 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:26.090869 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:26.090869 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:26.091691 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:26.091691 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:26.091691 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:26.091691 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:26.091691 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:16:26.091691 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:16:26.091691 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:16:26.091691 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:16:26.091691 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:16:26.091691 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:16:26.091691 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:16:26.091691 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:16:26.091691 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 197/406] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 30 01:16:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:26.092349 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c0c49a-dc26-40b3-8210-4248f023c6ea None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:26.105245 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:26.136576 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1184b166-21b9-42cc-b4f5-e93d0670dc4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:26.137399 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1184b166-21b9-42cc-b4f5-e93d0670dc4d None admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:26.137773 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1184b166-21b9-42cc-b4f5-e93d0670dc4d None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:26.138357 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1184b166-21b9-42cc-b4f5-e93d0670dc4d None admin] PATH_INFO: `/v3/projects/32242e96e74d4bc797430f115ced8a19/groups/9b88dce51cb24fb2b09ad4487e61997e/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:26.140453 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1184b166-21b9-42cc-b4f5-e93d0670dc4d None admin] RBAC: Authorizing `identity:create_grant(project_id=32242e96e74d4bc797430f115ced8a19, group_id=9b88dce51cb24fb2b09ad4487e61997e, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:26.141718 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1184b166-21b9-42cc-b4f5-e93d0670dc4d None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:26.167472 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 210/407] 10.222.0.60 () {58 vars in 1442 bytes} [Tue Aug 30 01:16:25 2022] PUT /identity/v3/projects/32242e96e74d4bc797430f115ced8a19/groups/9b88dce51cb24fb2b09ad4487e61997e/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:16:26.167472 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1184b166-21b9-42cc-b4f5-e93d0670dc4d None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:26.231975 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c0c49a-dc26-40b3-8210-4248f023c6ea None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:26.277371 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34126ad-87b2-468c-bca9-a1930f67b391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:26.278012 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34126ad-87b2-468c-bca9-a1930f67b391 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:26.278298 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34126ad-87b2-468c-bca9-a1930f67b391 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:26.278630 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34126ad-87b2-468c-bca9-a1930f67b391 None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:26.279426 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34126ad-87b2-468c-bca9-a1930f67b391 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:26.279763 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34126ad-87b2-468c-bca9-a1930f67b391 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:26.281185 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34126ad-87b2-468c-bca9-a1930f67b391 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:26.291825 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 198/408] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 30 01:16:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:26.299160 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34126ad-87b2-468c-bca9-a1930f67b391 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:26.337535 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:26.386073 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1184b166-21b9-42cc-b4f5-e93d0670dc4d None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:26.431331 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06432885-553d-4edb-837c-d65593f6fb33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:26.432796 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06432885-553d-4edb-837c-d65593f6fb33 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:26.433160 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06432885-553d-4edb-837c-d65593f6fb33 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:26.433514 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06432885-553d-4edb-837c-d65593f6fb33 None admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:26.434323 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06432885-553d-4edb-837c-d65593f6fb33 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:26.434435 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34126ad-87b2-468c-bca9-a1930f67b391 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:26.434764 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06432885-553d-4edb-837c-d65593f6fb33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:26.436272 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06432885-553d-4edb-837c-d65593f6fb33 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:26.448395 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 211/409] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 30 01:16:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:26.453462 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06432885-553d-4edb-837c-d65593f6fb33 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:26.488539 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5825ced6-30ea-4e4e-b90b-906e64f329c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:26.489088 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825ced6-30ea-4e4e-b90b-906e64f329c2 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:26.489360 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825ced6-30ea-4e4e-b90b-906e64f329c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:26.489628 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825ced6-30ea-4e4e-b90b-906e64f329c2 None admin] PATH_INFO: `/v3/groups/9b88dce51cb24fb2b09ad4487e61997e` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:26.493544 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5825ced6-30ea-4e4e-b90b-906e64f329c2 None admin] RBAC: Authorizing `identity:get_group(group_id=9b88dce51cb24fb2b09ad4487e61997e)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:26.495064 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5825ced6-30ea-4e4e-b90b-906e64f329c2 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:26.497922 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 199/410] 10.222.0.60 () {56 vars in 1180 bytes} [Tue Aug 30 01:16:26 2022] GET /identity/v3/groups/9b88dce51cb24fb2b09ad4487e61997e => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:16:26.504275 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5825ced6-30ea-4e4e-b90b-906e64f329c2 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:26.515813 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:26.652625 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06432885-553d-4edb-837c-d65593f6fb33 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:26.687231 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:26.695188 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5825ced6-30ea-4e4e-b90b-906e64f329c2 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:26.726101 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd7edfc-46c1-434b-9064-ee58695b4a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:26.726744 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7edfc-46c1-434b-9064-ee58695b4a06 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:26.727021 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7edfc-46c1-434b-9064-ee58695b4a06 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:26.727292 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7edfc-46c1-434b-9064-ee58695b4a06 None admin] PATH_INFO: `/v3/groups/b152cf09f00641fcbf63855b200c0117` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:26.728604 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd7edfc-46c1-434b-9064-ee58695b4a06 None admin] RBAC: Authorizing `identity:get_group(group_id=b152cf09f00641fcbf63855b200c0117)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:26.731221 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd7edfc-46c1-434b-9064-ee58695b4a06 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:26.735459 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 212/411] 10.222.0.60 () {56 vars in 1180 bytes} [Tue Aug 30 01:16:26 2022] GET /identity/v3/groups/b152cf09f00641fcbf63855b200c0117 => generated 229 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:16:26.739321 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd7edfc-46c1-434b-9064-ee58695b4a06 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:26.757902 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e6e54b-4e3f-46e2-90df-4df430ed94a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:26.758551 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e6e54b-4e3f-46e2-90df-4df430ed94a3 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:26.758831 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e6e54b-4e3f-46e2-90df-4df430ed94a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:26.759109 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e6e54b-4e3f-46e2-90df-4df430ed94a3 None admin] PATH_INFO: `/v3/projects/32242e96e74d4bc797430f115ced8a19` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:26.760378 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e6e54b-4e3f-46e2-90df-4df430ed94a3 None admin] RBAC: Authorizing `identity:get_project(project_id=32242e96e74d4bc797430f115ced8a19)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:26.761839 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e6e54b-4e3f-46e2-90df-4df430ed94a3 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:26.764692 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 200/412] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 30 01:16:26 2022] GET /identity/v3/projects/32242e96e74d4bc797430f115ced8a19 => generated 302 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:26.770092 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e6e54b-4e3f-46e2-90df-4df430ed94a3 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:26.888243 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:26.896163 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd7edfc-46c1-434b-9064-ee58695b4a06 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:26.932932 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea55ce11-e8d8-4d73-8746-94094caf5396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:26.933570 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55ce11-e8d8-4d73-8746-94094caf5396 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:26.933854 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55ce11-e8d8-4d73-8746-94094caf5396 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:26.934129 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55ce11-e8d8-4d73-8746-94094caf5396 None admin] PATH_INFO: `/v3/projects/9a06ede3df8449d487fb53c388e91ca5` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:26.937517 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea55ce11-e8d8-4d73-8746-94094caf5396 None admin] RBAC: Authorizing `identity:get_project(project_id=9a06ede3df8449d487fb53c388e91ca5)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:26.938968 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea55ce11-e8d8-4d73-8746-94094caf5396 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:26.942271 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 213/413] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 30 01:16:26 2022] GET /identity/v3/projects/9a06ede3df8449d487fb53c388e91ca5 => generated 344 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:26.946344 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea55ce11-e8d8-4d73-8746-94094caf5396 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:27.013589 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e6e54b-4e3f-46e2-90df-4df430ed94a3 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:27.058024 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ebd119-aacc-41d7-8b94-173771932b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:27.059057 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ebd119-aacc-41d7-8b94-173771932b45 None admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:27.059636 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ebd119-aacc-41d7-8b94-173771932b45 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:27.059922 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ebd119-aacc-41d7-8b94-173771932b45 None admin] PATH_INFO: `/v3/projects/32242e96e74d4bc797430f115ced8a19/groups/9b88dce51cb24fb2b09ad4487e61997e/roles/449624f20ef248ef97aeceba5b22eccd` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:27.062554 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ebd119-aacc-41d7-8b94-173771932b45 None admin] RBAC: Authorizing `identity:create_grant(project_id=32242e96e74d4bc797430f115ced8a19, group_id=9b88dce51cb24fb2b09ad4487e61997e, role_id=449624f20ef248ef97aeceba5b22eccd)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:27.064046 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ebd119-aacc-41d7-8b94-173771932b45 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:27.078194 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea55ce11-e8d8-4d73-8746-94094caf5396 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:27.082612 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 201/414] 10.222.0.60 () {58 vars in 1442 bytes} [Tue Aug 30 01:16:26 2022] PUT /identity/v3/projects/32242e96e74d4bc797430f115ced8a19/groups/9b88dce51cb24fb2b09ad4487e61997e/roles/449624f20ef248ef97aeceba5b22eccd => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:16:27.083933 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3faaff-9e8b-402b-9505-e0bcdda5438b None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:27.084219 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3faaff-9e8b-402b-9505-e0bcdda5438b None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:27.084497 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3faaff-9e8b-402b-9505-e0bcdda5438b None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:27.086080 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 202/415] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:16:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:16:27.106973 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23207a71-863e-48c3-86ae-e00f7e544202 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:27.107322 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23207a71-863e-48c3-86ae-e00f7e544202 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:27.107566 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23207a71-863e-48c3-86ae-e00f7e544202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:27.141802 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-23207a71-863e-48c3-86ae-e00f7e544202 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:27.145698 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-23207a71-863e-48c3-86ae-e00f7e544202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:27.156864 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faad1c2-0661-43df-a873-557f742bdf14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:27.157703 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faad1c2-0661-43df-a873-557f742bdf14 None admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:27.157992 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faad1c2-0661-43df-a873-557f742bdf14 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:27.158273 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faad1c2-0661-43df-a873-557f742bdf14 None admin] PATH_INFO: `/v3/projects/9a06ede3df8449d487fb53c388e91ca5/groups/b152cf09f00641fcbf63855b200c0117/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:27.160486 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faad1c2-0661-43df-a873-557f742bdf14 None admin] RBAC: Authorizing `identity:create_grant(project_id=9a06ede3df8449d487fb53c388e91ca5, group_id=b152cf09f00641fcbf63855b200c0117, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:27.167473 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faad1c2-0661-43df-a873-557f742bdf14 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:27.182858 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 214/416] 10.222.0.60 () {58 vars in 1442 bytes} [Tue Aug 30 01:16:26 2022] PUT /identity/v3/projects/9a06ede3df8449d487fb53c388e91ca5/groups/b152cf09f00641fcbf63855b200c0117/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:16:27.196971 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:27.258136 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 203/417] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:16:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 01:16:27.555985 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faad1c2-0661-43df-a873-557f742bdf14 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:27.589990 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:27.678274 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faad1c2-0661-43df-a873-557f742bdf14 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:27.715998 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9bc42d-647e-4fef-9070-a87db9f4a88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:27.717066 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9bc42d-647e-4fef-9070-a87db9f4a88b None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:27.717401 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9bc42d-647e-4fef-9070-a87db9f4a88b None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:27.718220 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9bc42d-647e-4fef-9070-a87db9f4a88b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:27.728654 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9bc42d-647e-4fef-9070-a87db9f4a88b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:16:27.734887 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-9f9bc42d-647e-4fef-9070-a87db9f4a88b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 01:16:27.734887 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:27.734887 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:27.734887 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:27.734887 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:27.734887 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:27.734887 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:27.734887 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:27.734887 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:27.734887 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:27.734887 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:27.734887 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:27.734887 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:16:27.734887 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:16:27.734887 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:16:27.734887 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:16:27.735852 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:16:27.735852 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:16:27.735852 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:16:27.735852 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:16:27.735852 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:27.735852 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:27.735852 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:27.735852 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:27.735852 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:27.735852 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:27.735852 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:27.735852 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:27.735852 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:27.735852 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:27.735852 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:27.735852 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:27.736666 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:27.736666 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:27.736666 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:27.736666 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:27.736666 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:16:27.736666 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:16:27.736666 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:16:27.736666 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:16:27.736666 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:16:27.736666 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:16:27.736666 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 01:16:27.736666 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:16:27.736666 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 215/418] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 30 01:16:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:27.743932 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23207a71-863e-48c3-86ae-e00f7e544202 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:27.782876 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e413a5f-91ef-4316-8d45-d87c09e012cc None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:27.783339 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e413a5f-91ef-4316-8d45-d87c09e012cc None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:27.783590 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e413a5f-91ef-4316-8d45-d87c09e012cc None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:27.785197 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 216/419] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:16:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:16:27.790747 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff2d56-65ab-4f1a-a076-db5cb2900bae None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:27.790934 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff2d56-65ab-4f1a-a076-db5cb2900bae None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:27.791232 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff2d56-65ab-4f1a-a076-db5cb2900bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:27.810841 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-4bff2d56-65ab-4f1a-a076-db5cb2900bae None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:27.812032 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-4bff2d56-65ab-4f1a-a076-db5cb2900bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:27.887059 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 217/420] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:16:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 01:16:27.952791 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23207a71-863e-48c3-86ae-e00f7e544202 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:28.004323 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec98f9ed-4e0c-4a3a-8f9e-9b1a00d1183d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:28.005306 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec98f9ed-4e0c-4a3a-8f9e-9b1a00d1183d None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:28.005789 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec98f9ed-4e0c-4a3a-8f9e-9b1a00d1183d None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:28.006264 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec98f9ed-4e0c-4a3a-8f9e-9b1a00d1183d None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:28.007193 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec98f9ed-4e0c-4a3a-8f9e-9b1a00d1183d None admin] RBAC: Adding query filter params (name=member) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:28.011778 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec98f9ed-4e0c-4a3a-8f9e-9b1a00d1183d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:28.013406 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec98f9ed-4e0c-4a3a-8f9e-9b1a00d1183d None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:28.022985 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 204/421] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Aug 30 01:16:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:28.028539 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff2d56-65ab-4f1a-a076-db5cb2900bae None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:28.056556 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:28.169497 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff2d56-65ab-4f1a-a076-db5cb2900bae None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:28.204471 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a7a818-b84d-4c9b-a0ce-846b571e1e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:28.205084 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7a818-b84d-4c9b-a0ce-846b571e1e68 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:28.205407 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7a818-b84d-4c9b-a0ce-846b571e1e68 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:28.205733 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7a818-b84d-4c9b-a0ce-846b571e1e68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:28.218913 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec98f9ed-4e0c-4a3a-8f9e-9b1a00d1183d None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:28.242226 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:28.327416 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a7a818-b84d-4c9b-a0ce-846b571e1e68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:28.328941 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a7a818-b84d-4c9b-a0ce-846b571e1e68 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:28.348491 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec98f9ed-4e0c-4a3a-8f9e-9b1a00d1183d None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:28.357228 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:28.387286 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5002467-3431-4f82-92af-d534c688d92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:28.388198 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5002467-3431-4f82-92af-d534c688d92c None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:28.388553 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5002467-3431-4f82-92af-d534c688d92c None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:28.388896 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5002467-3431-4f82-92af-d534c688d92c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:28.401115 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5002467-3431-4f82-92af-d534c688d92c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:16:28.406763 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-e5002467-3431-4f82-92af-d534c688d92c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 01:16:28.406763 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:28.406763 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:28.406763 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:28.406763 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:28.406763 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:28.406763 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:28.406763 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:28.406763 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:28.406763 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:28.406763 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:28.406763 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:28.406763 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:16:28.406763 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:16:28.406763 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:16:28.406763 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:16:28.407702 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:16:28.407702 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:16:28.407702 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:16:28.407702 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:16:28.407702 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:28.407702 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:28.407702 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:28.407702 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:28.407702 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:28.407702 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:28.407702 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:28.407702 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:28.407702 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:28.407702 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:28.407702 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:28.407702 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:28.408835 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:28.408835 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:28.408835 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:28.408835 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:28.408835 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:16:28.408835 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:16:28.408835 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:16:28.408835 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:16:28.408835 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:16:28.408835 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:16:28.408835 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 01:16:28.408835 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:16:28.408835 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 205/422] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Aug 30 01:16:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:16:28.413822 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5002467-3431-4f82-92af-d534c688d92c None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:28.488641 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 218/423] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 30 01:16:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:28.489875 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e625c1-8d6e-4195-b81c-2a4d068b19a5 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:28.490160 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e625c1-8d6e-4195-b81c-2a4d068b19a5 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:28.490436 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e625c1-8d6e-4195-b81c-2a4d068b19a5 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:28.491886 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 219/424] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:16:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:16:28.497422 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d361c6-b41d-40df-a32e-69abf831220e None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:28.497698 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d361c6-b41d-40df-a32e-69abf831220e None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:28.497963 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d361c6-b41d-40df-a32e-69abf831220e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:28.501269 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:28.518228 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-c8d361c6-b41d-40df-a32e-69abf831220e None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:28.519994 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-c8d361c6-b41d-40df-a32e-69abf831220e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:28.524969 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5002467-3431-4f82-92af-d534c688d92c None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:28.560714 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf1f26-9f9e-494c-b9c3-8cab6b77862b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:28.561321 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf1f26-9f9e-494c-b9c3-8cab6b77862b None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:28.561601 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf1f26-9f9e-494c-b9c3-8cab6b77862b None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:28.561874 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf1f26-9f9e-494c-b9c3-8cab6b77862b None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:28.562594 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bf1f26-9f9e-494c-b9c3-8cab6b77862b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:28.562898 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bf1f26-9f9e-494c-b9c3-8cab6b77862b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:28.564306 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bf1f26-9f9e-494c-b9c3-8cab6b77862b None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:28.577485 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 206/425] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 30 01:16:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:16:28.578366 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf1f26-9f9e-494c-b9c3-8cab6b77862b None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:28.603189 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 220/426] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:16:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 01:16:28.604485 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d361c6-b41d-40df-a32e-69abf831220e None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:28.664554 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:28.727266 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf1f26-9f9e-494c-b9c3-8cab6b77862b None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:28.746224 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d361c6-b41d-40df-a32e-69abf831220e None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:28.788374 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e73f6e-5511-47c3-9685-c678d42e1aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:28.789382 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e73f6e-5511-47c3-9685-c678d42e1aa7 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:28.789918 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e73f6e-5511-47c3-9685-c678d42e1aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:28.790393 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e73f6e-5511-47c3-9685-c678d42e1aa7 None admin] PATH_INFO: `/v3/projects/023703a6c5664626b371621981c1b1ba` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:28.791904 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e73f6e-5511-47c3-9685-c678d42e1aa7 None admin] RBAC: Authorizing `identity:get_project(project_id=023703a6c5664626b371621981c1b1ba)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:28.793915 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e73f6e-5511-47c3-9685-c678d42e1aa7 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:28.796813 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 207/427] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 30 01:16:28 2022] GET /identity/v3/projects/023703a6c5664626b371621981c1b1ba => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:28.802668 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e73f6e-5511-47c3-9685-c678d42e1aa7 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:28.824044 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e493b7-3141-4f04-9184-3213aa1cdecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:28.825027 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e493b7-3141-4f04-9184-3213aa1cdecf None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:28.825578 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:28.826481 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e493b7-3141-4f04-9184-3213aa1cdecf None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:28.828292 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e493b7-3141-4f04-9184-3213aa1cdecf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:28.928268 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e493b7-3141-4f04-9184-3213aa1cdecf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:28.929744 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e493b7-3141-4f04-9184-3213aa1cdecf None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:28.962822 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e73f6e-5511-47c3-9685-c678d42e1aa7 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:28.980665 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:29.018034 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3716cc9-f8b8-42ad-9abb-d661aaedb460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:29.020071 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3716cc9-f8b8-42ad-9abb-d661aaedb460 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:29.020610 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3716cc9-f8b8-42ad-9abb-d661aaedb460 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:29.021509 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3716cc9-f8b8-42ad-9abb-d661aaedb460 None admin] PATH_INFO: `/v3/groups/9b88dce51cb24fb2b09ad4487e61997e` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:29.023188 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3716cc9-f8b8-42ad-9abb-d661aaedb460 None admin] RBAC: Authorizing `identity:get_group(group_id=9b88dce51cb24fb2b09ad4487e61997e)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:29.026049 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3716cc9-f8b8-42ad-9abb-d661aaedb460 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:29.028587 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 208/428] 10.222.0.60 () {56 vars in 1180 bytes} [Tue Aug 30 01:16:28 2022] GET /identity/v3/groups/9b88dce51cb24fb2b09ad4487e61997e => generated 226 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:29.029598 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3716cc9-f8b8-42ad-9abb-d661aaedb460 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:29.045196 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 221/429] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 30 01:16:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:29.046015 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e493b7-3141-4f04-9184-3213aa1cdecf None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:29.128679 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:29.154905 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3716cc9-f8b8-42ad-9abb-d661aaedb460 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:29.170250 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e493b7-3141-4f04-9184-3213aa1cdecf None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:29.191276 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdfb816-545d-4f9a-ba7e-61096c597777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:29.192067 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdfb816-545d-4f9a-ba7e-61096c597777 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:29.192439 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdfb816-545d-4f9a-ba7e-61096c597777 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:29.192809 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdfb816-545d-4f9a-ba7e-61096c597777 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:29.203626 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdfb816-545d-4f9a-ba7e-61096c597777 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:16:29.210477 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-fbdfb816-545d-4f9a-ba7e-61096c597777 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 01:16:29.210477 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:29.210477 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:29.210477 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:29.210477 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:29.210477 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:29.210477 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:29.210477 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:29.210477 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:29.210477 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:29.210477 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:29.210477 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:29.210477 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:16:29.210477 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:16:29.210477 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:16:29.210477 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:16:29.211645 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:16:29.211645 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:16:29.211645 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:16:29.211645 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:16:29.211645 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:29.211645 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:29.211645 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:29.211645 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:29.211645 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:29.211645 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:29.211645 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:29.211645 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:29.211645 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:29.211645 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:29.211645 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:29.211645 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:29.212658 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:29.212658 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:29.212658 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:29.212658 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:29.212658 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:16:29.212658 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:16:29.212658 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:16:29.212658 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:16:29.212658 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:16:29.212658 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:16:29.212658 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 01:16:29.212658 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:16:29.214536 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 209/430] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 30 01:16:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:29.215751 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdfb816-545d-4f9a-ba7e-61096c597777 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:29.220704 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6152570b-22ae-40dc-aeaf-c51330fa92ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:29.221549 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152570b-22ae-40dc-aeaf-c51330fa92ab None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:29.222074 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152570b-22ae-40dc-aeaf-c51330fa92ab None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:29.222493 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152570b-22ae-40dc-aeaf-c51330fa92ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:29.223386 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6152570b-22ae-40dc-aeaf-c51330fa92ab None admin] RBAC: Adding query filter params (group.id=9b88dce51cb24fb2b09ad4487e61997e, role.id=5b38bd827c5847969c4ee48e27261f5b, scope.project.id=023703a6c5664626b371621981c1b1ba) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:29.223869 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6152570b-22ae-40dc-aeaf-c51330fa92ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:29.225463 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6152570b-22ae-40dc-aeaf-c51330fa92ab None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:29.234955 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 222/431] 10.222.0.60 () {56 vars in 1376 bytes} [Tue Aug 30 01:16:29 2022] GET /identity/v3/role_assignments?group.id=9b88dce51cb24fb2b09ad4487e61997e&scope.project.id=023703a6c5664626b371621981c1b1ba&role.id=5b38bd827c5847969c4ee48e27261f5b => generated 611 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:29.236191 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6152570b-22ae-40dc-aeaf-c51330fa92ab None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:29.253773 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:29.358170 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdfb816-545d-4f9a-ba7e-61096c597777 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:29.405544 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a29859-3dd6-4e57-9c21-653e1f2b98e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:29.406584 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a29859-3dd6-4e57-9c21-653e1f2b98e0 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:29.407019 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6152570b-22ae-40dc-aeaf-c51330fa92ab None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:29.407297 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a29859-3dd6-4e57-9c21-653e1f2b98e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:29.407801 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a29859-3dd6-4e57-9c21-653e1f2b98e0 None admin] PATH_INFO: `/v3/projects/023703a6c5664626b371621981c1b1ba` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:29.411211 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a29859-3dd6-4e57-9c21-653e1f2b98e0 None admin] RBAC: Authorizing `identity:get_project(project_id=023703a6c5664626b371621981c1b1ba)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:29.412970 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a29859-3dd6-4e57-9c21-653e1f2b98e0 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:29.414795 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 210/432] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 30 01:16:29 2022] GET /identity/v3/projects/023703a6c5664626b371621981c1b1ba => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:29.416656 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a98c3-4173-4fd3-8d9e-c1288028e8ba None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:29.416941 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a98c3-4173-4fd3-8d9e-c1288028e8ba None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:29.417214 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a98c3-4173-4fd3-8d9e-c1288028e8ba None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:29.419083 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 211/433] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:16:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:16:29.423833 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78a98c3-4173-4fd3-8d9e-c1288028e8ba None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:29.429392 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:29.447016 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231e272b-1846-40c5-a3ec-b37046e1844e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:29.448416 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e272b-1846-40c5-a3ec-b37046e1844e None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:29.448610 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e272b-1846-40c5-a3ec-b37046e1844e None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:29.448878 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e272b-1846-40c5-a3ec-b37046e1844e None admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:29.449696 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231e272b-1846-40c5-a3ec-b37046e1844e None admin] RBAC: Adding query filter params (name=member) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:29.450009 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231e272b-1846-40c5-a3ec-b37046e1844e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:29.452066 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231e272b-1846-40c5-a3ec-b37046e1844e None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:29.464251 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 223/434] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Aug 30 01:16:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:29.466032 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e9a26-6e11-450d-8bd7-cd59be4a18f7 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:29.466322 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e9a26-6e11-450d-8bd7-cd59be4a18f7 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:29.466598 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e9a26-6e11-450d-8bd7-cd59be4a18f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:29.486489 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-af2e9a26-6e11-450d-8bd7-cd59be4a18f7 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:29.486993 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-af2e9a26-6e11-450d-8bd7-cd59be4a18f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:29.569418 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:29.571625 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78a98c3-4173-4fd3-8d9e-c1288028e8ba None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:29.581885 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 224/435] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:16:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:16:29.581885 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e9a26-6e11-450d-8bd7-cd59be4a18f7 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:29.621695 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba14f7f-9a7f-416d-ad68-f5bc9533708d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:29.622787 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba14f7f-9a7f-416d-ad68-f5bc9533708d None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:29.623265 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba14f7f-9a7f-416d-ad68-f5bc9533708d None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:29.623852 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba14f7f-9a7f-416d-ad68-f5bc9533708d None admin] PATH_INFO: `/v3/groups/9b88dce51cb24fb2b09ad4487e61997e` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:29.625225 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba14f7f-9a7f-416d-ad68-f5bc9533708d None admin] RBAC: Authorizing `identity:get_group(group_id=9b88dce51cb24fb2b09ad4487e61997e)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:29.627021 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba14f7f-9a7f-416d-ad68-f5bc9533708d None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:29.629472 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 212/436] 10.222.0.60 () {56 vars in 1180 bytes} [Tue Aug 30 01:16:29 2022] GET /identity/v3/groups/9b88dce51cb24fb2b09ad4487e61997e => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:29.637730 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba14f7f-9a7f-416d-ad68-f5bc9533708d None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:29.710712 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e9a26-6e11-450d-8bd7-cd59be4a18f7 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:29.722485 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:29.763064 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba14f7f-9a7f-416d-ad68-f5bc9533708d None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:29.766206 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390e4c1-b26c-4dc1-8217-44b098b31cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:29.767098 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390e4c1-b26c-4dc1-8217-44b098b31cb2 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:29.767624 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390e4c1-b26c-4dc1-8217-44b098b31cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:29.768102 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390e4c1-b26c-4dc1-8217-44b098b31cb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:29.816802 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26685275-eb95-44c0-a1e6-a66c1ff2243d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:29.817410 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26685275-eb95-44c0-a1e6-a66c1ff2243d None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:29.817688 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26685275-eb95-44c0-a1e6-a66c1ff2243d None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:29.818341 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26685275-eb95-44c0-a1e6-a66c1ff2243d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:29.819081 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26685275-eb95-44c0-a1e6-a66c1ff2243d None admin] RBAC: Adding query filter params (group.id=9b88dce51cb24fb2b09ad4487e61997e, role.id=449624f20ef248ef97aeceba5b22eccd, scope.project.id=023703a6c5664626b371621981c1b1ba) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:29.819747 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26685275-eb95-44c0-a1e6-a66c1ff2243d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:29.821209 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26685275-eb95-44c0-a1e6-a66c1ff2243d None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:29.827506 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 213/437] 10.222.0.60 () {56 vars in 1376 bytes} [Tue Aug 30 01:16:29 2022] GET /identity/v3/role_assignments?group.id=9b88dce51cb24fb2b09ad4487e61997e&scope.project.id=023703a6c5664626b371621981c1b1ba&role.id=449624f20ef248ef97aeceba5b22eccd => generated 611 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:29.828504 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb0f4b-2ea9-4fde-ba0c-47d46a6fe413 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:29.828784 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb0f4b-2ea9-4fde-ba0c-47d46a6fe413 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:29.829351 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb0f4b-2ea9-4fde-ba0c-47d46a6fe413 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:29.830352 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 214/438] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:16:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:16:29.837107 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb908c6-b970-4d15-b583-ebcad83e874d None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:29.838304 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb908c6-b970-4d15-b583-ebcad83e874d None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:29.838952 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb908c6-b970-4d15-b583-ebcad83e874d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:29.851713 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:29.854634 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3390e4c1-b26c-4dc1-8217-44b098b31cb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:29.857170 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3390e4c1-b26c-4dc1-8217-44b098b31cb2 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:29.865410 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-bfb908c6-b970-4d15-b583-ebcad83e874d None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:29.868567 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-bfb908c6-b970-4d15-b583-ebcad83e874d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:29.958839 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 215/439] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:16:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:16:29.959809 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb908c6-b970-4d15-b583-ebcad83e874d None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:29.989592 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 225/440] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 30 01:16:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:29.995180 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390e4c1-b26c-4dc1-8217-44b098b31cb2 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:30.054053 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:30.100883 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb908c6-b970-4d15-b583-ebcad83e874d None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:30.126794 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:30.130120 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390e4c1-b26c-4dc1-8217-44b098b31cb2 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:30.157687 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e05d1e-779a-48bb-b8b8-a20a592c6df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:30.157687 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e05d1e-779a-48bb-b8b8-a20a592c6df4 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:30.157687 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e05d1e-779a-48bb-b8b8-a20a592c6df4 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:30.157687 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e05d1e-779a-48bb-b8b8-a20a592c6df4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:30.171014 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e05d1e-779a-48bb-b8b8-a20a592c6df4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:16:30.175571 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7f61ec-148f-490d-bcac-926ef6c4f6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:30.176116 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-a8e05d1e-779a-48bb-b8b8-a20a592c6df4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 01:16:30.176116 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:30.176116 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:30.176116 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:30.176116 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:30.176116 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:30.176116 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:30.176116 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:30.176116 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:30.176116 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:30.176116 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:30.176116 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:30.176116 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:16:30.176116 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:16:30.176116 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:16:30.176116 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:16:30.177017 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:16:30.177017 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:16:30.177017 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:16:30.177017 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:16:30.177017 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:30.177017 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:30.177017 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:30.177017 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:30.177017 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:30.177017 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:30.177017 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:30.177017 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:30.177017 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:30.177017 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:30.177017 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:30.177017 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:30.177822 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:30.177822 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:30.177822 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:30.177822 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:30.177822 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:16:30.177822 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:16:30.177822 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:16:30.177822 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:16:30.177822 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:16:30.177822 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:16:30.177822 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 01:16:30.177822 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:16:30.178421 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f61ec-148f-490d-bcac-926ef6c4f6b3 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:30.178421 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f61ec-148f-490d-bcac-926ef6c4f6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:30.178421 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f61ec-148f-490d-bcac-926ef6c4f6b3 None admin] PATH_INFO: `/v3/projects/32242e96e74d4bc797430f115ced8a19` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:30.178608 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 216/441] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Aug 30 01:16:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:30.179991 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7f61ec-148f-490d-bcac-926ef6c4f6b3 None admin] RBAC: Authorizing `identity:get_project(project_id=32242e96e74d4bc797430f115ced8a19)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:30.181479 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7f61ec-148f-490d-bcac-926ef6c4f6b3 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:30.182888 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e05d1e-779a-48bb-b8b8-a20a592c6df4 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:30.183592 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 226/442] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 30 01:16:29 2022] GET /identity/v3/projects/32242e96e74d4bc797430f115ced8a19 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:30.189905 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7f61ec-148f-490d-bcac-926ef6c4f6b3 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:30.305328 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e05d1e-779a-48bb-b8b8-a20a592c6df4 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:30.305594 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7f61ec-148f-490d-bcac-926ef6c4f6b3 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:30.330773 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:30.340565 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aee629-ed8d-4c58-a94c-a7e0a84d02a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:30.341122 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f56127-0616-49a6-a516-02e1c63a2607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:30.341258 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aee629-ed8d-4c58-a94c-a7e0a84d02a5 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:30.341459 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aee629-ed8d-4c58-a94c-a7e0a84d02a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:30.341720 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f56127-0616-49a6-a516-02e1c63a2607 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:30.341810 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aee629-ed8d-4c58-a94c-a7e0a84d02a5 None admin] PATH_INFO: `/v3/groups/9b88dce51cb24fb2b09ad4487e61997e` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:30.341997 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f56127-0616-49a6-a516-02e1c63a2607 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:30.342267 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f56127-0616-49a6-a516-02e1c63a2607 None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:30.342816 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aee629-ed8d-4c58-a94c-a7e0a84d02a5 None admin] RBAC: Authorizing `identity:get_group(group_id=9b88dce51cb24fb2b09ad4487e61997e)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:30.342913 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f56127-0616-49a6-a516-02e1c63a2607 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:30.343218 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f56127-0616-49a6-a516-02e1c63a2607 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:30.344299 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aee629-ed8d-4c58-a94c-a7e0a84d02a5 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:30.344633 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f56127-0616-49a6-a516-02e1c63a2607 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:30.345865 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 227/443] 10.222.0.60 () {56 vars in 1180 bytes} [Tue Aug 30 01:16:30 2022] GET /identity/v3/groups/9b88dce51cb24fb2b09ad4487e61997e => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:30.346621 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aee629-ed8d-4c58-a94c-a7e0a84d02a5 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:30.357383 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 217/444] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 30 01:16:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:16:30.358192 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f56127-0616-49a6-a516-02e1c63a2607 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:30.383086 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:30.447951 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aee629-ed8d-4c58-a94c-a7e0a84d02a5 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:30.455270 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f56127-0616-49a6-a516-02e1c63a2607 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:30.481379 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfc0d11-2b6b-44be-a8b6-298f9b695632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:30.482002 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc0d11-2b6b-44be-a8b6-298f9b695632 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:30.482283 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc0d11-2b6b-44be-a8b6-298f9b695632 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:30.482556 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc0d11-2b6b-44be-a8b6-298f9b695632 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:30.487951 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebecee90-17ee-4113-b8c8-eff12f371977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:30.488599 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebecee90-17ee-4113-b8c8-eff12f371977 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:30.488882 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebecee90-17ee-4113-b8c8-eff12f371977 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:30.489150 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebecee90-17ee-4113-b8c8-eff12f371977 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:30.489866 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebecee90-17ee-4113-b8c8-eff12f371977 None admin] RBAC: Adding query filter params (group.id=9b88dce51cb24fb2b09ad4487e61997e, role.id=5b38bd827c5847969c4ee48e27261f5b, scope.project.id=32242e96e74d4bc797430f115ced8a19) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:30.490171 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebecee90-17ee-4113-b8c8-eff12f371977 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:30.491656 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebecee90-17ee-4113-b8c8-eff12f371977 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:30.493347 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfc0d11-2b6b-44be-a8b6-298f9b695632 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:16:30.497207 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 218/445] 10.222.0.60 () {56 vars in 1376 bytes} [Tue Aug 30 01:16:30 2022] GET /identity/v3/role_assignments?group.id=9b88dce51cb24fb2b09ad4487e61997e&scope.project.id=32242e96e74d4bc797430f115ced8a19&role.id=5b38bd827c5847969c4ee48e27261f5b => generated 611 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:30.497982 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebecee90-17ee-4113-b8c8-eff12f371977 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:30.498648 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-0cfc0d11-2b6b-44be-a8b6-298f9b695632 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:16:30.498648 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:30.498648 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:30.498648 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:30.498648 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:30.498648 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:30.498648 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:30.498648 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:30.498648 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:30.498648 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:30.498648 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:30.498648 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:30.498648 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:16:30.498648 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:16:30.498648 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:16:30.498648 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:16:30.499762 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:16:30.499762 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:16:30.499762 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:16:30.499762 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:16:30.499762 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:30.499762 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:30.499762 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:30.499762 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:30.499762 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:30.499762 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:30.499762 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:30.499762 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:30.499762 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:30.499762 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:30.499762 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:30.499762 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:30.500604 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:30.500604 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:30.500604 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:30.500604 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:30.500604 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:16:30.500604 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:16:30.500604 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:16:30.500604 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:16:30.500604 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:16:30.500604 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:16:30.500604 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:16:30.500604 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:16:30.504835 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 228/446] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 30 01:16:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:30.505584 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfc0d11-2b6b-44be-a8b6-298f9b695632 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:30.560892 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:30.620463 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebecee90-17ee-4113-b8c8-eff12f371977 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:30.624991 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:30.631336 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfc0d11-2b6b-44be-a8b6-298f9b695632 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:30.664996 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca91fff0-b238-4c07-bbe9-3481225fe720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:30.665616 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91fff0-b238-4c07-bbe9-3481225fe720 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:30.665900 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91fff0-b238-4c07-bbe9-3481225fe720 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:30.666516 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91fff0-b238-4c07-bbe9-3481225fe720 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:30.675080 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452b2a1c-0cbd-4cc4-8a31-d3b558e8a962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:30.675838 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b2a1c-0cbd-4cc4-8a31-d3b558e8a962 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:30.676115 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b2a1c-0cbd-4cc4-8a31-d3b558e8a962 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:30.676384 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b2a1c-0cbd-4cc4-8a31-d3b558e8a962 None admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:30.677050 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452b2a1c-0cbd-4cc4-8a31-d3b558e8a962 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:30.677389 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452b2a1c-0cbd-4cc4-8a31-d3b558e8a962 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:30.679053 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452b2a1c-0cbd-4cc4-8a31-d3b558e8a962 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:30.687870 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 229/447] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 30 01:16:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:30.693676 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452b2a1c-0cbd-4cc4-8a31-d3b558e8a962 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:30.755774 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca91fff0-b238-4c07-bbe9-3481225fe720 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:30.757265 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca91fff0-b238-4c07-bbe9-3481225fe720 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:30.816957 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452b2a1c-0cbd-4cc4-8a31-d3b558e8a962 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:30.818670 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:30.854566 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abdf2b6-4ec0-4e28-a3ad-dd504511a34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:30.854566 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abdf2b6-4ec0-4e28-a3ad-dd504511a34e None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:30.854566 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abdf2b6-4ec0-4e28-a3ad-dd504511a34e None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:30.854949 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abdf2b6-4ec0-4e28-a3ad-dd504511a34e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:30.870857 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 219/448] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 30 01:16:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:30.876590 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca91fff0-b238-4c07-bbe9-3481225fe720 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:30.882661 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:30.925461 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abdf2b6-4ec0-4e28-a3ad-dd504511a34e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:30.926929 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abdf2b6-4ec0-4e28-a3ad-dd504511a34e None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:30.974269 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca91fff0-b238-4c07-bbe9-3481225fe720 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:31.008542 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4d7a60-8d9c-49ef-845d-c27d0b212bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:31.009160 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d7a60-8d9c-49ef-845d-c27d0b212bdd None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:31.009431 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d7a60-8d9c-49ef-845d-c27d0b212bdd None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:31.009696 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d7a60-8d9c-49ef-845d-c27d0b212bdd None admin] PATH_INFO: `/v3/projects/32242e96e74d4bc797430f115ced8a19` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:31.010800 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4d7a60-8d9c-49ef-845d-c27d0b212bdd None admin] RBAC: Authorizing `identity:get_project(project_id=32242e96e74d4bc797430f115ced8a19)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:31.012276 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4d7a60-8d9c-49ef-845d-c27d0b212bdd None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:31.013936 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 220/449] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 30 01:16:30 2022] GET /identity/v3/projects/32242e96e74d4bc797430f115ced8a19 => generated 302 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:16:31.019899 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4d7a60-8d9c-49ef-845d-c27d0b212bdd None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:31.026807 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 230/450] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 30 01:16:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 01:16:31.032516 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abdf2b6-4ec0-4e28-a3ad-dd504511a34e None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:31.040697 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:31.088798 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:31.119581 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4d7a60-8d9c-49ef-845d-c27d0b212bdd None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:31.134806 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abdf2b6-4ec0-4e28-a3ad-dd504511a34e None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:31.154817 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa5b49a-ef32-409b-a424-427e08bc3335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:31.155460 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa5b49a-ef32-409b-a424-427e08bc3335 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:31.155743 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa5b49a-ef32-409b-a424-427e08bc3335 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:31.156017 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa5b49a-ef32-409b-a424-427e08bc3335 None admin] PATH_INFO: `/v3/groups/9b88dce51cb24fb2b09ad4487e61997e` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:31.157125 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa5b49a-ef32-409b-a424-427e08bc3335 None admin] RBAC: Authorizing `identity:get_group(group_id=9b88dce51cb24fb2b09ad4487e61997e)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:31.158580 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa5b49a-ef32-409b-a424-427e08bc3335 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:31.160681 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 221/451] 10.222.0.60 () {56 vars in 1180 bytes} [Tue Aug 30 01:16:31 2022] GET /identity/v3/groups/9b88dce51cb24fb2b09ad4487e61997e => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:16:31.166390 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa5b49a-ef32-409b-a424-427e08bc3335 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:31.168615 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda58403-cee8-4208-8052-2b5e1dcf799a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:31.169353 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda58403-cee8-4208-8052-2b5e1dcf799a None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:31.169662 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda58403-cee8-4208-8052-2b5e1dcf799a None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:31.169937 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda58403-cee8-4208-8052-2b5e1dcf799a None admin] PATH_INFO: `/v3/projects/9a06ede3df8449d487fb53c388e91ca5` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:31.171072 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda58403-cee8-4208-8052-2b5e1dcf799a None admin] RBAC: Authorizing `identity:get_project(project_id=9a06ede3df8449d487fb53c388e91ca5)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:31.172547 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda58403-cee8-4208-8052-2b5e1dcf799a None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:31.174147 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 231/452] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 30 01:16:31 2022] GET /identity/v3/projects/9a06ede3df8449d487fb53c388e91ca5 => generated 344 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:16:31.180064 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda58403-cee8-4208-8052-2b5e1dcf799a None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:31.253432 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:31.265876 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa5b49a-ef32-409b-a424-427e08bc3335 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:31.280740 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda58403-cee8-4208-8052-2b5e1dcf799a None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:31.304512 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4464318c-ac53-40fc-8a72-791dd9e38e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:31.305112 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4464318c-ac53-40fc-8a72-791dd9e38e74 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:31.305390 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4464318c-ac53-40fc-8a72-791dd9e38e74 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:31.305661 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4464318c-ac53-40fc-8a72-791dd9e38e74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:31.306384 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4464318c-ac53-40fc-8a72-791dd9e38e74 None admin] RBAC: Adding query filter params (group.id=9b88dce51cb24fb2b09ad4487e61997e, role.id=449624f20ef248ef97aeceba5b22eccd, scope.project.id=32242e96e74d4bc797430f115ced8a19) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:31.306702 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4464318c-ac53-40fc-8a72-791dd9e38e74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:31.306834 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:31.308260 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4464318c-ac53-40fc-8a72-791dd9e38e74 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:31.314106 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 222/453] 10.222.0.60 () {56 vars in 1376 bytes} [Tue Aug 30 01:16:31 2022] GET /identity/v3/role_assignments?group.id=9b88dce51cb24fb2b09ad4487e61997e&scope.project.id=32242e96e74d4bc797430f115ced8a19&role.id=449624f20ef248ef97aeceba5b22eccd => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:16:31.318316 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a2ba59-d31b-4b23-99b4-ad4884a7ab1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:31.319058 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a2ba59-d31b-4b23-99b4-ad4884a7ab1c None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:31.319404 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a2ba59-d31b-4b23-99b4-ad4884a7ab1c None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:31.319713 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a2ba59-d31b-4b23-99b4-ad4884a7ab1c None admin] PATH_INFO: `/v3/groups/b152cf09f00641fcbf63855b200c0117` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:31.320872 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a2ba59-d31b-4b23-99b4-ad4884a7ab1c None admin] RBAC: Authorizing `identity:get_group(group_id=b152cf09f00641fcbf63855b200c0117)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:31.322342 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a2ba59-d31b-4b23-99b4-ad4884a7ab1c None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:31.324028 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 232/454] 10.222.0.60 () {56 vars in 1180 bytes} [Tue Aug 30 01:16:31 2022] GET /identity/v3/groups/b152cf09f00641fcbf63855b200c0117 => generated 229 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:31.330335 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4464318c-ac53-40fc-8a72-791dd9e38e74 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:31.434756 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4464318c-ac53-40fc-8a72-791dd9e38e74 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:31.469211 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad9f0a-902d-4b60-9ea1-66469441a469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:31.469821 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad9f0a-902d-4b60-9ea1-66469441a469 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:31.470101 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad9f0a-902d-4b60-9ea1-66469441a469 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:31.470384 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad9f0a-902d-4b60-9ea1-66469441a469 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:31.471145 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aad9f0a-902d-4b60-9ea1-66469441a469 None admin] RBAC: Adding query filter params (group.id=b152cf09f00641fcbf63855b200c0117, role.id=f6bc03b6972e420eb338ee7fd1443974, scope.project.id=9a06ede3df8449d487fb53c388e91ca5) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:31.471580 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aad9f0a-902d-4b60-9ea1-66469441a469 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:31.473495 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aad9f0a-902d-4b60-9ea1-66469441a469 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:31.479422 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 223/455] 10.222.0.60 () {56 vars in 1376 bytes} [Tue Aug 30 01:16:31 2022] GET /identity/v3/role_assignments?group.id=b152cf09f00641fcbf63855b200c0117&scope.project.id=9a06ede3df8449d487fb53c388e91ca5&role.id=f6bc03b6972e420eb338ee7fd1443974 => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:33.758035 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eccfd1-ed9e-4fb3-a5a3-e80c146eb7bb None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:33.759286 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eccfd1-ed9e-4fb3-a5a3-e80c146eb7bb None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:33.759807 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eccfd1-ed9e-4fb3-a5a3-e80c146eb7bb None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:33.762134 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 233/456] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:16:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:16:33.768231 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ae5c4-eed2-44b5-a83f-524ec05ff36d None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:33.770219 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ae5c4-eed2-44b5-a83f-524ec05ff36d None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:33.771008 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ae5c4-eed2-44b5-a83f-524ec05ff36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:33.800463 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-a66ae5c4-eed2-44b5-a83f-524ec05ff36d None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:33.802247 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-a66ae5c4-eed2-44b5-a83f-524ec05ff36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:33.814254 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:33.897388 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba46a57-6b8b-484f-9c7d-ea7d2c514282 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:33.897736 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba46a57-6b8b-484f-9c7d-ea7d2c514282 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:33.897944 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba46a57-6b8b-484f-9c7d-ea7d2c514282 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:33.899895 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 234/457] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:16:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:16:33.900583 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 224/458] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:16:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:16:33.904701 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13d05d-b689-4232-8863-dfb1b7479415 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:33.904979 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13d05d-b689-4232-8863-dfb1b7479415 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:33.905249 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13d05d-b689-4232-8863-dfb1b7479415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:33.923770 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-fa13d05d-b689-4232-8863-dfb1b7479415 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:33.924983 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-fa13d05d-b689-4232-8863-dfb1b7479415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:34.006966 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 235/459] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:16:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:16:34.345122 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ae5c4-eed2-44b5-a83f-524ec05ff36d None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:34.348348 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa13d05d-b689-4232-8863-dfb1b7479415 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:34.482114 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ae5c4-eed2-44b5-a83f-524ec05ff36d None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:34.500586 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa13d05d-b689-4232-8863-dfb1b7479415 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:34.524659 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c13c51-3243-454b-b9bd-9096d4308480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:34.525299 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c13c51-3243-454b-b9bd-9096d4308480 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:34.525582 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c13c51-3243-454b-b9bd-9096d4308480 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:34.525856 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c13c51-3243-454b-b9bd-9096d4308480 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:34.527661 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:34.542829 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c13c51-3243-454b-b9bd-9096d4308480 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:34.543386 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e037a5f-f9b7-4397-9671-87a10f4cb363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:34.544300 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e037a5f-f9b7-4397-9671-87a10f4cb363 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:34.544407 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c13c51-3243-454b-b9bd-9096d4308480 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:34.544875 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e037a5f-f9b7-4397-9671-87a10f4cb363 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:34.545345 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e037a5f-f9b7-4397-9671-87a10f4cb363 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:34.552730 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:34.560273 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e037a5f-f9b7-4397-9671-87a10f4cb363 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:34.562019 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e037a5f-f9b7-4397-9671-87a10f4cb363 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:34.563602 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-53c13c51-3243-454b-b9bd-9096d4308480 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:34.563602 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:34.563602 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:34.563602 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:34.563602 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:34.563602 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:34.563602 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:34.563602 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:34.563602 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:34.563602 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:34.563602 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:34.563602 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:34.563602 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:16:34.563602 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:16:34.563602 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:16:34.563602 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:16:34.564519 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:34.564519 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:34.564519 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:34.564519 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:34.564519 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:34.564519 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:34.564519 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:34.564519 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:34.564519 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:34.564519 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:34.564519 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:34.564519 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:34.564519 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:34.564519 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:34.564519 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:34.564519 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:34.564519 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:16:34.565364 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:16:34.565364 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:34.565364 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:16:34.568454 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 225/460] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:16:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:34.570594 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a886fc-bb87-459b-8fca-3bd4d4715fd0 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:34.571015 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a886fc-bb87-459b-8fca-3bd4d4715fd0 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:34.571416 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a886fc-bb87-459b-8fca-3bd4d4715fd0 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:34.573038 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 226/461] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:16:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:16:34.576283 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a886fc-bb87-459b-8fca-3bd4d4715fd0 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:34.595103 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-3e037a5f-f9b7-4397-9671-87a10f4cb363 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:34.595103 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:34.595103 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:34.595103 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:34.595103 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:34.595103 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:34.595103 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:34.595103 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:34.595103 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:34.595103 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:34.595103 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:34.595103 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:34.595103 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:16:34.595103 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:16:34.595103 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:16:34.595103 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:16:34.596146 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:34.596146 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:34.596146 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:34.596146 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:34.596146 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:34.596146 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:34.596146 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:34.596146 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:34.596146 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:34.596146 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:34.596146 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:34.596146 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:34.596146 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:34.596146 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:34.596146 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:34.596146 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:34.596146 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:16:34.597072 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:16:34.597072 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:34.597072 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:16:34.603286 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 236/462] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:16:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:16:34.604640 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93423a76-9712-47f8-b615-ac8be641f0aa None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:34.604922 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93423a76-9712-47f8-b615-ac8be641f0aa None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:34.605186 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93423a76-9712-47f8-b615-ac8be641f0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:34.625029 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-93423a76-9712-47f8-b615-ac8be641f0aa None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:34.626304 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-93423a76-9712-47f8-b615-ac8be641f0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:34.702436 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a886fc-bb87-459b-8fca-3bd4d4715fd0 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:34.705755 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 237/463] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:16:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:16:34.706235 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93423a76-9712-47f8-b615-ac8be641f0aa None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:34.739411 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef245e54-1028-436c-bdad-e72d205cdc2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:34.740407 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef245e54-1028-436c-bdad-e72d205cdc2e None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:34.741116 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef245e54-1028-436c-bdad-e72d205cdc2e None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:34.741743 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef245e54-1028-436c-bdad-e72d205cdc2e None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:34.742614 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef245e54-1028-436c-bdad-e72d205cdc2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:34.743118 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef245e54-1028-436c-bdad-e72d205cdc2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:34.744918 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef245e54-1028-436c-bdad-e72d205cdc2e None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:34.760244 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 227/464] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:16:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:34.766298 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef245e54-1028-436c-bdad-e72d205cdc2e None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:34.820071 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93423a76-9712-47f8-b615-ac8be641f0aa None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:34.828417 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:34.845653 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:34.858725 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b5399-7d03-4e43-9e38-ffe01162be2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:34.859286 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b5399-7d03-4e43-9e38-ffe01162be2d None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:34.859950 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b5399-7d03-4e43-9e38-ffe01162be2d None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:34.859950 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b5399-7d03-4e43-9e38-ffe01162be2d None admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:34.860493 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304b5399-7d03-4e43-9e38-ffe01162be2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:34.860789 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304b5399-7d03-4e43-9e38-ffe01162be2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:34.862194 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304b5399-7d03-4e43-9e38-ffe01162be2d None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:34.881338 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 238/465] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:16:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:34.882614 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe63e96-8e56-48eb-9f88-94f3b07ba1a5 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:34.882953 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe63e96-8e56-48eb-9f88-94f3b07ba1a5 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:34.883288 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe63e96-8e56-48eb-9f88-94f3b07ba1a5 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:34.883854 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef245e54-1028-436c-bdad-e72d205cdc2e None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:34.884829 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 239/466] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:16:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:16:34.890937 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3397c-9bca-448a-9282-6d28a5b90cec None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:34.891345 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3397c-9bca-448a-9282-6d28a5b90cec None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:34.891743 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3397c-9bca-448a-9282-6d28a5b90cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:34.911691 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-e6c3397c-9bca-448a-9282-6d28a5b90cec None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:34.913102 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-e6c3397c-9bca-448a-9282-6d28a5b90cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:34.928150 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf67c22a-db15-46f5-8c67-a7292838d132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:34.929271 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67c22a-db15-46f5-8c67-a7292838d132 None admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:34.929983 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67c22a-db15-46f5-8c67-a7292838d132 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:34.930642 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67c22a-db15-46f5-8c67-a7292838d132 None admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:34.931548 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf67c22a-db15-46f5-8c67-a7292838d132 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:34.933174 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf67c22a-db15-46f5-8c67-a7292838d132 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:34.961559 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 228/467] 10.222.0.60 () {60 vars in 1132 bytes} [Tue Aug 30 01:16:34 2022] POST /identity/v3/users => generated 248 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:16:34.968622 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf67c22a-db15-46f5-8c67-a7292838d132 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:34.994304 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 240/468] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:16:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:16:35.037264 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c3397c-9bca-448a-9282-6d28a5b90cec None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:35.151364 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:35.161757 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c3397c-9bca-448a-9282-6d28a5b90cec None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:35.197782 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc64ba2-8cd9-44d9-b201-1c630ebacb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:35.198428 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc64ba2-8cd9-44d9-b201-1c630ebacb45 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:35.198719 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc64ba2-8cd9-44d9-b201-1c630ebacb45 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:35.198971 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc64ba2-8cd9-44d9-b201-1c630ebacb45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:35.210130 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc64ba2-8cd9-44d9-b201-1c630ebacb45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:35.212482 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc64ba2-8cd9-44d9-b201-1c630ebacb45 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:35.229182 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-dbc64ba2-8cd9-44d9-b201-1c630ebacb45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:35.229182 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:35.229182 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:35.229182 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:35.229182 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:35.229182 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:35.229182 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:35.229182 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:35.229182 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:35.229182 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:35.229182 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:35.229182 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:35.229182 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:16:35.229182 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:16:35.229182 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:16:35.229182 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:16:35.230997 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:35.230997 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:35.230997 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:35.230997 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:35.230997 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:35.230997 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:35.230997 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:35.230997 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:35.230997 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:35.230997 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:35.230997 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:35.230997 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:35.230997 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:35.230997 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:35.230997 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:35.230997 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:35.230997 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:16:35.232830 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:16:35.232830 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:35.232830 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:16:35.232830 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 241/469] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:16:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:16:35.236268 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc64ba2-8cd9-44d9-b201-1c630ebacb45 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:35.242125 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf67c22a-db15-46f5-8c67-a7292838d132 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:35.262262 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:35.296712 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61bf180-2907-4140-a34f-dec243835d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:35.297752 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61bf180-2907-4140-a34f-dec243835d50 None admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:35.298262 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61bf180-2907-4140-a34f-dec243835d50 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:35.298785 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61bf180-2907-4140-a34f-dec243835d50 None admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:35.299683 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61bf180-2907-4140-a34f-dec243835d50 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:35.301467 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61bf180-2907-4140-a34f-dec243835d50 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:35.329705 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 229/470] 10.222.0.60 () {60 vars in 1132 bytes} [Tue Aug 30 01:16:34 2022] POST /identity/v3/users => generated 246 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:16:35.331909 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58bc3d-80b7-44df-9d10-8cac018b7b91 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:35.332417 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58bc3d-80b7-44df-9d10-8cac018b7b91 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:35.332901 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58bc3d-80b7-44df-9d10-8cac018b7b91 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:35.334386 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 230/471] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:16:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:16:35.344111 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf462426-a258-4cc2-a663-a10fbcef31f7 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:35.345026 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf462426-a258-4cc2-a663-a10fbcef31f7 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:35.345973 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf462426-a258-4cc2-a663-a10fbcef31f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:35.372563 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-cf462426-a258-4cc2-a663-a10fbcef31f7 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:35.372808 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc64ba2-8cd9-44d9-b201-1c630ebacb45 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:35.375765 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-cf462426-a258-4cc2-a663-a10fbcef31f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:35.417783 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43902b1c-1ba3-48ba-a678-9370ea5b0738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:35.418329 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43902b1c-1ba3-48ba-a678-9370ea5b0738 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:35.418605 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43902b1c-1ba3-48ba-a678-9370ea5b0738 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:35.418874 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43902b1c-1ba3-48ba-a678-9370ea5b0738 None admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:35.419731 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43902b1c-1ba3-48ba-a678-9370ea5b0738 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:35.420033 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43902b1c-1ba3-48ba-a678-9370ea5b0738 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:35.422914 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43902b1c-1ba3-48ba-a678-9370ea5b0738 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:35.437834 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 242/472] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:16:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:35.438711 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43902b1c-1ba3-48ba-a678-9370ea5b0738 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:35.454855 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:35.491717 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 231/473] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:16:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:16:35.493362 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf462426-a258-4cc2-a663-a10fbcef31f7 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:35.620368 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43902b1c-1ba3-48ba-a678-9370ea5b0738 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:35.638110 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:35.642757 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf462426-a258-4cc2-a663-a10fbcef31f7 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:35.663586 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f18aa7-3f7b-4999-bcc0-e17eca29252b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:35.664324 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f18aa7-3f7b-4999-bcc0-e17eca29252b None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:35.664745 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f18aa7-3f7b-4999-bcc0-e17eca29252b None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:35.665159 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f18aa7-3f7b-4999-bcc0-e17eca29252b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:35.678334 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f18aa7-3f7b-4999-bcc0-e17eca29252b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:35.679927 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f18aa7-3f7b-4999-bcc0-e17eca29252b None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:35.688786 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d54dd8d-9b42-4bab-a563-516be9870524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:35.690104 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54dd8d-9b42-4bab-a563-516be9870524 None admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:35.691109 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54dd8d-9b42-4bab-a563-516be9870524 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:35.691610 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54dd8d-9b42-4bab-a563-516be9870524 None admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:35.692727 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d54dd8d-9b42-4bab-a563-516be9870524 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:35.694372 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d54dd8d-9b42-4bab-a563-516be9870524 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:35.702971 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-37f18aa7-3f7b-4999-bcc0-e17eca29252b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:35.702971 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:35.702971 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:35.702971 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:35.702971 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:35.702971 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:35.702971 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:35.702971 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:35.702971 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:35.702971 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:35.702971 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:35.702971 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:35.702971 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:16:35.702971 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:16:35.702971 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:16:35.702971 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:16:35.704181 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:35.704181 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:35.704181 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:35.704181 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:35.704181 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:35.704181 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:35.704181 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:35.704181 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:35.704181 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:35.704181 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:35.704181 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:35.704181 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:35.704181 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:35.704181 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:35.704181 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:35.704181 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:35.704181 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:16:35.705046 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:16:35.705046 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:35.705046 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:16:35.705046 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 243/474] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:16:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:35.711104 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f18aa7-3f7b-4999-bcc0-e17eca29252b None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:35.729099 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 232/475] 10.222.0.60 () {60 vars in 1132 bytes} [Tue Aug 30 01:16:35 2022] POST /identity/v3/users => generated 248 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:16:35.796813 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:35.821953 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d54dd8d-9b42-4bab-a563-516be9870524 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:35.865254 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f18aa7-3f7b-4999-bcc0-e17eca29252b None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:35.907875 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb3db9-114c-436c-bef2-6598ce4cdca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:35.908489 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb3db9-114c-436c-bef2-6598ce4cdca9 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:35.908761 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb3db9-114c-436c-bef2-6598ce4cdca9 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:35.909041 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb3db9-114c-436c-bef2-6598ce4cdca9 None admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:35.910345 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cb3db9-114c-436c-bef2-6598ce4cdca9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:35.910621 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cb3db9-114c-436c-bef2-6598ce4cdca9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:35.912130 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cb3db9-114c-436c-bef2-6598ce4cdca9 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:35.932396 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 244/476] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:16:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:16:35.944521 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb3db9-114c-436c-bef2-6598ce4cdca9 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:36.001260 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d54dd8d-9b42-4bab-a563-516be9870524 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:36.055874 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea85a22-3749-4ca3-b653-115a87809c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:36.056543 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea85a22-3749-4ca3-b653-115a87809c48 None admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:36.056828 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea85a22-3749-4ca3-b653-115a87809c48 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:36.057098 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea85a22-3749-4ca3-b653-115a87809c48 None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:36.057809 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea85a22-3749-4ca3-b653-115a87809c48 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:36.059191 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea85a22-3749-4ca3-b653-115a87809c48 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:36.071420 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.sql.core [None req-dea85a22-3749-4ca3-b653-115a87809c48 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 30 01:16:36.071420 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 30 01:16:36.071420 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [parameters: {'id': 'e6f4c1bb28ee48b9bde23bd129a9292a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 30 01:16:36.071420 dv-cinder-819668-6-smb devstack@keystone.service[81446]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81446) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 30 01:16:36.088004 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb3db9-114c-436c-bef2-6598ce4cdca9 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:36.089258 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-dea85a22-3749-4ca3-b653-115a87809c48 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 30 01:16:36.089258 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:36.089258 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 01:16:36.089258 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 01:16:36.089258 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 01:16:36.089258 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 01:16:36.089258 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 01:16:36.089258 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 01:16:36.089258 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 01:16:36.089258 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application conn.query(q) Aug 30 01:16:36.089258 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 01:16:36.089258 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 01:16:36.089258 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 01:16:36.089258 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application result.read() Aug 30 01:16:36.089258 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 01:16:36.090394 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 01:16:36.090394 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 01:16:36.090394 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 01:16:36.090394 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 01:16:36.090394 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 01:16:36.090394 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 01:16:36.090394 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 01:16:36.090394 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 30 01:16:36.090394 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:16:36.090394 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 30 01:16:36.090394 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:16:36.090394 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:36.090394 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 30 01:16:36.090394 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 30 01:16:36.090394 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 30 01:16:36.090394 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return ref.to_dict() Aug 30 01:16:36.090394 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 01:16:36.090394 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application next(self.gen) Aug 30 01:16:36.091307 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 30 01:16:36.091307 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application yield resource Aug 30 01:16:36.091307 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 01:16:36.091307 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application next(self.gen) Aug 30 01:16:36.091307 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 30 01:16:36.091307 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self.session.rollback() Aug 30 01:16:36.091307 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 01:16:36.091307 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self.force_reraise() Aug 30 01:16:36.091307 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 01:16:36.091307 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise self.value Aug 30 01:16:36.091307 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 30 01:16:36.091307 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 30 01:16:36.091307 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 30 01:16:36.091307 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application session.commit() Aug 30 01:16:36.091307 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 30 01:16:36.091307 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 30 01:16:36.091307 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 30 01:16:36.092199 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self._prepare_impl() Aug 30 01:16:36.092199 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 30 01:16:36.092199 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self.session.flush() Aug 30 01:16:36.092199 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 30 01:16:36.092199 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self._flush(objects) Aug 30 01:16:36.092199 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 30 01:16:36.092199 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 30 01:16:36.092199 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 30 01:16:36.092199 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application compat.raise_( Aug 30 01:16:36.092199 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 01:16:36.092199 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception Aug 30 01:16:36.092199 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 30 01:16:36.092199 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application flush_context.execute() Aug 30 01:16:36.092199 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 30 01:16:36.092199 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rec.execute(self) Aug 30 01:16:36.092199 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 30 01:16:36.092199 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 30 01:16:36.093894 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 30 01:16:36.093894 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 30 01:16:36.093894 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 30 01:16:36.093894 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 30 01:16:36.093894 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 30 01:16:36.093894 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 30 01:16:36.093894 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 30 01:16:36.093894 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 30 01:16:36.093894 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 30 01:16:36.093894 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 30 01:16:36.093894 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 30 01:16:36.093894 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 30 01:16:36.093894 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 30 01:16:36.093894 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 30 01:16:36.093894 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 01:16:36.093894 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception Aug 30 01:16:36.094684 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 01:16:36.094684 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 01:16:36.094684 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 01:16:36.094684 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 01:16:36.094684 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 01:16:36.094684 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 01:16:36.094684 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 01:16:36.094684 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application conn.query(q) Aug 30 01:16:36.094684 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 01:16:36.094684 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 01:16:36.094684 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 01:16:36.094684 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application result.read() Aug 30 01:16:36.094684 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 01:16:36.094684 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 01:16:36.094684 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 01:16:36.094684 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 01:16:36.097273 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 01:16:36.097273 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 01:16:36.097273 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 01:16:36.097273 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 01:16:36.097273 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 30 01:16:36.097273 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 30 01:16:36.097273 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [parameters: {'id': 'e6f4c1bb28ee48b9bde23bd129a9292a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 30 01:16:36.097273 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 30 01:16:36.097273 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:16:36.097273 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 01:16:36.097273 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:16:36.097273 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:36.097273 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:36.097273 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:36.097273 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:36.097273 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:36.100142 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:36.100142 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:36.100142 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:36.100142 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:36.100142 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:36.100142 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:36.100142 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 30 01:16:36.100142 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 30 01:16:36.100142 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:36.100142 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:36.100142 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 30 01:16:36.100142 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 30 01:16:36.100142 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 30 01:16:36.100142 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 30 01:16:36.100142 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 30 01:16:36.100142 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:16:36.102775 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 233/477] 10.222.0.60 () {60 vars in 1131 bytes} [Tue Aug 30 01:16:35 2022] POST /identity/v3/roles => generated 144 bytes in 270 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:36.102775 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea85a22-3749-4ca3-b653-115a87809c48 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:36.121112 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:36.142627 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:36.150123 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b94d88-b169-4945-8b35-fdcf88f02f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:36.150782 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b94d88-b169-4945-8b35-fdcf88f02f94 None admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:36.151031 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b94d88-b169-4945-8b35-fdcf88f02f94 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:36.151451 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b94d88-b169-4945-8b35-fdcf88f02f94 None admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:36.152208 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b94d88-b169-4945-8b35-fdcf88f02f94 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:36.153657 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b94d88-b169-4945-8b35-fdcf88f02f94 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:36.222858 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 245/478] 10.222.0.60 () {60 vars in 1132 bytes} [Tue Aug 30 01:16:35 2022] POST /identity/v3/users => generated 249 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:16:36.239885 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea85a22-3749-4ca3-b653-115a87809c48 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:36.324968 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5232b8c-4ae3-4f37-9528-9953b6c055f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:36.325625 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5232b8c-4ae3-4f37-9528-9953b6c055f1 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:36.325904 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5232b8c-4ae3-4f37-9528-9953b6c055f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:36.326177 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5232b8c-4ae3-4f37-9528-9953b6c055f1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:36.352662 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5232b8c-4ae3-4f37-9528-9953b6c055f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:16:36.358068 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-c5232b8c-4ae3-4f37-9528-9953b6c055f1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 01:16:36.358068 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:36.358068 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:36.358068 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:36.358068 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:36.358068 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:36.358068 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:36.358068 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:36.358068 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:36.358068 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:36.358068 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:36.358068 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:36.358068 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:16:36.358068 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:16:36.358068 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:16:36.358068 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:16:36.358922 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:16:36.358922 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:16:36.358922 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:16:36.358922 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:16:36.358922 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:36.358922 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:36.358922 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:36.358922 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:36.358922 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:36.358922 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:36.358922 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:36.358922 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:36.358922 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:36.358922 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:36.358922 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:36.358922 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:36.359749 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:36.359749 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:36.359749 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:36.359749 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:36.359749 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:16:36.359749 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:16:36.359749 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:16:36.359749 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:16:36.359749 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:16:36.359749 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:16:36.359749 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 01:16:36.359749 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:16:36.359749 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 234/479] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Aug 30 01:16:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:36.365231 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b94d88-b169-4945-8b35-fdcf88f02f94 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:36.515405 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b94d88-b169-4945-8b35-fdcf88f02f94 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:36.549157 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bcd132-5cb5-46ac-a939-3b4c9a4f26b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:36.550294 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bcd132-5cb5-46ac-a939-3b4c9a4f26b6 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:36.550590 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bcd132-5cb5-46ac-a939-3b4c9a4f26b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:36.550860 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bcd132-5cb5-46ac-a939-3b4c9a4f26b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:36.551550 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bcd132-5cb5-46ac-a939-3b4c9a4f26b6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:36.551854 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bcd132-5cb5-46ac-a939-3b4c9a4f26b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:36.553353 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bcd132-5cb5-46ac-a939-3b4c9a4f26b6 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:36.562421 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 246/480] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 30 01:16:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:37.333631 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf4018-9b34-4490-84f3-f322f4ff9c1a None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:37.334627 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf4018-9b34-4490-84f3-f322f4ff9c1a None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:37.335129 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf4018-9b34-4490-84f3-f322f4ff9c1a None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:37.337015 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 235/481] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:16:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:16:37.342660 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c473132e-a79e-4a64-b5f5-2719a4ec8ae2 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:37.343067 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c473132e-a79e-4a64-b5f5-2719a4ec8ae2 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:37.343255 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c473132e-a79e-4a64-b5f5-2719a4ec8ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:37.367690 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-c473132e-a79e-4a64-b5f5-2719a4ec8ae2 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:37.368896 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-c473132e-a79e-4a64-b5f5-2719a4ec8ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:37.406372 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:37.454878 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 247/482] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:16:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:16:37.737756 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cf4018-9b34-4490-84f3-f322f4ff9c1a None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:37.817656 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b5313-67db-4bbb-ac06-0e96e3571a0d None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:37.818137 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b5313-67db-4bbb-ac06-0e96e3571a0d None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:37.818593 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b5313-67db-4bbb-ac06-0e96e3571a0d None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:37.825104 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 248/483] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:16:37 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:16:37.832583 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75812950-c2ca-4694-a303-5d999d4c4371 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:37.833069 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75812950-c2ca-4694-a303-5d999d4c4371 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:37.833341 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75812950-c2ca-4694-a303-5d999d4c4371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:37.845344 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:37.874283 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-75812950-c2ca-4694-a303-5d999d4c4371 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:37.875587 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-75812950-c2ca-4694-a303-5d999d4c4371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:37.887176 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cf4018-9b34-4490-84f3-f322f4ff9c1a None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:37.955060 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2b366-dfce-4642-9ff6-c1c298a5c38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:37.955727 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2b366-dfce-4642-9ff6-c1c298a5c38e None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:37.956525 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2b366-dfce-4642-9ff6-c1c298a5c38e None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:37.956802 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2b366-dfce-4642-9ff6-c1c298a5c38e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:37.978227 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b2b366-dfce-4642-9ff6-c1c298a5c38e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:16:37.983566 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-69b2b366-dfce-4642-9ff6-c1c298a5c38e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 01:16:37.983566 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:37.983566 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:37.983566 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:37.983566 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:37.983566 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:37.983566 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:37.983566 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:37.983566 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:37.983566 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:37.983566 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:37.983566 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:37.983566 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:16:37.983566 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:16:37.983566 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:16:37.983566 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:16:37.984616 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:16:37.984616 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:16:37.984616 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:16:37.984616 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:16:37.984616 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:37.984616 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:37.984616 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:37.984616 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:37.984616 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:37.984616 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:37.984616 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:37.984616 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:37.984616 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:37.984616 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:37.984616 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:37.984616 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:37.985593 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:37.985593 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:37.985593 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:37.985593 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:37.985593 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:16:37.985593 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:16:37.985593 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:16:37.985593 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:16:37.985593 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:16:37.985593 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:16:37.985593 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 01:16:37.985593 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:16:37.985593 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 236/484] 10.222.0.60 () {56 vars in 1102 bytes} [Tue Aug 30 01:16:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:37.992158 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2b366-dfce-4642-9ff6-c1c298a5c38e None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:38.000922 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 249/485] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:16:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:16:38.135215 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2b366-dfce-4642-9ff6-c1c298a5c38e None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:38.181880 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28830549-f204-4e6c-a347-ce290d1b11c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:38.182500 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28830549-f204-4e6c-a347-ce290d1b11c4 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:38.182777 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28830549-f204-4e6c-a347-ce290d1b11c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:38.183051 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28830549-f204-4e6c-a347-ce290d1b11c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:38.183819 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28830549-f204-4e6c-a347-ce290d1b11c4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:38.184128 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28830549-f204-4e6c-a347-ce290d1b11c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:38.185515 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28830549-f204-4e6c-a347-ce290d1b11c4 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:38.198635 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 237/486] 10.222.0.60 () {56 vars in 1103 bytes} [Tue Aug 30 01:16:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:38.204262 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75812950-c2ca-4694-a303-5d999d4c4371 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:38.217787 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9a73e-404b-4920-bf81-c3d84cdab92d None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:38.218067 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9a73e-404b-4920-bf81-c3d84cdab92d None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:38.218555 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9a73e-404b-4920-bf81-c3d84cdab92d None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:38.223481 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 238/487] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:16:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:16:38.225435 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e245a5-5db0-4b67-8896-da5025d791c9 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:38.225714 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e245a5-5db0-4b67-8896-da5025d791c9 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:38.225992 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e245a5-5db0-4b67-8896-da5025d791c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:38.232299 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:38.247459 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-26e245a5-5db0-4b67-8896-da5025d791c9 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:38.247459 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-26e245a5-5db0-4b67-8896-da5025d791c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:38.337717 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 239/488] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:16:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 01:16:38.338577 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e245a5-5db0-4b67-8896-da5025d791c9 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:38.350338 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:38.354669 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75812950-c2ca-4694-a303-5d999d4c4371 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:38.394916 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b8b62e-dd0b-4a3d-9bc7-655b6fca2901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:38.395601 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8b62e-dd0b-4a3d-9bc7-655b6fca2901 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:38.395887 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8b62e-dd0b-4a3d-9bc7-655b6fca2901 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:38.396163 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8b62e-dd0b-4a3d-9bc7-655b6fca2901 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:38.407144 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b8b62e-dd0b-4a3d-9bc7-655b6fca2901 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:38.408877 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b8b62e-dd0b-4a3d-9bc7-655b6fca2901 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:38.425028 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-68b8b62e-dd0b-4a3d-9bc7-655b6fca2901 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:38.425028 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:38.425028 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:38.425028 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:38.425028 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:38.425028 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:38.425028 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:38.425028 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:38.425028 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:38.425028 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:38.425028 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:38.425028 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:38.425028 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:16:38.425028 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:16:38.425028 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:16:38.425028 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:16:38.426003 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:38.426003 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:38.426003 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:38.426003 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:38.426003 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:38.426003 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:38.426003 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:38.426003 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:38.426003 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:38.426003 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:38.426003 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:38.426003 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:38.426003 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:38.426003 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:38.426003 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:38.426003 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:38.426003 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:16:38.426852 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:16:38.426852 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:38.426852 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:16:38.431009 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 250/489] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:16:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:38.432383 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b8b62e-dd0b-4a3d-9bc7-655b6fca2901 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:38.449326 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e245a5-5db0-4b67-8896-da5025d791c9 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:38.482680 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:38.488878 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be970ed-8420-4ff2-8f21-2cb228e9dc77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:38.489592 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be970ed-8420-4ff2-8f21-2cb228e9dc77 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:38.489964 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be970ed-8420-4ff2-8f21-2cb228e9dc77 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:38.490664 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be970ed-8420-4ff2-8f21-2cb228e9dc77 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:38.502638 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be970ed-8420-4ff2-8f21-2cb228e9dc77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:16:38.507993 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-4be970ed-8420-4ff2-8f21-2cb228e9dc77 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 01:16:38.507993 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:38.507993 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:38.507993 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:38.507993 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:38.507993 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:38.507993 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:38.507993 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:38.507993 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:38.507993 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:38.507993 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:38.507993 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:38.507993 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:16:38.507993 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:16:38.507993 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:16:38.507993 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:16:38.510021 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:16:38.510021 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:16:38.510021 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:16:38.510021 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:16:38.510021 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:38.510021 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:38.510021 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:38.510021 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:38.510021 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:38.510021 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:38.510021 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:38.510021 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:38.510021 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:38.510021 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:38.510021 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:38.510021 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:38.511952 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:38.511952 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:38.511952 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:38.511952 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:38.511952 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:16:38.511952 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:16:38.511952 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:16:38.511952 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:16:38.511952 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:16:38.511952 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:16:38.511952 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 01:16:38.511952 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:16:38.511952 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 240/490] 10.222.0.60 () {56 vars in 1102 bytes} [Tue Aug 30 01:16:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:38.519473 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be970ed-8420-4ff2-8f21-2cb228e9dc77 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:38.552537 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b8b62e-dd0b-4a3d-9bc7-655b6fca2901 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:38.589506 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb38636-f795-4f3d-8fe0-e2622ffbdfcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:38.590485 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb38636-f795-4f3d-8fe0-e2622ffbdfcd None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:38.590767 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb38636-f795-4f3d-8fe0-e2622ffbdfcd None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:38.591044 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb38636-f795-4f3d-8fe0-e2622ffbdfcd None admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:38.591742 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb38636-f795-4f3d-8fe0-e2622ffbdfcd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:38.592049 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb38636-f795-4f3d-8fe0-e2622ffbdfcd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:38.593650 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb38636-f795-4f3d-8fe0-e2622ffbdfcd None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:38.611654 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 251/491] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:16:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:38.613398 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb38636-f795-4f3d-8fe0-e2622ffbdfcd None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:38.625159 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be970ed-8420-4ff2-8f21-2cb228e9dc77 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:38.627328 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:38.673644 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e0261-5331-47c3-adfa-8c707774a124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:38.674158 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e0261-5331-47c3-adfa-8c707774a124 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:38.674434 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e0261-5331-47c3-adfa-8c707774a124 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:38.674697 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e0261-5331-47c3-adfa-8c707774a124 None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:38.675502 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30e0261-5331-47c3-adfa-8c707774a124 None admin] RBAC: Adding query filter params (name=service) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:38.675843 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30e0261-5331-47c3-adfa-8c707774a124 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:38.677320 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30e0261-5331-47c3-adfa-8c707774a124 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:38.693390 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 241/492] 10.222.0.60 () {56 vars in 1103 bytes} [Tue Aug 30 01:16:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:38.703008 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e0261-5331-47c3-adfa-8c707774a124 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:38.784522 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb38636-f795-4f3d-8fe0-e2622ffbdfcd None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:38.800350 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:38.822918 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194804e4-d4b2-4394-b7a5-007c3ed504c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:38.823587 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194804e4-d4b2-4394-b7a5-007c3ed504c5 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:38.823866 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194804e4-d4b2-4394-b7a5-007c3ed504c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:38.824137 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194804e4-d4b2-4394-b7a5-007c3ed504c5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:38.832730 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194804e4-d4b2-4394-b7a5-007c3ed504c5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:38.834412 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194804e4-d4b2-4394-b7a5-007c3ed504c5 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:38.837918 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e0261-5331-47c3-adfa-8c707774a124 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:38.848825 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-194804e4-d4b2-4394-b7a5-007c3ed504c5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 30 01:16:38.848825 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:38.848825 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:38.848825 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:38.848825 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:38.848825 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:38.848825 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:38.848825 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:38.848825 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:38.848825 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:38.848825 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:38.848825 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:38.848825 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 01:16:38.848825 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 01:16:38.848825 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 01:16:38.848825 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 01:16:38.849780 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:38.849780 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:38.849780 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 01:16:38.849780 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:16:38.849780 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 01:16:38.849780 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:16:38.849780 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:38.849780 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:38.849780 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:38.849780 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:38.849780 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:38.849780 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:38.849780 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:38.849780 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:38.849780 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:38.849780 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:38.849780 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:38.849780 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:38.850738 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:38.850738 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:38.850738 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 01:16:38.850738 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 01:16:38.850738 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 01:16:38.850738 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 01:16:38.850738 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 01:16:38.850738 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 01:16:38.850738 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 30 01:16:38.850738 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:16:38.850738 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 252/493] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 30 01:16:38 2022] GET /identity/v3/users/glance => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:38.851311 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194804e4-d4b2-4394-b7a5-007c3ed504c5 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:38.882987 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba6fbc7-1055-4277-aa24-f54da15d604d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:38.884615 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6fbc7-1055-4277-aa24-f54da15d604d None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:38.885218 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6fbc7-1055-4277-aa24-f54da15d604d None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:38.885846 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6fbc7-1055-4277-aa24-f54da15d604d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:38.900188 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba6fbc7-1055-4277-aa24-f54da15d604d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:38.901689 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba6fbc7-1055-4277-aa24-f54da15d604d None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:38.917309 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-cba6fbc7-1055-4277-aa24-f54da15d604d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:38.917309 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:38.917309 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:38.917309 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:38.917309 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:38.917309 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:38.917309 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:38.917309 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:38.917309 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:38.917309 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:38.917309 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:38.917309 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:38.917309 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:16:38.917309 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:16:38.917309 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:16:38.917309 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:16:38.918236 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:38.918236 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:38.918236 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:38.918236 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:38.918236 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:38.918236 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:38.918236 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:38.918236 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:38.918236 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:38.918236 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:38.918236 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:38.918236 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:38.918236 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:38.918236 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:38.918236 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:38.918236 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:38.918236 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:16:38.919082 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:16:38.919082 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:38.919082 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:16:38.919082 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 242/494] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:16:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:38.919754 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba6fbc7-1055-4277-aa24-f54da15d604d None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:38.935341 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:38.972881 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194804e4-d4b2-4394-b7a5-007c3ed504c5 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:39.012217 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b221189a-5b6f-4568-b438-9075817199e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:39.013284 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b221189a-5b6f-4568-b438-9075817199e9 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:39.013564 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b221189a-5b6f-4568-b438-9075817199e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:39.014010 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b221189a-5b6f-4568-b438-9075817199e9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:39.025215 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba6fbc7-1055-4277-aa24-f54da15d604d None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:39.025361 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b221189a-5b6f-4568-b438-9075817199e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:16:39.031523 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-b221189a-5b6f-4568-b438-9075817199e9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 01:16:39.031523 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:39.031523 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:39.031523 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:39.031523 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:39.031523 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:39.031523 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:39.031523 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:39.031523 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:39.031523 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:39.031523 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:39.031523 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:39.031523 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:16:39.031523 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:16:39.031523 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:16:39.031523 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:16:39.032412 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:16:39.032412 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:16:39.032412 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:16:39.032412 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:16:39.032412 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:39.032412 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:39.032412 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:39.032412 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:39.032412 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:39.032412 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:39.032412 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:39.032412 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:39.032412 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:39.032412 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:39.032412 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:39.032412 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:39.033222 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:39.033222 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:39.033222 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:39.033222 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:39.033222 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:16:39.033222 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:16:39.033222 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:16:39.033222 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:16:39.033222 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:16:39.033222 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:16:39.033222 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 01:16:39.033222 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:16:39.033222 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 253/495] 10.222.0.60 () {56 vars in 1102 bytes} [Tue Aug 30 01:16:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:39.033877 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b221189a-5b6f-4568-b438-9075817199e9 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:39.035302 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:39.065473 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a4134-f90b-471e-94ac-260eca506bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:39.066437 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a4134-f90b-471e-94ac-260eca506bd9 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:39.066718 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a4134-f90b-471e-94ac-260eca506bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:39.066980 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a4134-f90b-471e-94ac-260eca506bd9 None admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:39.067751 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1a4134-f90b-471e-94ac-260eca506bd9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:39.068079 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1a4134-f90b-471e-94ac-260eca506bd9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:39.069599 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1a4134-f90b-471e-94ac-260eca506bd9 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:39.106879 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 243/496] 10.222.0.60 () {56 vars in 1137 bytes} [Tue Aug 30 01:16:38 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:39.107977 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88c12d-99da-42ec-b874-716b4d2ed471 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:39.108249 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88c12d-99da-42ec-b874-716b4d2ed471 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:39.108547 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88c12d-99da-42ec-b874-716b4d2ed471 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:39.109851 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 244/497] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:16:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:16:39.110409 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e88c12d-99da-42ec-b874-716b4d2ed471 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:39.152367 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b221189a-5b6f-4568-b438-9075817199e9 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:39.189144 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:39.197102 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca947a6-5de0-4b02-b9da-9365b9261170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:39.197715 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca947a6-5de0-4b02-b9da-9365b9261170 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:39.197989 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca947a6-5de0-4b02-b9da-9365b9261170 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:39.198256 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca947a6-5de0-4b02-b9da-9365b9261170 None admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:39.198891 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca947a6-5de0-4b02-b9da-9365b9261170 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:39.199245 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca947a6-5de0-4b02-b9da-9365b9261170 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:39.200646 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca947a6-5de0-4b02-b9da-9365b9261170 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:39.217379 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 254/498] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:16:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:39.217965 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e88c12d-99da-42ec-b874-716b4d2ed471 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:39.218234 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca947a6-5de0-4b02-b9da-9365b9261170 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:39.255406 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa7fe8-cb11-479d-bc28-d2fc2fbe952a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:39.255919 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa7fe8-cb11-479d-bc28-d2fc2fbe952a None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:39.256194 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa7fe8-cb11-479d-bc28-d2fc2fbe952a None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:39.256507 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa7fe8-cb11-479d-bc28-d2fc2fbe952a None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:39.257193 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaa7fe8-cb11-479d-bc28-d2fc2fbe952a None admin] RBAC: Adding query filter params (name=service) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:39.257493 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaa7fe8-cb11-479d-bc28-d2fc2fbe952a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:39.258873 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaa7fe8-cb11-479d-bc28-d2fc2fbe952a None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:39.271922 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 245/499] 10.222.0.60 () {56 vars in 1103 bytes} [Tue Aug 30 01:16:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:39.271922 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1ac4f-c951-43bb-ac05-b23c7dcd0134 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:39.271922 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1ac4f-c951-43bb-ac05-b23c7dcd0134 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:39.271922 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1ac4f-c951-43bb-ac05-b23c7dcd0134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:39.289097 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-97e1ac4f-c951-43bb-ac05-b23c7dcd0134 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:39.290305 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-97e1ac4f-c951-43bb-ac05-b23c7dcd0134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:39.310707 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:39.340423 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca947a6-5de0-4b02-b9da-9365b9261170 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:39.359059 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 246/500] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:16:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:16:39.360687 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e1ac4f-c951-43bb-ac05-b23c7dcd0134 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:39.387706 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08193a54-671e-4bc3-9c71-73ff3aff803b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:39.388395 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08193a54-671e-4bc3-9c71-73ff3aff803b None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:39.388652 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08193a54-671e-4bc3-9c71-73ff3aff803b None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:39.388917 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08193a54-671e-4bc3-9c71-73ff3aff803b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:39.453215 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:39.467219 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08193a54-671e-4bc3-9c71-73ff3aff803b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:39.469236 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08193a54-671e-4bc3-9c71-73ff3aff803b None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:39.482311 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e1ac4f-c951-43bb-ac05-b23c7dcd0134 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:39.519541 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53196c63-a676-4fc9-a558-f58cd1c26b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:39.520165 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53196c63-a676-4fc9-a558-f58cd1c26b9e None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:39.520445 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53196c63-a676-4fc9-a558-f58cd1c26b9e None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:39.520717 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53196c63-a676-4fc9-a558-f58cd1c26b9e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:39.528182 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53196c63-a676-4fc9-a558-f58cd1c26b9e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:39.529772 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53196c63-a676-4fc9-a558-f58cd1c26b9e None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:39.543378 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-53196c63-a676-4fc9-a558-f58cd1c26b9e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 01:16:39.543378 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:39.543378 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:39.543378 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:39.543378 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:39.543378 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:39.543378 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:39.543378 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:39.543378 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:39.543378 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:39.543378 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:39.543378 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:39.543378 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 01:16:39.543378 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 01:16:39.543378 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 01:16:39.543378 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 01:16:39.544332 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:39.544332 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:39.544332 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 01:16:39.544332 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:16:39.544332 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 01:16:39.544332 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:16:39.544332 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:39.544332 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:39.544332 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:39.544332 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:39.544332 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:39.544332 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:39.544332 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:39.544332 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:39.544332 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:39.544332 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:39.544332 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:39.544332 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:39.545231 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:39.545231 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:39.545231 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 01:16:39.545231 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 01:16:39.545231 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 01:16:39.545231 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 01:16:39.545231 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 01:16:39.545231 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 01:16:39.545231 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 01:16:39.545231 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:16:39.545231 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 247/501] 10.222.0.60 () {56 vars in 1093 bytes} [Tue Aug 30 01:16:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:39.546481 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53196c63-a676-4fc9-a558-f58cd1c26b9e None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:39.567647 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:39.578186 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 255/502] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 30 01:16:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:39.579776 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d9758-fe4e-4728-99c3-d00e2dd36164 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:39.580013 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d9758-fe4e-4728-99c3-d00e2dd36164 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:39.580262 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d9758-fe4e-4728-99c3-d00e2dd36164 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:39.583560 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 256/503] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:16:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:16:39.583560 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d9758-fe4e-4728-99c3-d00e2dd36164 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:39.666092 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53196c63-a676-4fc9-a558-f58cd1c26b9e None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:39.683611 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:39.694556 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d9758-fe4e-4728-99c3-d00e2dd36164 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:39.700728 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a085fa61-c395-4eed-9339-6dadfbd4ffe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:39.701347 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085fa61-c395-4eed-9339-6dadfbd4ffe6 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:39.701627 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085fa61-c395-4eed-9339-6dadfbd4ffe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:39.701909 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085fa61-c395-4eed-9339-6dadfbd4ffe6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:39.712271 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a085fa61-c395-4eed-9339-6dadfbd4ffe6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:39.713676 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a085fa61-c395-4eed-9339-6dadfbd4ffe6 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:39.727694 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-a085fa61-c395-4eed-9339-6dadfbd4ffe6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:39.727694 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:39.727694 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:39.727694 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:39.727694 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:39.727694 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:39.727694 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:39.727694 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:39.727694 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:39.727694 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:39.727694 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:39.727694 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:39.727694 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:16:39.727694 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:16:39.727694 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:16:39.727694 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:16:39.728776 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:39.728776 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:39.728776 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:39.728776 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:39.728776 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:39.728776 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:39.728776 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:39.728776 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:39.728776 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:39.728776 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:39.728776 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:39.728776 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:39.728776 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:39.728776 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:39.728776 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:39.728776 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:39.728776 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:16:39.729810 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:16:39.729810 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:39.729810 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:16:39.730018 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2916f9e-3e45-49de-b73a-899ab97576d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:39.730018 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2916f9e-3e45-49de-b73a-899ab97576d8 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:39.730018 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2916f9e-3e45-49de-b73a-899ab97576d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:39.730018 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2916f9e-3e45-49de-b73a-899ab97576d8 None admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:39.730324 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2916f9e-3e45-49de-b73a-899ab97576d8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:39.730324 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2916f9e-3e45-49de-b73a-899ab97576d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:39.731572 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2916f9e-3e45-49de-b73a-899ab97576d8 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:39.731684 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 248/504] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:16:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:39.732595 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a085fa61-c395-4eed-9339-6dadfbd4ffe6 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:39.770542 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 257/505] 10.222.0.60 () {56 vars in 1133 bytes} [Tue Aug 30 01:16:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:39.771801 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8407c77-c7b8-43b3-81ba-289df432c9d5 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:39.772130 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8407c77-c7b8-43b3-81ba-289df432c9d5 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:39.772780 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8407c77-c7b8-43b3-81ba-289df432c9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:39.789905 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-b8407c77-c7b8-43b3-81ba-289df432c9d5 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:39.791081 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-b8407c77-c7b8-43b3-81ba-289df432c9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:39.800379 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:39.836197 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a085fa61-c395-4eed-9339-6dadfbd4ffe6 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:39.866691 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 258/506] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:16:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:16:39.867306 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8407c77-c7b8-43b3-81ba-289df432c9d5 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:39.881039 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49c5ae-df0e-42ae-8241-668a02c0cc05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:39.881677 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49c5ae-df0e-42ae-8241-668a02c0cc05 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:39.881955 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49c5ae-df0e-42ae-8241-668a02c0cc05 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:39.882461 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49c5ae-df0e-42ae-8241-668a02c0cc05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:39.893337 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e49c5ae-df0e-42ae-8241-668a02c0cc05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:39.894877 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e49c5ae-df0e-42ae-8241-668a02c0cc05 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:39.910135 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-7e49c5ae-df0e-42ae-8241-668a02c0cc05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:39.910135 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:39.910135 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:39.910135 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:39.910135 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:39.910135 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:39.910135 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:39.910135 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:39.910135 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:39.910135 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:39.910135 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:39.910135 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:39.910135 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:16:39.910135 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:16:39.910135 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:16:39.910135 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:16:39.911057 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:39.911057 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:39.911057 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:39.911057 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:39.911057 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:39.911057 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:39.911057 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:39.911057 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:39.911057 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:39.911057 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:39.911057 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:39.911057 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:39.911057 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:39.911057 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:39.911057 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:39.911057 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:39.911057 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:16:39.911946 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:16:39.911946 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:39.911946 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:16:39.911946 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 249/507] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:16:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:39.912159 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49c5ae-df0e-42ae-8241-668a02c0cc05 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:39.953605 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:39.980035 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8407c77-c7b8-43b3-81ba-289df432c9d5 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:40.016094 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485826ee-b1ee-4adb-bcc7-e9908b3b12b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:40.016722 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485826ee-b1ee-4adb-bcc7-e9908b3b12b1 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:40.016998 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485826ee-b1ee-4adb-bcc7-e9908b3b12b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:40.017276 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485826ee-b1ee-4adb-bcc7-e9908b3b12b1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:40.027459 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49c5ae-df0e-42ae-8241-668a02c0cc05 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:40.028678 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485826ee-b1ee-4adb-bcc7-e9908b3b12b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:16:40.033698 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-485826ee-b1ee-4adb-bcc7-e9908b3b12b1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 01:16:40.033698 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:40.033698 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:40.033698 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:40.033698 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:40.033698 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:40.033698 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:40.033698 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:40.033698 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:40.033698 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:40.033698 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:40.033698 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:40.033698 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:16:40.033698 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:16:40.033698 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:16:40.033698 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:16:40.034598 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:16:40.034598 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:16:40.034598 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:16:40.034598 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:16:40.034598 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:40.034598 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:40.034598 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:40.034598 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:40.034598 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:40.034598 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:40.034598 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:40.034598 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:40.034598 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:40.034598 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:40.034598 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:40.034598 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:40.035420 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:40.035420 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:40.035420 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:40.035420 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:40.035420 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:16:40.035420 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:16:40.035420 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:16:40.035420 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:16:40.035420 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:16:40.035420 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:16:40.035420 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 01:16:40.035420 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:16:40.035420 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 259/508] 10.222.0.60 () {56 vars in 1102 bytes} [Tue Aug 30 01:16:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:40.036125 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485826ee-b1ee-4adb-bcc7-e9908b3b12b1 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:40.057463 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:40.075770 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b67c3d-4e64-4771-8a7c-06a875b73434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:40.076377 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b67c3d-4e64-4771-8a7c-06a875b73434 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:40.076657 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b67c3d-4e64-4771-8a7c-06a875b73434 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:40.076931 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b67c3d-4e64-4771-8a7c-06a875b73434 None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:40.077580 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b67c3d-4e64-4771-8a7c-06a875b73434 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:40.077883 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b67c3d-4e64-4771-8a7c-06a875b73434 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:40.079262 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b67c3d-4e64-4771-8a7c-06a875b73434 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:40.096536 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 250/509] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:16:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:40.096536 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b67c3d-4e64-4771-8a7c-06a875b73434 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:40.147583 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485826ee-b1ee-4adb-bcc7-e9908b3b12b1 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:40.182077 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ac172-6882-4917-b379-180a14d99d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:40.182676 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ac172-6882-4917-b379-180a14d99d8c None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:40.182951 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ac172-6882-4917-b379-180a14d99d8c None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:40.183223 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ac172-6882-4917-b379-180a14d99d8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:40.191254 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:40.194887 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b67c3d-4e64-4771-8a7c-06a875b73434 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:40.229333 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c49e82-950b-4c18-86cc-048954673c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:40.229930 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c49e82-950b-4c18-86cc-048954673c56 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:40.230254 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c49e82-950b-4c18-86cc-048954673c56 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:40.230471 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c49e82-950b-4c18-86cc-048954673c56 None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:40.231100 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c49e82-950b-4c18-86cc-048954673c56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:40.231394 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c49e82-950b-4c18-86cc-048954673c56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:40.232782 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c49e82-950b-4c18-86cc-048954673c56 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:40.243647 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 251/510] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:16:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:40.244426 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c49e82-950b-4c18-86cc-048954673c56 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:40.252389 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36ac172-6882-4917-b379-180a14d99d8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:40.253883 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36ac172-6882-4917-b379-180a14d99d8c None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:40.287054 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:40.345780 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c49e82-950b-4c18-86cc-048954673c56 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:40.353529 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 260/511] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 30 01:16:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:40.354528 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ac172-6882-4917-b379-180a14d99d8c None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:40.379275 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5eed52-0019-481a-93ef-b819e14162a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:40.379916 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5eed52-0019-481a-93ef-b819e14162a7 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:40.380195 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5eed52-0019-481a-93ef-b819e14162a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:40.380463 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5eed52-0019-481a-93ef-b819e14162a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:40.381122 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5eed52-0019-481a-93ef-b819e14162a7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:40.381469 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5eed52-0019-481a-93ef-b819e14162a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:40.382941 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5eed52-0019-481a-93ef-b819e14162a7 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:40.390591 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 252/512] 10.222.0.60 () {56 vars in 1103 bytes} [Tue Aug 30 01:16:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:40.391354 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5eed52-0019-481a-93ef-b819e14162a7 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:40.397840 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:40.457771 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ac172-6882-4917-b379-180a14d99d8c None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:40.491231 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5eed52-0019-481a-93ef-b819e14162a7 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:40.491381 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b205695-1f22-49da-9259-c1d0b0678199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:40.492018 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b205695-1f22-49da-9259-c1d0b0678199 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:40.492295 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b205695-1f22-49da-9259-c1d0b0678199 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:40.492576 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b205695-1f22-49da-9259-c1d0b0678199 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:40.492713 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:40.499508 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b205695-1f22-49da-9259-c1d0b0678199 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:40.500960 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b205695-1f22-49da-9259-c1d0b0678199 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:40.512421 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-6b205695-1f22-49da-9259-c1d0b0678199 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 01:16:40.512421 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:40.512421 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:40.512421 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:40.512421 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:40.512421 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:40.512421 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:40.512421 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:40.512421 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:40.512421 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:40.512421 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:40.512421 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:40.512421 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 01:16:40.512421 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 01:16:40.512421 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 01:16:40.512421 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 01:16:40.513468 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:40.513468 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:40.513468 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 01:16:40.513468 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:16:40.513468 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 01:16:40.513468 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:16:40.513468 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:40.513468 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:40.513468 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:40.513468 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:40.513468 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:40.513468 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:40.513468 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:40.513468 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:40.513468 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:40.513468 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:40.513468 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:40.513468 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:40.514798 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:40.514798 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:40.514798 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 01:16:40.514798 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 01:16:40.514798 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 01:16:40.514798 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 01:16:40.514798 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 01:16:40.514798 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 01:16:40.514798 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 01:16:40.514798 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:16:40.514798 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 261/513] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 30 01:16:40 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:40.514798 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b205695-1f22-49da-9259-c1d0b0678199 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:40.535354 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168fb819-8d2e-4c44-aca2-c4fccd7b4fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:40.536095 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168fb819-8d2e-4c44-aca2-c4fccd7b4fc9 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:40.536369 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168fb819-8d2e-4c44-aca2-c4fccd7b4fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:40.536636 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168fb819-8d2e-4c44-aca2-c4fccd7b4fc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:40.550588 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168fb819-8d2e-4c44-aca2-c4fccd7b4fc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:40.552106 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168fb819-8d2e-4c44-aca2-c4fccd7b4fc9 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:40.566580 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-168fb819-8d2e-4c44-aca2-c4fccd7b4fc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:40.566580 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:40.566580 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:40.566580 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:40.566580 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:40.566580 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:40.566580 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:40.566580 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:40.566580 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:40.566580 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:40.566580 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:40.566580 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:40.566580 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:16:40.566580 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:16:40.566580 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:16:40.566580 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:16:40.567515 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:40.567515 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:40.567515 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:40.567515 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:40.567515 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:40.567515 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:40.567515 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:40.567515 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:40.567515 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:40.567515 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:40.567515 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:40.567515 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:40.567515 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:40.567515 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:40.567515 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:40.567515 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:40.567515 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:16:40.568362 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:16:40.568362 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:40.568362 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:16:40.568362 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 253/514] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:16:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:40.568588 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168fb819-8d2e-4c44-aca2-c4fccd7b4fc9 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:40.622255 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:40.626204 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b205695-1f22-49da-9259-c1d0b0678199 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:40.660028 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefdd13d-8dd9-4c53-a712-aff590f0dc29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:40.660642 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefdd13d-8dd9-4c53-a712-aff590f0dc29 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:40.660912 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefdd13d-8dd9-4c53-a712-aff590f0dc29 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:40.661183 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefdd13d-8dd9-4c53-a712-aff590f0dc29 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:40.667644 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefdd13d-8dd9-4c53-a712-aff590f0dc29 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:40.669145 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefdd13d-8dd9-4c53-a712-aff590f0dc29 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:40.670581 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168fb819-8d2e-4c44-aca2-c4fccd7b4fc9 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:40.681214 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-eefdd13d-8dd9-4c53-a712-aff590f0dc29 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:16:40.681214 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:40.681214 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:40.681214 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:40.681214 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:40.681214 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:40.681214 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:40.681214 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:40.681214 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:40.681214 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:40.681214 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:40.681214 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:40.681214 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 01:16:40.681214 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 01:16:40.681214 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 01:16:40.682089 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 01:16:40.682089 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:40.682089 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:40.682089 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:40.682089 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:40.682089 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:40.682089 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:40.682089 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:40.682089 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:40.682089 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:40.682089 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:40.682089 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:40.682089 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:40.682089 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:40.682089 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:40.682089 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:40.682089 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:40.682938 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 01:16:40.682938 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 01:16:40.682938 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 01:16:40.682938 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 01:16:40.682938 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 01:16:40.682938 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 01:16:40.682938 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:16:40.682938 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:16:40.682938 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 262/515] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 30 01:16:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:40.683401 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefdd13d-8dd9-4c53-a712-aff590f0dc29 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:40.710254 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d1257-3513-4efa-a1b3-abc1ebf757da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:40.710878 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d1257-3513-4efa-a1b3-abc1ebf757da None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:40.711160 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d1257-3513-4efa-a1b3-abc1ebf757da None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:40.711478 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d1257-3513-4efa-a1b3-abc1ebf757da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:40.722385 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6d1257-3513-4efa-a1b3-abc1ebf757da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:40.723894 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6d1257-3513-4efa-a1b3-abc1ebf757da None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:40.738009 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-ae6d1257-3513-4efa-a1b3-abc1ebf757da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:40.738009 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:40.738009 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:40.738009 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:40.738009 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:40.738009 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:40.738009 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:40.738009 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:40.738009 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:40.738009 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:40.738009 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:40.738009 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:40.738009 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:16:40.738009 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:16:40.738009 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:16:40.738009 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:16:40.738990 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:40.738990 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:40.738990 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:40.738990 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:40.738990 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:40.738990 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:40.738990 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:40.738990 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:40.738990 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:40.738990 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:40.738990 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:40.738990 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:40.738990 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:40.738990 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:40.738990 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:40.738990 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:40.738990 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:16:40.739871 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:16:40.739871 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:40.739871 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:16:40.739871 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 254/516] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:16:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:40.740097 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d1257-3513-4efa-a1b3-abc1ebf757da None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:40.750124 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:40.790734 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefdd13d-8dd9-4c53-a712-aff590f0dc29 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:40.824559 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b05c0e-86ea-45d7-afa0-9e1783f3a48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:40.825178 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b05c0e-86ea-45d7-afa0-9e1783f3a48e None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:40.825449 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b05c0e-86ea-45d7-afa0-9e1783f3a48e None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:40.825718 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b05c0e-86ea-45d7-afa0-9e1783f3a48e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:40.837017 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b05c0e-86ea-45d7-afa0-9e1783f3a48e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:40.838498 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b05c0e-86ea-45d7-afa0-9e1783f3a48e None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:40.842614 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d1257-3513-4efa-a1b3-abc1ebf757da None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:40.852835 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-86b05c0e-86ea-45d7-afa0-9e1783f3a48e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:40.852835 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:40.852835 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:40.852835 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:40.852835 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:40.852835 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:40.852835 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:40.852835 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:40.852835 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:40.852835 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:40.852835 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:40.852835 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:40.852835 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:16:40.852835 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:16:40.852835 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:16:40.852835 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:16:40.853704 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:40.853704 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:40.853704 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:40.853704 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:40.853704 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:40.853704 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:40.853704 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:40.853704 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:40.853704 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:40.853704 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:40.853704 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:40.853704 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:40.853704 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:40.853704 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:40.853704 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:40.853704 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:40.853704 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:16:40.854546 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:16:40.854546 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:40.854546 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:16:40.854546 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 263/517] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:16:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:40.854766 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b05c0e-86ea-45d7-afa0-9e1783f3a48e None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:40.866947 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:40.881902 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7fcaa8-9982-4297-8f31-dc875dde92fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:40.882506 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7fcaa8-9982-4297-8f31-dc875dde92fe None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:40.882783 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7fcaa8-9982-4297-8f31-dc875dde92fe None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:40.883054 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7fcaa8-9982-4297-8f31-dc875dde92fe None admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:40.883812 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7fcaa8-9982-4297-8f31-dc875dde92fe None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:40.884116 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7fcaa8-9982-4297-8f31-dc875dde92fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:40.885549 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7fcaa8-9982-4297-8f31-dc875dde92fe None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:40.905533 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 255/518] 10.222.0.60 () {56 vars in 1137 bytes} [Tue Aug 30 01:16:40 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:40.906359 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7fcaa8-9982-4297-8f31-dc875dde92fe None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:40.956605 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b05c0e-86ea-45d7-afa0-9e1783f3a48e None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:40.967127 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:40.990136 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc746e-e6c8-4253-868b-7b3348d8f8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:40.990745 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc746e-e6c8-4253-868b-7b3348d8f8e7 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:40.991100 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc746e-e6c8-4253-868b-7b3348d8f8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:40.991425 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc746e-e6c8-4253-868b-7b3348d8f8e7 None admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:40.992169 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efc746e-e6c8-4253-868b-7b3348d8f8e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:40.992471 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efc746e-e6c8-4253-868b-7b3348d8f8e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:40.993842 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efc746e-e6c8-4253-868b-7b3348d8f8e7 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:41.006179 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 264/519] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:16:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:41.006644 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7fcaa8-9982-4297-8f31-dc875dde92fe None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:41.006898 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc746e-e6c8-4253-868b-7b3348d8f8e7 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:41.040498 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d07d4-e94d-4ac3-8ae5-cf3799ad35a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:41.041097 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d07d4-e94d-4ac3-8ae5-cf3799ad35a3 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:41.041379 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d07d4-e94d-4ac3-8ae5-cf3799ad35a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:41.041649 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d07d4-e94d-4ac3-8ae5-cf3799ad35a3 None admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:41.042344 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342d07d4-e94d-4ac3-8ae5-cf3799ad35a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:41.042650 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342d07d4-e94d-4ac3-8ae5-cf3799ad35a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:41.044137 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342d07d4-e94d-4ac3-8ae5-cf3799ad35a3 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:41.061824 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 256/520] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 30 01:16:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:41.062428 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d07d4-e94d-4ac3-8ae5-cf3799ad35a3 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:41.075057 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:41.106253 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc746e-e6c8-4253-868b-7b3348d8f8e7 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:41.140202 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8e5c4a-ac44-4fcf-b984-7aa1cd8dbb5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:41.140803 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e5c4a-ac44-4fcf-b984-7aa1cd8dbb5a None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:41.141084 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e5c4a-ac44-4fcf-b984-7aa1cd8dbb5a None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:41.141358 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e5c4a-ac44-4fcf-b984-7aa1cd8dbb5a None admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:41.141992 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8e5c4a-ac44-4fcf-b984-7aa1cd8dbb5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:41.142298 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8e5c4a-ac44-4fcf-b984-7aa1cd8dbb5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:41.144290 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8e5c4a-ac44-4fcf-b984-7aa1cd8dbb5a None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:41.155199 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 265/521] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:16:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:41.156018 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8e5c4a-ac44-4fcf-b984-7aa1cd8dbb5a None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:41.166052 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d07d4-e94d-4ac3-8ae5-cf3799ad35a3 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:41.189315 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:41.200759 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accde6d3-9494-49c5-ba31-58f1d9ff3bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:41.201354 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accde6d3-9494-49c5-ba31-58f1d9ff3bc0 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:41.201684 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accde6d3-9494-49c5-ba31-58f1d9ff3bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:41.201958 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accde6d3-9494-49c5-ba31-58f1d9ff3bc0 None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:41.202591 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accde6d3-9494-49c5-ba31-58f1d9ff3bc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:41.202886 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accde6d3-9494-49c5-ba31-58f1d9ff3bc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:41.204293 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accde6d3-9494-49c5-ba31-58f1d9ff3bc0 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:41.216313 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 257/522] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:16:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:41.217095 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accde6d3-9494-49c5-ba31-58f1d9ff3bc0 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:41.255807 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8e5c4a-ac44-4fcf-b984-7aa1cd8dbb5a None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:41.283627 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:41.290999 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be60645-43a4-44cd-949d-b5319ae82d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:41.291632 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be60645-43a4-44cd-949d-b5319ae82d55 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:41.291947 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be60645-43a4-44cd-949d-b5319ae82d55 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:41.292216 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be60645-43a4-44cd-949d-b5319ae82d55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:41.318136 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accde6d3-9494-49c5-ba31-58f1d9ff3bc0 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:41.351976 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b8c1c2-83d5-4fae-988a-3698c1283e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:41.352577 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8c1c2-83d5-4fae-988a-3698c1283e90 None admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:41.352855 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8c1c2-83d5-4fae-988a-3698c1283e90 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:41.353138 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8c1c2-83d5-4fae-988a-3698c1283e90 None admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:41.353780 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b8c1c2-83d5-4fae-988a-3698c1283e90 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:41.355239 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b8c1c2-83d5-4fae-988a-3698c1283e90 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:41.361504 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be60645-43a4-44cd-949d-b5319ae82d55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:41.363006 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be60645-43a4-44cd-949d-b5319ae82d55 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:41.375672 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 258/523] 10.222.0.60 () {60 vars in 1132 bytes} [Tue Aug 30 01:16:41 2022] POST /identity/v3/users => generated 247 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:16:41.376523 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b8c1c2-83d5-4fae-988a-3698c1283e90 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:41.427614 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:41.490044 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 266/524] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 30 01:16:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:41.490044 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be60645-43a4-44cd-949d-b5319ae82d55 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:41.503699 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b8c1c2-83d5-4fae-988a-3698c1283e90 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:41.524878 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:41.543590 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f08d9d-97be-4eff-b547-3bad8ef78062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:41.544127 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f08d9d-97be-4eff-b547-3bad8ef78062 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:41.544402 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f08d9d-97be-4eff-b547-3bad8ef78062 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:41.544759 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f08d9d-97be-4eff-b547-3bad8ef78062 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:41.545492 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f08d9d-97be-4eff-b547-3bad8ef78062 None admin] RBAC: Adding query filter params (role.id=01439ffbf0dd41caadd0cc40b3176062, scope.project.id=b050b2dad22a4a06875072e44c8c9824, user.id=2de6decc90df4df58217d5eed9c5e190) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:41.545797 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f08d9d-97be-4eff-b547-3bad8ef78062 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:41.547474 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f08d9d-97be-4eff-b547-3bad8ef78062 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:41.553464 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 259/525] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 30 01:16:41 2022] GET /identity/v3/role_assignments?user.id=2de6decc90df4df58217d5eed9c5e190&scope.project.id=b050b2dad22a4a06875072e44c8c9824&role.id=01439ffbf0dd41caadd0cc40b3176062 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:41.554298 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f08d9d-97be-4eff-b547-3bad8ef78062 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:41.656330 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be60645-43a4-44cd-949d-b5319ae82d55 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:41.691364 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f08d9d-97be-4eff-b547-3bad8ef78062 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:41.697126 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:41.710435 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bc4185-5567-4972-ac81-5eb17f2f81fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:41.711090 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bc4185-5567-4972-ac81-5eb17f2f81fa None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:41.711372 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bc4185-5567-4972-ac81-5eb17f2f81fa None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:41.711925 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bc4185-5567-4972-ac81-5eb17f2f81fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:41.723675 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bc4185-5567-4972-ac81-5eb17f2f81fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:41.725195 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bc4185-5567-4972-ac81-5eb17f2f81fa None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:41.738077 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6739adfe-c3c0-46d3-8272-b8925fdad46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:41.738847 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739adfe-c3c0-46d3-8272-b8925fdad46b None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:41.739221 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739adfe-c3c0-46d3-8272-b8925fdad46b None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:41.739784 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739adfe-c3c0-46d3-8272-b8925fdad46b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:41.743382 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-d4bc4185-5567-4972-ac81-5eb17f2f81fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:16:41.743382 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:41.743382 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:41.743382 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:41.743382 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:41.743382 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:41.743382 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:41.743382 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:41.743382 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:41.743382 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:41.743382 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:41.743382 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:41.743382 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 01:16:41.743382 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 01:16:41.743382 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 01:16:41.744326 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 01:16:41.744326 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:41.744326 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:41.744326 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:41.744326 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:41.744326 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:41.744326 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:41.744326 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:41.744326 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:41.744326 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:41.744326 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:41.744326 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:41.744326 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:41.744326 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:41.744326 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:41.744326 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:41.744326 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:41.745214 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 01:16:41.745214 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 01:16:41.745214 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 01:16:41.745214 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 01:16:41.745214 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 01:16:41.745214 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 01:16:41.745214 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:16:41.745214 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:16:41.745214 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 267/526] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 30 01:16:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:41.745747 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bc4185-5567-4972-ac81-5eb17f2f81fa None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:41.753315 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6739adfe-c3c0-46d3-8272-b8925fdad46b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:41.754790 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6739adfe-c3c0-46d3-8272-b8925fdad46b None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:41.767075 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-6739adfe-c3c0-46d3-8272-b8925fdad46b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 01:16:41.767075 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:41.767075 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:41.767075 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:41.767075 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:41.767075 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:41.767075 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:41.767075 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:41.767075 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:41.767075 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:41.767075 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:41.767075 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:41.767075 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 01:16:41.767075 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 01:16:41.767075 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 01:16:41.767075 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 01:16:41.769299 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:41.769299 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:41.769299 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 01:16:41.769299 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:16:41.769299 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 01:16:41.769299 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:16:41.769299 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:41.769299 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:41.769299 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:41.769299 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:41.769299 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:41.769299 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:41.769299 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:41.769299 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:41.769299 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:41.769299 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:41.769299 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:41.769299 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:41.770244 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:41.770244 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:41.770244 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 01:16:41.770244 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 01:16:41.770244 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 01:16:41.770244 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 01:16:41.770244 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 01:16:41.770244 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 01:16:41.770244 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 01:16:41.770244 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:16:41.775118 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 260/527] 10.222.0.60 () {56 vars in 1102 bytes} [Tue Aug 30 01:16:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:41.776030 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6739adfe-c3c0-46d3-8272-b8925fdad46b None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:41.856235 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:41.870228 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bc4185-5567-4972-ac81-5eb17f2f81fa None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:41.883209 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6739adfe-c3c0-46d3-8272-b8925fdad46b None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:41.917861 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7f71c6-e6e3-4789-8762-c15e460c5dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:41.919017 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f71c6-e6e3-4789-8762-c15e460c5dbd None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:41.919550 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f71c6-e6e3-4789-8762-c15e460c5dbd None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:41.919966 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f71c6-e6e3-4789-8762-c15e460c5dbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:41.920097 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364177d4-b407-4dd7-8868-3283dbdb41bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:41.920704 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364177d4-b407-4dd7-8868-3283dbdb41bd None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:41.920974 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364177d4-b407-4dd7-8868-3283dbdb41bd None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:41.921249 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364177d4-b407-4dd7-8868-3283dbdb41bd None admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:41.921942 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364177d4-b407-4dd7-8868-3283dbdb41bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:41.922241 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364177d4-b407-4dd7-8868-3283dbdb41bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:41.923704 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364177d4-b407-4dd7-8868-3283dbdb41bd None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:41.932912 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7f71c6-e6e3-4789-8762-c15e460c5dbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:41.934650 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7f71c6-e6e3-4789-8762-c15e460c5dbd None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:41.941293 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 261/528] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 30 01:16:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:41.942405 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364177d4-b407-4dd7-8868-3283dbdb41bd None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:41.950737 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-1b7f71c6-e6e3-4789-8762-c15e460c5dbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:41.950737 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:41.950737 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:41.950737 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:41.950737 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:41.950737 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:41.950737 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:41.950737 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:41.950737 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:41.950737 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:41.950737 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:41.950737 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:41.950737 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:16:41.950737 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:16:41.950737 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:16:41.950737 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:16:41.951931 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:41.951931 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:41.951931 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:41.951931 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:41.951931 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:41.951931 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:41.951931 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:41.951931 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:41.951931 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:41.951931 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:41.951931 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:41.951931 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:41.951931 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:41.951931 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:41.951931 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:41.951931 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:41.951931 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:16:41.952909 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:16:41.952909 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:41.952909 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:16:41.959286 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 268/529] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:16:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:41.960345 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7f71c6-e6e3-4789-8762-c15e460c5dbd None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:41.968734 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:42.049290 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364177d4-b407-4dd7-8868-3283dbdb41bd None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:42.071796 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7f71c6-e6e3-4789-8762-c15e460c5dbd None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:42.087077 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b5766b-aac6-4712-be4d-c0c3840b8904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:42.087719 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5766b-aac6-4712-be4d-c0c3840b8904 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:42.087997 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5766b-aac6-4712-be4d-c0c3840b8904 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:42.088269 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5766b-aac6-4712-be4d-c0c3840b8904 None admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:42.089001 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b5766b-aac6-4712-be4d-c0c3840b8904 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:42.089302 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b5766b-aac6-4712-be4d-c0c3840b8904 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:42.091117 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b5766b-aac6-4712-be4d-c0c3840b8904 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:42.109930 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d00066a-39c2-4130-82bd-6c9140d75326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:42.110754 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00066a-39c2-4130-82bd-6c9140d75326 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:42.111307 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00066a-39c2-4130-82bd-6c9140d75326 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:42.111737 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00066a-39c2-4130-82bd-6c9140d75326 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:42.112663 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d00066a-39c2-4130-82bd-6c9140d75326 None admin] RBAC: Adding query filter params (role.id=01439ffbf0dd41caadd0cc40b3176062, scope.project.id=b050b2dad22a4a06875072e44c8c9824, user.id=8889145228a24fb6bd539a11925e62f2) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:42.113113 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d00066a-39c2-4130-82bd-6c9140d75326 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:42.114760 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 262/530] 10.222.0.60 () {56 vars in 1139 bytes} [Tue Aug 30 01:16:41 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:42.115316 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d00066a-39c2-4130-82bd-6c9140d75326 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:42.115656 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b5766b-aac6-4712-be4d-c0c3840b8904 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:42.121696 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 269/531] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 30 01:16:41 2022] GET /identity/v3/role_assignments?user.id=8889145228a24fb6bd539a11925e62f2&scope.project.id=b050b2dad22a4a06875072e44c8c9824&role.id=01439ffbf0dd41caadd0cc40b3176062 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:42.122728 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d00066a-39c2-4130-82bd-6c9140d75326 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:42.138826 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:42.296791 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:42.318207 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d00066a-39c2-4130-82bd-6c9140d75326 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:42.334072 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b5766b-aac6-4712-be4d-c0c3840b8904 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:42.380655 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6136e4cc-68ec-4679-b86b-52b48015590d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:42.381265 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6136e4cc-68ec-4679-b86b-52b48015590d None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:42.381540 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6136e4cc-68ec-4679-b86b-52b48015590d None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:42.381809 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6136e4cc-68ec-4679-b86b-52b48015590d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:42.398209 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc978d32-c85b-4927-b278-e4d90a2cbb8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:42.398823 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc978d32-c85b-4927-b278-e4d90a2cbb8e None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:42.399095 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc978d32-c85b-4927-b278-e4d90a2cbb8e None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:42.399359 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc978d32-c85b-4927-b278-e4d90a2cbb8e None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:42.400030 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc978d32-c85b-4927-b278-e4d90a2cbb8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:42.400468 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc978d32-c85b-4927-b278-e4d90a2cbb8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:42.401845 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc978d32-c85b-4927-b278-e4d90a2cbb8e None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:42.427424 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 263/532] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:16:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:42.432887 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc978d32-c85b-4927-b278-e4d90a2cbb8e None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:42.515160 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6136e4cc-68ec-4679-b86b-52b48015590d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:42.521187 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6136e4cc-68ec-4679-b86b-52b48015590d None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:42.531832 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:42.580069 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc978d32-c85b-4927-b278-e4d90a2cbb8e None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:42.656630 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db546a7-4301-4ef9-b6b8-14bd3344c7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:42.657172 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db546a7-4301-4ef9-b6b8-14bd3344c7bf None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:42.657450 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db546a7-4301-4ef9-b6b8-14bd3344c7bf None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:42.660193 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db546a7-4301-4ef9-b6b8-14bd3344c7bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:42.677661 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db546a7-4301-4ef9-b6b8-14bd3344c7bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:42.679168 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db546a7-4301-4ef9-b6b8-14bd3344c7bf None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:42.701331 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-6db546a7-4301-4ef9-b6b8-14bd3344c7bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:16:42.701331 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:42.701331 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:42.701331 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:42.701331 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:42.701331 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:42.701331 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:42.701331 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:42.701331 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:42.701331 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:42.701331 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:42.701331 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:42.701331 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 01:16:42.701331 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 01:16:42.701331 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 01:16:42.702212 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 01:16:42.702212 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:42.702212 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:42.702212 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:42.702212 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:42.702212 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:42.702212 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:42.702212 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:42.702212 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:42.702212 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:42.702212 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:42.702212 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:42.702212 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:42.702212 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:42.702212 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:42.702212 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:42.702212 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:42.703041 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 01:16:42.703041 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 01:16:42.703041 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 01:16:42.703041 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 01:16:42.703041 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 01:16:42.703041 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 01:16:42.703041 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:16:42.703041 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:16:42.709115 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 270/533] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 30 01:16:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 586 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:42.711862 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 264/534] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 30 01:16:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:42.714521 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6136e4cc-68ec-4679-b86b-52b48015590d None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:42.717607 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db546a7-4301-4ef9-b6b8-14bd3344c7bf None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:42.724687 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:42.839276 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6136e4cc-68ec-4679-b86b-52b48015590d None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:42.848184 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:42.895400 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f769e9-62fe-40a7-9be5-10d66db6e74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:42.896058 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f769e9-62fe-40a7-9be5-10d66db6e74f None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:42.896336 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f769e9-62fe-40a7-9be5-10d66db6e74f None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:42.896606 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f769e9-62fe-40a7-9be5-10d66db6e74f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:42.920715 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f769e9-62fe-40a7-9be5-10d66db6e74f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:42.922109 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f769e9-62fe-40a7-9be5-10d66db6e74f None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:42.936102 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db546a7-4301-4ef9-b6b8-14bd3344c7bf None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:42.950018 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-29f769e9-62fe-40a7-9be5-10d66db6e74f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:42.950018 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:42.950018 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:42.950018 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:42.950018 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:42.950018 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:42.950018 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:42.950018 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:42.950018 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:42.950018 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:42.950018 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:42.950018 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:42.950018 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:16:42.950018 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:16:42.950018 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:16:42.950018 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:16:42.952198 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:42.952198 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:42.952198 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:42.952198 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:42.952198 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:42.952198 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:42.952198 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:42.952198 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:42.952198 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:42.952198 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:42.952198 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:42.952198 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:42.952198 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:42.952198 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:42.952198 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:42.952198 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:42.952198 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:16:42.954280 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:16:42.954280 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:42.954280 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:16:42.959463 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 271/535] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:16:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:16:42.960337 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f769e9-62fe-40a7-9be5-10d66db6e74f None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:42.985929 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8cb49b-7ecb-415c-80e6-6c424af8d9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:42.986543 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8cb49b-7ecb-415c-80e6-6c424af8d9b1 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:42.986829 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8cb49b-7ecb-415c-80e6-6c424af8d9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:42.987154 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8cb49b-7ecb-415c-80e6-6c424af8d9b1 None admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:42.988662 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8cb49b-7ecb-415c-80e6-6c424af8d9b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:42.988662 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8cb49b-7ecb-415c-80e6-6c424af8d9b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:42.989913 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8cb49b-7ecb-415c-80e6-6c424af8d9b1 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:43.004206 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 265/536] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 30 01:16:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:43.009989 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8cb49b-7ecb-415c-80e6-6c424af8d9b1 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:43.084070 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:43.141431 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8cb49b-7ecb-415c-80e6-6c424af8d9b1 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:43.182516 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09924e4c-346c-4a71-95fc-0d716eed5fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:43.183045 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09924e4c-346c-4a71-95fc-0d716eed5fbf None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:43.183324 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09924e4c-346c-4a71-95fc-0d716eed5fbf None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:43.183623 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09924e4c-346c-4a71-95fc-0d716eed5fbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:43.184363 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09924e4c-346c-4a71-95fc-0d716eed5fbf None admin] RBAC: Adding query filter params (role.id=01439ffbf0dd41caadd0cc40b3176062, scope.project.id=b050b2dad22a4a06875072e44c8c9824, user.id=e3040f72d52249f1b0e19e3a200bd16e) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:43.184673 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09924e4c-346c-4a71-95fc-0d716eed5fbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:43.186130 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09924e4c-346c-4a71-95fc-0d716eed5fbf None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:43.193549 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 266/537] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 30 01:16:43 2022] GET /identity/v3/role_assignments?user.id=e3040f72d52249f1b0e19e3a200bd16e&scope.project.id=b050b2dad22a4a06875072e44c8c9824&role.id=01439ffbf0dd41caadd0cc40b3176062 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:43.201733 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f769e9-62fe-40a7-9be5-10d66db6e74f None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:43.257788 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f6d30-505d-4425-8713-ddce21b03aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:43.258410 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f6d30-505d-4425-8713-ddce21b03aa5 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:43.258689 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f6d30-505d-4425-8713-ddce21b03aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:43.258957 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f6d30-505d-4425-8713-ddce21b03aa5 None admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:43.259644 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2f6d30-505d-4425-8713-ddce21b03aa5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:43.259952 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2f6d30-505d-4425-8713-ddce21b03aa5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:43.261361 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2f6d30-505d-4425-8713-ddce21b03aa5 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:43.280843 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 272/538] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:16:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:43.286390 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09924e4c-346c-4a71-95fc-0d716eed5fbf None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:43.421837 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09924e4c-346c-4a71-95fc-0d716eed5fbf None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:43.449768 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:43.460577 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4327a00f-1ffc-468f-8de7-7649c285f025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:43.461439 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4327a00f-1ffc-468f-8de7-7649c285f025 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:43.461899 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4327a00f-1ffc-468f-8de7-7649c285f025 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:43.462404 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4327a00f-1ffc-468f-8de7-7649c285f025 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:43.469657 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4327a00f-1ffc-468f-8de7-7649c285f025 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:43.471112 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4327a00f-1ffc-468f-8de7-7649c285f025 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:43.483357 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-4327a00f-1ffc-468f-8de7-7649c285f025 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:16:43.483357 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:43.483357 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:43.483357 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:43.483357 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:43.483357 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:43.483357 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:43.483357 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:43.483357 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:43.483357 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:43.483357 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:43.483357 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:43.483357 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 01:16:43.483357 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 01:16:43.483357 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 01:16:43.484273 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 01:16:43.484273 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:43.484273 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:43.484273 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:43.484273 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:43.484273 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:43.484273 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:43.484273 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:43.484273 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:43.484273 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:43.484273 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:43.484273 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:43.484273 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:43.484273 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:43.484273 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:43.484273 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:43.484273 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:43.485108 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 01:16:43.485108 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 01:16:43.485108 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 01:16:43.485108 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 01:16:43.485108 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 01:16:43.485108 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 01:16:43.485108 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:16:43.485108 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:16:43.485108 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 267/539] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 30 01:16:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:43.490584 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f6d30-505d-4425-8713-ddce21b03aa5 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:43.524644 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:43.536293 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10755711-75f4-4f5f-b44b-a2ec4eecd2f1 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:43.536790 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10755711-75f4-4f5f-b44b-a2ec4eecd2f1 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:43.537972 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10755711-75f4-4f5f-b44b-a2ec4eecd2f1 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:43.540362 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 268/540] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:16:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:16:43.548671 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064302f-43d3-4420-8915-06e914dc2095 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:43.549146 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064302f-43d3-4420-8915-06e914dc2095 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:43.549867 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064302f-43d3-4420-8915-06e914dc2095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:43.571922 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-0064302f-43d3-4420-8915-06e914dc2095 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:43.573366 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-0064302f-43d3-4420-8915-06e914dc2095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:43.670553 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f6d30-505d-4425-8713-ddce21b03aa5 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:43.677538 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 269/541] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:16:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 01:16:43.726999 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a044ac0d-ac31-42e5-9e8f-119709c72d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:43.727892 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044ac0d-ac31-42e5-9e8f-119709c72d18 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:43.728327 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044ac0d-ac31-42e5-9e8f-119709c72d18 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:43.728736 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044ac0d-ac31-42e5-9e8f-119709c72d18 None admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:43.729577 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a044ac0d-ac31-42e5-9e8f-119709c72d18 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:43.730047 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a044ac0d-ac31-42e5-9e8f-119709c72d18 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:43.731646 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a044ac0d-ac31-42e5-9e8f-119709c72d18 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:43.763675 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 273/542] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 30 01:16:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:43.772547 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0064302f-43d3-4420-8915-06e914dc2095 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:43.784914 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f0ab5-46b4-4325-83bf-c17cafa816c8 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:43.785414 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f0ab5-46b4-4325-83bf-c17cafa816c8 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:43.785862 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f0ab5-46b4-4325-83bf-c17cafa816c8 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:43.787630 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 274/543] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:16:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:16:43.792800 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe9ec37-0c47-4819-9e08-935395ee5888 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:43.793253 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe9ec37-0c47-4819-9e08-935395ee5888 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:43.793675 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe9ec37-0c47-4819-9e08-935395ee5888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:43.814495 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-2fe9ec37-0c47-4819-9e08-935395ee5888 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:43.816295 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-2fe9ec37-0c47-4819-9e08-935395ee5888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:43.896587 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 275/544] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:16:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 01:16:43.951919 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0064302f-43d3-4420-8915-06e914dc2095 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:43.973980 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:43.997510 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c31d5-379e-42d3-8468-065b86823fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:43.998386 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c31d5-379e-42d3-8468-065b86823fd9 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:43.998846 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c31d5-379e-42d3-8468-065b86823fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:43.999297 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c31d5-379e-42d3-8468-065b86823fd9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:44.000226 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1c31d5-379e-42d3-8468-065b86823fd9 None admin] RBAC: Adding query filter params (role.id=01439ffbf0dd41caadd0cc40b3176062, scope.project.id=b050b2dad22a4a06875072e44c8c9824, user.id=61e48e00a0c34949a4fffae8c372304e) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:44.000751 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1c31d5-379e-42d3-8468-065b86823fd9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:44.002381 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1c31d5-379e-42d3-8468-065b86823fd9 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:44.014670 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 270/545] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 30 01:16:43 2022] GET /identity/v3/role_assignments?user.id=61e48e00a0c34949a4fffae8c372304e&scope.project.id=b050b2dad22a4a06875072e44c8c9824&role.id=01439ffbf0dd41caadd0cc40b3176062 => generated 259 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:44.118118 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe9ec37-0c47-4819-9e08-935395ee5888 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:44.130797 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:44.241206 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe9ec37-0c47-4819-9e08-935395ee5888 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:44.276987 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146a3252-07a8-40b7-a99d-df6322a90462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:44.277935 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a3252-07a8-40b7-a99d-df6322a90462 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:44.278430 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a3252-07a8-40b7-a99d-df6322a90462 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:44.278923 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a3252-07a8-40b7-a99d-df6322a90462 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:44.290157 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146a3252-07a8-40b7-a99d-df6322a90462 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:16:44.295328 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-146a3252-07a8-40b7-a99d-df6322a90462 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 01:16:44.295328 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:44.295328 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:44.295328 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:44.295328 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:44.295328 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:44.295328 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:44.295328 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:44.295328 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:44.295328 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:44.295328 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:44.295328 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:44.295328 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:16:44.295328 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:16:44.295328 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:16:44.295328 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:16:44.296215 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:16:44.296215 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:16:44.296215 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:16:44.296215 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:16:44.296215 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:44.296215 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:44.296215 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:44.296215 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:44.296215 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:44.296215 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:44.296215 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:44.296215 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:44.296215 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:44.296215 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:44.296215 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:44.296215 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:44.297023 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:44.297023 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:44.297023 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:44.297023 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:44.297023 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:16:44.297023 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:16:44.297023 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:16:44.297023 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:16:44.297023 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:16:44.297023 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:16:44.297023 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 01:16:44.297023 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:16:44.300120 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 276/546] 10.222.0.60 () {56 vars in 1102 bytes} [Tue Aug 30 01:16:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:44.308769 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c31d5-379e-42d3-8468-065b86823fd9 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:44.319136 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146a3252-07a8-40b7-a99d-df6322a90462 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:44.410749 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:44.458032 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c31d5-379e-42d3-8468-065b86823fd9 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:44.463136 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146a3252-07a8-40b7-a99d-df6322a90462 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:44.497756 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284358a0-39a5-4772-9baf-8a62de36212d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:44.498713 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284358a0-39a5-4772-9baf-8a62de36212d None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:44.499418 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284358a0-39a5-4772-9baf-8a62de36212d None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:44.499864 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284358a0-39a5-4772-9baf-8a62de36212d None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:44.501225 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284358a0-39a5-4772-9baf-8a62de36212d None admin] RBAC: Adding query filter params (name=service) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:44.501808 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284358a0-39a5-4772-9baf-8a62de36212d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:44.504057 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284358a0-39a5-4772-9baf-8a62de36212d None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:44.509666 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0c49ef-6630-4bba-b84b-f0ab6291287f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:44.510431 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c49ef-6630-4bba-b84b-f0ab6291287f None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:44.510886 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c49ef-6630-4bba-b84b-f0ab6291287f None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:44.511896 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c49ef-6630-4bba-b84b-f0ab6291287f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:44.517471 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 271/547] 10.222.0.60 () {56 vars in 1103 bytes} [Tue Aug 30 01:16:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:44.519018 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63795f5-5d91-423b-882b-a8a688e79d0c None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:44.519737 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63795f5-5d91-423b-882b-a8a688e79d0c None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:44.520230 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63795f5-5d91-423b-882b-a8a688e79d0c None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:44.521964 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 272/548] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:16:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:16:44.528450 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0c49ef-6630-4bba-b84b-f0ab6291287f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:16:44.529041 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3a670-9c8d-4b07-ae7f-3c7a6eeef46a None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:44.529251 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3a670-9c8d-4b07-ae7f-3c7a6eeef46a None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:44.529528 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3a670-9c8d-4b07-ae7f-3c7a6eeef46a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:44.535173 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-6e0c49ef-6630-4bba-b84b-f0ab6291287f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 01:16:44.535173 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:44.535173 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:44.535173 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:44.535173 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:44.535173 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:44.535173 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:44.535173 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:44.535173 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:44.535173 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:44.535173 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:44.535173 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:44.535173 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:16:44.535173 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:16:44.535173 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:16:44.535173 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:16:44.536117 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:16:44.536117 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:16:44.536117 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:16:44.536117 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:16:44.536117 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:44.536117 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:44.536117 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:44.536117 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:44.536117 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:44.536117 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:44.536117 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:44.536117 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:44.536117 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:44.536117 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:44.536117 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:44.536117 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:44.536895 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:44.536895 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:44.536895 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:44.536895 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:44.536895 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:16:44.536895 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:16:44.536895 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:16:44.536895 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:16:44.536895 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:16:44.536895 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:16:44.536895 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 01:16:44.536895 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:16:44.540822 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 277/549] 10.222.0.60 () {56 vars in 1102 bytes} [Tue Aug 30 01:16:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:44.542080 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0c49ef-6630-4bba-b84b-f0ab6291287f None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:44.552262 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-30f3a670-9c8d-4b07-ae7f-3c7a6eeef46a None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:44.553481 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-30f3a670-9c8d-4b07-ae7f-3c7a6eeef46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:44.599841 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:44.639021 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 273/550] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:16:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:16:44.639980 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f3a670-9c8d-4b07-ae7f-3c7a6eeef46a None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:44.670559 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0c49ef-6630-4bba-b84b-f0ab6291287f None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:44.702123 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:44.713510 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778259e2-477b-4c6d-9efe-2e9b39911f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:44.714447 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778259e2-477b-4c6d-9efe-2e9b39911f92 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:44.714930 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778259e2-477b-4c6d-9efe-2e9b39911f92 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:44.715687 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778259e2-477b-4c6d-9efe-2e9b39911f92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:44.728340 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778259e2-477b-4c6d-9efe-2e9b39911f92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:44.730450 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778259e2-477b-4c6d-9efe-2e9b39911f92 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:44.757985 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-778259e2-477b-4c6d-9efe-2e9b39911f92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:44.757985 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:44.757985 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:44.757985 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:44.757985 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:44.757985 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:44.757985 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:44.757985 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:44.757985 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:44.757985 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:44.757985 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:44.757985 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:44.757985 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:16:44.757985 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:16:44.757985 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:16:44.757985 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:16:44.759207 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:44.759207 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:44.759207 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:44.759207 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:44.759207 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:44.759207 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:44.759207 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:44.759207 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:44.759207 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:44.759207 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:44.759207 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:44.759207 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:44.759207 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:44.759207 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:44.759207 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:44.759207 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:44.759207 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:16:44.760129 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:16:44.760129 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:44.760129 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:16:44.767818 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 278/551] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:16:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:44.775478 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778259e2-477b-4c6d-9efe-2e9b39911f92 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:44.867896 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f3a670-9c8d-4b07-ae7f-3c7a6eeef46a None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:44.908303 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c6e53-529b-40b4-ab61-15eacfa97298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:44.910206 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c6e53-529b-40b4-ab61-15eacfa97298 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:44.910716 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c6e53-529b-40b4-ab61-15eacfa97298 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:44.911217 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c6e53-529b-40b4-ab61-15eacfa97298 None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:44.912271 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6c6e53-529b-40b4-ab61-15eacfa97298 None admin] RBAC: Adding query filter params (name=service) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:44.912796 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6c6e53-529b-40b4-ab61-15eacfa97298 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:44.914406 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6c6e53-529b-40b4-ab61-15eacfa97298 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:44.923895 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 274/552] 10.222.0.60 () {56 vars in 1103 bytes} [Tue Aug 30 01:16:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:44.929267 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c6e53-529b-40b4-ab61-15eacfa97298 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:44.997053 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:45.010121 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778259e2-477b-4c6d-9efe-2e9b39911f92 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:45.057677 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead7c39c-2e20-4919-ab07-519a5fa7c713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:45.058293 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead7c39c-2e20-4919-ab07-519a5fa7c713 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:45.058574 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead7c39c-2e20-4919-ab07-519a5fa7c713 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:45.058846 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead7c39c-2e20-4919-ab07-519a5fa7c713 None admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:45.059704 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead7c39c-2e20-4919-ab07-519a5fa7c713 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:45.060422 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead7c39c-2e20-4919-ab07-519a5fa7c713 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:45.063066 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead7c39c-2e20-4919-ab07-519a5fa7c713 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:45.083914 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c6e53-529b-40b4-ab61-15eacfa97298 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:45.087865 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 279/553] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:16:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:16:45.089526 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead7c39c-2e20-4919-ab07-519a5fa7c713 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:45.138399 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb350f3f-9c4a-4712-b17c-6802421a0a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:45.139846 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb350f3f-9c4a-4712-b17c-6802421a0a48 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:45.140122 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb350f3f-9c4a-4712-b17c-6802421a0a48 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:45.140381 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb350f3f-9c4a-4712-b17c-6802421a0a48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:45.148656 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:45.159233 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb350f3f-9c4a-4712-b17c-6802421a0a48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:45.161038 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb350f3f-9c4a-4712-b17c-6802421a0a48 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:45.182266 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-fb350f3f-9c4a-4712-b17c-6802421a0a48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:45.182266 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:45.182266 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:45.182266 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:45.182266 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:45.182266 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:45.182266 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:45.182266 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:45.182266 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:45.182266 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:45.182266 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:45.182266 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:45.182266 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:16:45.182266 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:16:45.182266 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:16:45.182266 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:16:45.183573 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:45.183573 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:45.183573 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:45.183573 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:45.183573 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:45.183573 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:45.183573 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:45.183573 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:45.183573 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:45.183573 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:45.183573 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:45.183573 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:45.183573 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:45.183573 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:45.183573 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:45.183573 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:45.183573 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:16:45.184543 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:16:45.184543 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:45.184543 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:16:45.187191 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 275/554] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:16:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:45.188288 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb350f3f-9c4a-4712-b17c-6802421a0a48 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:45.224210 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead7c39c-2e20-4919-ab07-519a5fa7c713 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:45.273892 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea0da5a-b230-4680-9f40-603fa41611c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:45.275300 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0da5a-b230-4680-9f40-603fa41611c7 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:45.275748 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0da5a-b230-4680-9f40-603fa41611c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:45.276165 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0da5a-b230-4680-9f40-603fa41611c7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:45.285447 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:45.292916 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea0da5a-b230-4680-9f40-603fa41611c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:16:45.300679 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-4ea0da5a-b230-4680-9f40-603fa41611c7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 01:16:45.300679 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:45.300679 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:45.300679 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:45.300679 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:45.300679 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:45.300679 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:45.300679 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:45.300679 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:45.300679 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:45.300679 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:45.300679 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:45.300679 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:16:45.300679 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:16:45.300679 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:16:45.300679 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:16:45.301762 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:16:45.301762 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:16:45.301762 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:16:45.301762 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:16:45.301762 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:45.301762 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:45.301762 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:45.301762 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:45.301762 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:45.301762 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:45.301762 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:45.301762 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:45.301762 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:45.301762 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:45.301762 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:45.301762 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:45.302747 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:45.302747 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:45.302747 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:45.302747 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:45.302747 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:16:45.302747 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:16:45.302747 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:16:45.302747 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:16:45.302747 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:16:45.302747 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:16:45.302747 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 01:16:45.302747 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:16:45.303355 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb350f3f-9c4a-4712-b17c-6802421a0a48 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:45.311077 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 280/555] 10.222.0.60 () {56 vars in 1102 bytes} [Tue Aug 30 01:16:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:45.312213 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea0da5a-b230-4680-9f40-603fa41611c7 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:45.342769 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330bf1aa-8d36-4f3e-8df7-46dfeb8f7614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:45.343397 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330bf1aa-8d36-4f3e-8df7-46dfeb8f7614 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:45.343713 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330bf1aa-8d36-4f3e-8df7-46dfeb8f7614 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:45.344041 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330bf1aa-8d36-4f3e-8df7-46dfeb8f7614 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:45.351962 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330bf1aa-8d36-4f3e-8df7-46dfeb8f7614 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:45.353406 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330bf1aa-8d36-4f3e-8df7-46dfeb8f7614 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:45.365097 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-330bf1aa-8d36-4f3e-8df7-46dfeb8f7614 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 01:16:45.365097 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:45.365097 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:45.365097 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:45.365097 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:45.365097 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:45.365097 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:45.365097 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:45.365097 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:45.365097 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:45.365097 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:45.365097 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:45.365097 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 01:16:45.365097 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 01:16:45.365097 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 01:16:45.365097 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 01:16:45.366429 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:45.366429 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:45.366429 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 01:16:45.366429 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:16:45.366429 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 01:16:45.366429 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:16:45.366429 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:45.366429 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:45.366429 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:45.366429 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:45.366429 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:45.366429 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:45.366429 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:45.366429 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:45.366429 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:45.366429 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:45.366429 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:45.366429 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:45.367943 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:45.367943 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:45.367943 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 01:16:45.367943 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 01:16:45.367943 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 01:16:45.367943 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 01:16:45.367943 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 01:16:45.367943 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 01:16:45.367943 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 01:16:45.367943 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:16:45.367943 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 276/556] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 30 01:16:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:45.367943 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330bf1aa-8d36-4f3e-8df7-46dfeb8f7614 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:45.441731 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:45.444930 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea0da5a-b230-4680-9f40-603fa41611c7 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:45.480617 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8667432-0547-4b47-ba67-e268a02e7fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:45.481224 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8667432-0547-4b47-ba67-e268a02e7fc5 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:45.481498 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8667432-0547-4b47-ba67-e268a02e7fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:45.481776 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8667432-0547-4b47-ba67-e268a02e7fc5 None admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:45.482418 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8667432-0547-4b47-ba67-e268a02e7fc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:45.482721 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8667432-0547-4b47-ba67-e268a02e7fc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:45.484124 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8667432-0547-4b47-ba67-e268a02e7fc5 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:45.486649 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330bf1aa-8d36-4f3e-8df7-46dfeb8f7614 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:45.496667 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 281/557] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:16:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:45.497498 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8667432-0547-4b47-ba67-e268a02e7fc5 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:45.530120 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1bfb09-e8e8-4d0c-bf5f-90a856b29a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:45.530742 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1bfb09-e8e8-4d0c-bf5f-90a856b29a3d None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:45.531016 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1bfb09-e8e8-4d0c-bf5f-90a856b29a3d None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:45.531288 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1bfb09-e8e8-4d0c-bf5f-90a856b29a3d None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:45.531976 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1bfb09-e8e8-4d0c-bf5f-90a856b29a3d None admin] RBAC: Adding query filter params (name=service) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:45.532277 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1bfb09-e8e8-4d0c-bf5f-90a856b29a3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:45.533651 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1bfb09-e8e8-4d0c-bf5f-90a856b29a3d None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:45.546583 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 277/558] 10.222.0.60 () {56 vars in 1103 bytes} [Tue Aug 30 01:16:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:45.546583 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33d5d1-93e0-4122-914c-452d98a68b3a None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:45.546583 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33d5d1-93e0-4122-914c-452d98a68b3a None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:45.546583 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33d5d1-93e0-4122-914c-452d98a68b3a None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:45.548933 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 278/559] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:16:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:16:45.550231 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d33d5d1-93e0-4122-914c-452d98a68b3a None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:45.562474 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:45.611555 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8667432-0547-4b47-ba67-e268a02e7fc5 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:45.647642 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeb02eb-2ac1-44f4-9f43-134a197c85b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:45.648307 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb02eb-2ac1-44f4-9f43-134a197c85b8 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:45.648583 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb02eb-2ac1-44f4-9f43-134a197c85b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:45.648847 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb02eb-2ac1-44f4-9f43-134a197c85b8 None admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:45.649617 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeb02eb-2ac1-44f4-9f43-134a197c85b8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:45.649973 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeb02eb-2ac1-44f4-9f43-134a197c85b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:45.651415 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeb02eb-2ac1-44f4-9f43-134a197c85b8 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:45.664907 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d33d5d1-93e0-4122-914c-452d98a68b3a None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:45.670083 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 282/560] 10.222.0.60 () {56 vars in 1135 bytes} [Tue Aug 30 01:16:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:45.675701 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeb02eb-2ac1-44f4-9f43-134a197c85b8 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:45.695913 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:45.701563 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a6aae7-2aaa-48f5-997c-60516a47f6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:45.702363 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6aae7-2aaa-48f5-997c-60516a47f6c7 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:45.702714 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6aae7-2aaa-48f5-997c-60516a47f6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:45.702996 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6aae7-2aaa-48f5-997c-60516a47f6c7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:45.711151 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a6aae7-2aaa-48f5-997c-60516a47f6c7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:45.712641 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a6aae7-2aaa-48f5-997c-60516a47f6c7 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:45.725520 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-65a6aae7-2aaa-48f5-997c-60516a47f6c7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 30 01:16:45.725520 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:45.725520 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:45.725520 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:45.725520 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:45.725520 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:45.725520 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:45.725520 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:45.725520 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:45.725520 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:45.725520 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:45.725520 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:45.725520 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 01:16:45.725520 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 01:16:45.725520 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 01:16:45.725520 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 01:16:45.726631 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:45.726631 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:45.726631 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 01:16:45.726631 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:16:45.726631 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 01:16:45.726631 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:16:45.726631 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:45.726631 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:45.726631 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:45.726631 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:45.726631 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:45.726631 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:45.726631 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:45.726631 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:45.726631 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:45.726631 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:45.726631 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:45.726631 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:45.728161 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:45.728161 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:45.728161 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 01:16:45.728161 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 01:16:45.728161 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 01:16:45.728161 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 01:16:45.728161 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 01:16:45.728161 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 01:16:45.728161 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 30 01:16:45.728161 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:16:45.728161 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 279/561] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 30 01:16:45 2022] GET /identity/v3/users/glance => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:45.728161 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582bb2c-f40f-4676-a6ab-48995c80bd87 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:45.728815 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582bb2c-f40f-4676-a6ab-48995c80bd87 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:45.728815 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582bb2c-f40f-4676-a6ab-48995c80bd87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:45.749636 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-4582bb2c-f40f-4676-a6ab-48995c80bd87 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:45.750886 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-4582bb2c-f40f-4676-a6ab-48995c80bd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:45.791930 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeb02eb-2ac1-44f4-9f43-134a197c85b8 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:45.820811 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:45.828408 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 280/562] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:16:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:16:45.829611 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4582bb2c-f40f-4676-a6ab-48995c80bd87 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:45.841656 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e13c4cb-1d5f-4d61-b97f-ee1b9a701767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:45.842600 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13c4cb-1d5f-4d61-b97f-ee1b9a701767 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:45.843083 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13c4cb-1d5f-4d61-b97f-ee1b9a701767 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:45.843355 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13c4cb-1d5f-4d61-b97f-ee1b9a701767 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:45.858653 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e13c4cb-1d5f-4d61-b97f-ee1b9a701767 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:45.860547 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e13c4cb-1d5f-4d61-b97f-ee1b9a701767 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:45.877695 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-1e13c4cb-1d5f-4d61-b97f-ee1b9a701767 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:45.877695 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:45.877695 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:45.877695 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:45.877695 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:45.877695 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:45.877695 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:45.877695 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:45.877695 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:45.877695 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:45.877695 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:45.877695 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:45.877695 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:16:45.877695 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:16:45.877695 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:16:45.877695 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:16:45.878630 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:45.878630 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:45.878630 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:45.878630 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:45.878630 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:45.878630 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:45.878630 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:45.878630 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:45.878630 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:45.878630 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:45.878630 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:45.878630 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:45.878630 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:45.878630 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:45.878630 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:45.878630 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:45.878630 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:16:45.879540 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:16:45.879540 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:45.879540 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:16:45.886095 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 283/563] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:16:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:45.887413 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e13c4cb-1d5f-4d61-b97f-ee1b9a701767 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:45.953336 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4582bb2c-f40f-4676-a6ab-48995c80bd87 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:45.978022 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:46.001425 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1b8d3-b73e-40bd-a59e-612f2e1dc181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:46.002375 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1b8d3-b73e-40bd-a59e-612f2e1dc181 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:46.002892 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1b8d3-b73e-40bd-a59e-612f2e1dc181 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:46.003392 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1b8d3-b73e-40bd-a59e-612f2e1dc181 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:46.015226 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e13c4cb-1d5f-4d61-b97f-ee1b9a701767 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:46.054242 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e778f2a9-7712-4f81-8944-cbb04f5547af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:46.055111 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778f2a9-7712-4f81-8944-cbb04f5547af None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:46.055393 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778f2a9-7712-4f81-8944-cbb04f5547af None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:46.055692 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778f2a9-7712-4f81-8944-cbb04f5547af None admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:46.056916 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e778f2a9-7712-4f81-8944-cbb04f5547af None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:46.057227 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e778f2a9-7712-4f81-8944-cbb04f5547af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:46.058939 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e778f2a9-7712-4f81-8944-cbb04f5547af None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:46.076926 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:46.081035 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc1b8d3-b73e-40bd-a59e-612f2e1dc181 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:46.083195 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc1b8d3-b73e-40bd-a59e-612f2e1dc181 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:46.089002 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 284/564] 10.222.0.60 () {56 vars in 1137 bytes} [Tue Aug 30 01:16:45 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:46.090952 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e778f2a9-7712-4f81-8944-cbb04f5547af None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:46.195721 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 281/565] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 30 01:16:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:46.195943 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e778f2a9-7712-4f81-8944-cbb04f5547af None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:46.196028 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee54b16-0c54-4339-8e93-9c4a24b31b64 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:46.196028 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee54b16-0c54-4339-8e93-9c4a24b31b64 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:46.196028 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee54b16-0c54-4339-8e93-9c4a24b31b64 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:46.196028 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 282/566] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:16:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:16:46.196028 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee54b16-0c54-4339-8e93-9c4a24b31b64 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:46.223252 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:46.231313 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8291c1-de5f-4f0d-8995-d452e8ce2ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:46.231951 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8291c1-de5f-4f0d-8995-d452e8ce2ef3 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:46.232235 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8291c1-de5f-4f0d-8995-d452e8ce2ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:46.232512 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8291c1-de5f-4f0d-8995-d452e8ce2ef3 None admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:46.233156 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8291c1-de5f-4f0d-8995-d452e8ce2ef3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:46.233462 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8291c1-de5f-4f0d-8995-d452e8ce2ef3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:46.234832 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8291c1-de5f-4f0d-8995-d452e8ce2ef3 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:46.245981 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 285/567] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:16:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:46.246769 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8291c1-de5f-4f0d-8995-d452e8ce2ef3 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:46.293962 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:46.299743 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee54b16-0c54-4339-8e93-9c4a24b31b64 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:46.333044 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb15f6-fd22-4f24-87d6-02a06c9ba063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:46.333672 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb15f6-fd22-4f24-87d6-02a06c9ba063 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:46.333955 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb15f6-fd22-4f24-87d6-02a06c9ba063 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:46.334227 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb15f6-fd22-4f24-87d6-02a06c9ba063 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:46.344247 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bb15f6-fd22-4f24-87d6-02a06c9ba063 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:46.345711 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bb15f6-fd22-4f24-87d6-02a06c9ba063 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:46.347210 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8291c1-de5f-4f0d-8995-d452e8ce2ef3 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:46.361154 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-59bb15f6-fd22-4f24-87d6-02a06c9ba063 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:46.361154 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:46.361154 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:46.361154 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:46.361154 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:46.361154 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:46.361154 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:46.361154 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:46.361154 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:46.361154 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:46.361154 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:46.361154 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:46.361154 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:16:46.361154 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:16:46.361154 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:16:46.361154 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:16:46.362305 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:46.362305 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:46.362305 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:46.362305 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:46.362305 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:46.362305 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:46.362305 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:46.362305 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:46.362305 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:46.362305 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:46.362305 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:46.362305 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:46.362305 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:46.362305 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:46.362305 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:46.362305 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:46.362305 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:16:46.363200 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:16:46.363200 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:46.363200 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:16:46.363200 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 283/568] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:16:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:46.363200 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb15f6-fd22-4f24-87d6-02a06c9ba063 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:46.383490 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e9cef4-8747-440b-9d11-bb958096153f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:46.384166 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e9cef4-8747-440b-9d11-bb958096153f None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:46.384445 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e9cef4-8747-440b-9d11-bb958096153f None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:46.384714 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e9cef4-8747-440b-9d11-bb958096153f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:46.395357 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e9cef4-8747-440b-9d11-bb958096153f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:16:46.401502 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-16e9cef4-8747-440b-9d11-bb958096153f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 01:16:46.401502 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:46.401502 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:46.401502 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:46.401502 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:46.401502 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:46.401502 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:46.401502 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:46.401502 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:46.401502 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:46.401502 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:46.401502 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:46.401502 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:16:46.401502 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:16:46.401502 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:16:46.401502 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:16:46.402643 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:16:46.402643 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:16:46.402643 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:16:46.402643 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:16:46.402643 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:46.402643 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:46.402643 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:46.402643 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:46.402643 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:46.402643 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:46.402643 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:46.402643 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:46.402643 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:46.402643 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:46.402643 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:46.402643 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:46.403495 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:46.403495 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:46.403495 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:46.403495 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:46.403495 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:16:46.403495 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:16:46.403495 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:16:46.403495 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:16:46.403495 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:16:46.403495 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:16:46.403495 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 01:16:46.403495 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:16:46.403495 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 286/569] 10.222.0.60 () {56 vars in 1102 bytes} [Tue Aug 30 01:16:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:46.404275 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b32a09-98c2-4e99-b4c6-c2ef42b03669 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:46.404354 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b32a09-98c2-4e99-b4c6-c2ef42b03669 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:46.404557 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b32a09-98c2-4e99-b4c6-c2ef42b03669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:46.422337 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-78b32a09-98c2-4e99-b4c6-c2ef42b03669 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:46.423539 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-78b32a09-98c2-4e99-b4c6-c2ef42b03669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:46.467309 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:46.470034 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb15f6-fd22-4f24-87d6-02a06c9ba063 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:46.490876 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 287/570] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:16:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:16:46.491656 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b32a09-98c2-4e99-b4c6-c2ef42b03669 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:46.507915 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5642b5ca-a5b6-471c-b651-9baf2bc48382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:46.508538 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642b5ca-a5b6-471c-b651-9baf2bc48382 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:46.508812 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642b5ca-a5b6-471c-b651-9baf2bc48382 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:46.509078 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642b5ca-a5b6-471c-b651-9baf2bc48382 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:46.520293 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5642b5ca-a5b6-471c-b651-9baf2bc48382 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:46.521747 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5642b5ca-a5b6-471c-b651-9baf2bc48382 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:46.536907 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-5642b5ca-a5b6-471c-b651-9baf2bc48382 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:46.536907 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:46.536907 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:46.536907 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:46.536907 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:46.536907 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:46.536907 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:46.536907 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:46.536907 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:46.536907 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:46.536907 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:46.536907 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:46.536907 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:16:46.536907 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:16:46.536907 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:16:46.536907 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:16:46.537949 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:46.537949 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:46.537949 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:46.537949 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:46.537949 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:46.537949 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:46.537949 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:46.537949 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:46.537949 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:46.537949 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:46.537949 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:46.537949 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:46.537949 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:46.537949 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:46.537949 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:46.537949 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:46.537949 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:16:46.544683 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:16:46.544683 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:46.544683 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:16:46.544683 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 284/571] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:16:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:46.544683 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5642b5ca-a5b6-471c-b651-9baf2bc48382 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:46.544683 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:46.622585 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b32a09-98c2-4e99-b4c6-c2ef42b03669 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:46.659129 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bd051c-4c65-4a7f-83b2-8cbb2c3e92e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:46.659358 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5642b5ca-a5b6-471c-b651-9baf2bc48382 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:46.660008 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd051c-4c65-4a7f-83b2-8cbb2c3e92e5 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:46.660385 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd051c-4c65-4a7f-83b2-8cbb2c3e92e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:46.660760 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd051c-4c65-4a7f-83b2-8cbb2c3e92e5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:46.668749 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bd051c-4c65-4a7f-83b2-8cbb2c3e92e5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:46.670358 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bd051c-4c65-4a7f-83b2-8cbb2c3e92e5 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:46.682284 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-93bd051c-4c65-4a7f-83b2-8cbb2c3e92e5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 01:16:46.682284 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:46.682284 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:46.682284 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:46.682284 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:46.682284 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:46.682284 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:46.682284 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:46.682284 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:46.682284 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:46.682284 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:46.682284 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:46.682284 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 01:16:46.682284 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 01:16:46.682284 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 01:16:46.682284 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 01:16:46.683528 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:46.683528 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:46.683528 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 01:16:46.683528 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:16:46.683528 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 01:16:46.683528 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:16:46.683528 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:46.683528 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:46.683528 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:46.683528 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:46.683528 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:46.683528 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:46.683528 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:46.683528 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:46.683528 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:46.683528 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:46.683528 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:46.683528 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:46.684597 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:46.684597 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:46.684597 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 01:16:46.684597 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 01:16:46.684597 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 01:16:46.684597 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 01:16:46.684597 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 01:16:46.684597 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 01:16:46.684597 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 01:16:46.684597 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:16:46.684597 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 288/572] 10.222.0.60 () {56 vars in 1093 bytes} [Tue Aug 30 01:16:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:46.685194 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bd051c-4c65-4a7f-83b2-8cbb2c3e92e5 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:46.704521 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e27faab-74fc-4190-b026-6683da81c1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:46.705131 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27faab-74fc-4190-b026-6683da81c1a3 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:46.705409 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27faab-74fc-4190-b026-6683da81c1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:46.705684 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27faab-74fc-4190-b026-6683da81c1a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:46.706953 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e27faab-74fc-4190-b026-6683da81c1a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:46.707279 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e27faab-74fc-4190-b026-6683da81c1a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:46.708695 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e27faab-74fc-4190-b026-6683da81c1a3 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:46.720728 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 285/573] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:16:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:46.721520 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e27faab-74fc-4190-b026-6683da81c1a3 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:46.736072 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:46.786549 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:46.797084 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bd051c-4c65-4a7f-83b2-8cbb2c3e92e5 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:46.827478 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e27faab-74fc-4190-b026-6683da81c1a3 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:46.832045 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7cd837-b90e-4167-b21f-667516b5c21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:46.832658 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7cd837-b90e-4167-b21f-667516b5c21d None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:46.832935 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7cd837-b90e-4167-b21f-667516b5c21d None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:46.833210 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7cd837-b90e-4167-b21f-667516b5c21d None admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:46.833867 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7cd837-b90e-4167-b21f-667516b5c21d None admin] RBAC: Adding query filter params (name=service) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:46.834165 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7cd837-b90e-4167-b21f-667516b5c21d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:46.835548 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7cd837-b90e-4167-b21f-667516b5c21d None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:46.843959 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 289/574] 10.222.0.60 () {56 vars in 1103 bytes} [Tue Aug 30 01:16:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:46.844652 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7cd837-b90e-4167-b21f-667516b5c21d None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:46.867386 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f41550-0604-409b-b84d-11fee9634e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:46.868004 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f41550-0604-409b-b84d-11fee9634e50 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:46.868279 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f41550-0604-409b-b84d-11fee9634e50 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:46.868546 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f41550-0604-409b-b84d-11fee9634e50 None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:46.869177 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f41550-0604-409b-b84d-11fee9634e50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:46.869474 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f41550-0604-409b-b84d-11fee9634e50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:46.870835 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f41550-0604-409b-b84d-11fee9634e50 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:46.882185 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 286/575] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:16:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:46.882960 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f41550-0604-409b-b84d-11fee9634e50 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:46.944997 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:46.948183 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7cd837-b90e-4167-b21f-667516b5c21d None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:46.983081 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32c752-a32e-43ea-8d58-83cab883b307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:46.983269 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f41550-0604-409b-b84d-11fee9634e50 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:46.983766 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32c752-a32e-43ea-8d58-83cab883b307 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:46.984045 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32c752-a32e-43ea-8d58-83cab883b307 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:46.984313 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32c752-a32e-43ea-8d58-83cab883b307 None admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:46.985035 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a32c752-a32e-43ea-8d58-83cab883b307 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:46.985344 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a32c752-a32e-43ea-8d58-83cab883b307 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:46.986748 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a32c752-a32e-43ea-8d58-83cab883b307 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:47.005212 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 290/576] 10.222.0.60 () {56 vars in 1133 bytes} [Tue Aug 30 01:16:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:47.006098 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32c752-a32e-43ea-8d58-83cab883b307 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:47.006235 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:47.021467 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1533c082-0aa8-4c13-928a-d5f828dd2120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:47.022093 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1533c082-0aa8-4c13-928a-d5f828dd2120 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:47.022369 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1533c082-0aa8-4c13-928a-d5f828dd2120 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:47.022636 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1533c082-0aa8-4c13-928a-d5f828dd2120 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:47.029235 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1533c082-0aa8-4c13-928a-d5f828dd2120 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:47.030679 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1533c082-0aa8-4c13-928a-d5f828dd2120 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:47.041853 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-1533c082-0aa8-4c13-928a-d5f828dd2120 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:16:47.041853 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:47.041853 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:47.041853 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:47.041853 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:47.041853 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:47.041853 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:47.041853 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:47.041853 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:47.041853 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:47.041853 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:47.041853 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:47.041853 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 01:16:47.041853 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 01:16:47.041853 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 01:16:47.042904 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 01:16:47.042904 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:47.042904 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:47.042904 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:47.042904 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:47.042904 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:47.042904 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:47.042904 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:47.042904 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:47.042904 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:47.042904 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:47.042904 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:47.042904 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:47.042904 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:47.042904 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:47.042904 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:47.042904 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:47.043858 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 01:16:47.043858 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 01:16:47.043858 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 01:16:47.043858 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 01:16:47.043858 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 01:16:47.043858 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 01:16:47.043858 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:16:47.043858 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:16:47.043858 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 287/577] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 30 01:16:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:47.043858 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1533c082-0aa8-4c13-928a-d5f828dd2120 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:47.106554 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32c752-a32e-43ea-8d58-83cab883b307 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:47.141447 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae759e5-54ef-46aa-97b0-c24193bb9b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:47.142066 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae759e5-54ef-46aa-97b0-c24193bb9b72 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:47.142344 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae759e5-54ef-46aa-97b0-c24193bb9b72 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:47.142613 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae759e5-54ef-46aa-97b0-c24193bb9b72 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:47.144050 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1533c082-0aa8-4c13-928a-d5f828dd2120 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:47.152540 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae759e5-54ef-46aa-97b0-c24193bb9b72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:16:47.157358 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-0ae759e5-54ef-46aa-97b0-c24193bb9b72 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 01:16:47.157358 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:47.157358 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:47.157358 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:47.157358 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:47.157358 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:47.157358 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:47.157358 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:47.157358 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:47.157358 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:47.157358 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:47.157358 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:47.157358 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:16:47.157358 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:16:47.157358 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:16:47.157358 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:16:47.158396 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:16:47.158396 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:16:47.158396 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:16:47.158396 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:16:47.158396 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:47.158396 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:47.158396 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:47.158396 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:47.158396 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:47.158396 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:47.158396 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:47.158396 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:47.158396 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:47.158396 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:47.158396 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:47.158396 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:47.160148 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:47.160148 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:47.160148 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:47.160148 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:47.160148 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:16:47.160148 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:16:47.160148 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:16:47.160148 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:16:47.160148 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:16:47.160148 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:16:47.160148 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 01:16:47.160148 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:16:47.160148 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 291/578] 10.222.0.60 () {56 vars in 1102 bytes} [Tue Aug 30 01:16:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:47.160148 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae759e5-54ef-46aa-97b0-c24193bb9b72 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:47.178570 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:47.182144 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9913e11f-3019-4ff1-b84e-be12f8420bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:47.182750 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913e11f-3019-4ff1-b84e-be12f8420bfb None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:47.183047 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913e11f-3019-4ff1-b84e-be12f8420bfb None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:47.183290 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913e11f-3019-4ff1-b84e-be12f8420bfb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:47.194417 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9913e11f-3019-4ff1-b84e-be12f8420bfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:47.195900 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9913e11f-3019-4ff1-b84e-be12f8420bfb None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:47.210491 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-9913e11f-3019-4ff1-b84e-be12f8420bfb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:47.210491 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:47.210491 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:47.210491 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:47.210491 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:47.210491 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:47.210491 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:47.210491 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:47.210491 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:47.210491 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:47.210491 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:47.210491 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:47.210491 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:16:47.210491 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:16:47.210491 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:16:47.210491 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:16:47.211548 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:47.211548 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:47.211548 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:47.211548 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:47.211548 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:47.211548 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:47.211548 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:47.211548 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:47.211548 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:47.211548 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:47.211548 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:47.211548 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:47.211548 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:47.211548 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:47.211548 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:47.211548 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:47.211548 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:16:47.212421 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:16:47.212421 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:47.212421 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:16:47.212421 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 288/579] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:16:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:47.213064 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9913e11f-3019-4ff1-b84e-be12f8420bfb None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:47.247542 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:47.263520 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae759e5-54ef-46aa-97b0-c24193bb9b72 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:47.296903 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f9324-9e48-4477-9594-af056a2170bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:47.297460 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f9324-9e48-4477-9594-af056a2170bc None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:47.297740 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f9324-9e48-4477-9594-af056a2170bc None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:47.298011 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f9324-9e48-4477-9594-af056a2170bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:47.305301 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858f9324-9e48-4477-9594-af056a2170bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:47.306746 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858f9324-9e48-4477-9594-af056a2170bc None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:47.314780 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9913e11f-3019-4ff1-b84e-be12f8420bfb None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:47.318808 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-858f9324-9e48-4477-9594-af056a2170bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:16:47.318808 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:47.318808 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:47.318808 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:47.318808 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:47.318808 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:47.318808 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:47.318808 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:47.318808 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:47.318808 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:47.318808 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:47.318808 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:47.318808 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 01:16:47.318808 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 01:16:47.318808 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 01:16:47.319867 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 01:16:47.319867 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:47.319867 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:47.319867 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:47.319867 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:47.319867 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:47.319867 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:47.319867 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:47.319867 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:47.319867 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:47.319867 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:47.319867 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:47.319867 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:47.319867 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:47.319867 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:47.319867 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:47.319867 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:47.320774 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 01:16:47.320774 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 01:16:47.320774 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 01:16:47.320774 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 01:16:47.320774 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 01:16:47.320774 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 01:16:47.320774 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:16:47.320774 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:16:47.320774 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 292/580] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 30 01:16:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:47.320774 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f9324-9e48-4477-9594-af056a2170bc None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:47.350297 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5788c1c9-063a-498c-bec5-ba4da5e73175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:47.350927 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788c1c9-063a-498c-bec5-ba4da5e73175 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:47.351207 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788c1c9-063a-498c-bec5-ba4da5e73175 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:47.351531 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788c1c9-063a-498c-bec5-ba4da5e73175 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:47.362765 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5788c1c9-063a-498c-bec5-ba4da5e73175 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:47.364255 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5788c1c9-063a-498c-bec5-ba4da5e73175 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:47.378761 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-5788c1c9-063a-498c-bec5-ba4da5e73175 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:47.378761 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:47.378761 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:47.378761 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:47.378761 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:47.378761 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:47.378761 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:47.378761 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:47.378761 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:47.378761 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:47.378761 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:47.378761 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:47.378761 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:16:47.378761 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:16:47.378761 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:16:47.378761 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:16:47.379965 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:47.379965 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:47.379965 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:47.379965 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:47.379965 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:47.379965 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:47.379965 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:47.379965 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:47.379965 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:47.379965 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:47.379965 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:47.379965 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:47.379965 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:47.379965 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:47.379965 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:47.379965 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:47.379965 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:16:47.380865 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:16:47.380865 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:47.380865 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:16:47.380865 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 289/581] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:16:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:47.381101 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5788c1c9-063a-498c-bec5-ba4da5e73175 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:47.404033 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:47.426291 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f9324-9e48-4477-9594-af056a2170bc None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:47.459056 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b247c688-3843-44c3-a1b6-ab16f72db2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:47.460011 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247c688-3843-44c3-a1b6-ab16f72db2e8 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:47.460011 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247c688-3843-44c3-a1b6-ab16f72db2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:47.460237 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247c688-3843-44c3-a1b6-ab16f72db2e8 None admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:47.460914 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b247c688-3843-44c3-a1b6-ab16f72db2e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:47.461224 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b247c688-3843-44c3-a1b6-ab16f72db2e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:47.462648 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b247c688-3843-44c3-a1b6-ab16f72db2e8 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:47.464576 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:47.475407 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 293/582] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 30 01:16:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:47.476234 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b247c688-3843-44c3-a1b6-ab16f72db2e8 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:47.480950 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5788c1c9-063a-498c-bec5-ba4da5e73175 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:47.514579 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ebb455-3dac-4558-8822-afb0af6d24cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:47.515188 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ebb455-3dac-4558-8822-afb0af6d24cf None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:47.515455 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ebb455-3dac-4558-8822-afb0af6d24cf None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:47.515740 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ebb455-3dac-4558-8822-afb0af6d24cf None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:47.516394 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ebb455-3dac-4558-8822-afb0af6d24cf None admin] RBAC: Adding query filter params (name=service) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:47.516695 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ebb455-3dac-4558-8822-afb0af6d24cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:47.518067 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ebb455-3dac-4558-8822-afb0af6d24cf None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:47.525908 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 290/583] 10.222.0.60 () {56 vars in 1103 bytes} [Tue Aug 30 01:16:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:47.526685 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ebb455-3dac-4558-8822-afb0af6d24cf None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:47.577428 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b247c688-3843-44c3-a1b6-ab16f72db2e8 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:47.613800 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168d230-fd79-4175-8bee-8cdcd98c304c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:47.614431 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168d230-fd79-4175-8bee-8cdcd98c304c None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:47.614780 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168d230-fd79-4175-8bee-8cdcd98c304c None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:47.614979 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168d230-fd79-4175-8bee-8cdcd98c304c None admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:47.615651 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b168d230-fd79-4175-8bee-8cdcd98c304c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:47.616228 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b168d230-fd79-4175-8bee-8cdcd98c304c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:47.617320 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b168d230-fd79-4175-8bee-8cdcd98c304c None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:47.623667 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:47.629295 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 294/584] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:16:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:47.630113 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168d230-fd79-4175-8bee-8cdcd98c304c None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:47.633914 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ebb455-3dac-4558-8822-afb0af6d24cf None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:47.668860 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af60b22-6145-4753-bf47-d09828c336f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:47.669498 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af60b22-6145-4753-bf47-d09828c336f4 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:47.670180 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af60b22-6145-4753-bf47-d09828c336f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:47.670180 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af60b22-6145-4753-bf47-d09828c336f4 None admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:47.670722 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af60b22-6145-4753-bf47-d09828c336f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:47.671025 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af60b22-6145-4753-bf47-d09828c336f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:47.672489 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af60b22-6145-4753-bf47-d09828c336f4 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:47.684773 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 291/585] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 30 01:16:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:47.685548 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af60b22-6145-4753-bf47-d09828c336f4 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:47.697752 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:47.733136 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168d230-fd79-4175-8bee-8cdcd98c304c None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:47.765479 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce23b99-518b-421a-ad1d-3ad7d93c4ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:47.766079 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce23b99-518b-421a-ad1d-3ad7d93c4ed0 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:47.766355 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce23b99-518b-421a-ad1d-3ad7d93c4ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:47.766624 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce23b99-518b-421a-ad1d-3ad7d93c4ed0 None admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:47.767259 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce23b99-518b-421a-ad1d-3ad7d93c4ed0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:47.767597 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce23b99-518b-421a-ad1d-3ad7d93c4ed0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:47.769475 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce23b99-518b-421a-ad1d-3ad7d93c4ed0 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:47.781286 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 295/586] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:16:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:47.782076 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce23b99-518b-421a-ad1d-3ad7d93c4ed0 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:47.791772 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af60b22-6145-4753-bf47-d09828c336f4 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:47.825685 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77201e69-cce5-4c8c-8ce1-84ab9390654e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:47.826330 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77201e69-cce5-4c8c-8ce1-84ab9390654e None admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:47.826603 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77201e69-cce5-4c8c-8ce1-84ab9390654e None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:47.826873 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77201e69-cce5-4c8c-8ce1-84ab9390654e None admin] PATH_INFO: `/v3/projects/b050b2dad22a4a06875072e44c8c9824/users/2de6decc90df4df58217d5eed9c5e190/roles/01439ffbf0dd41caadd0cc40b3176062` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:47.839113 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:47.842454 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77201e69-cce5-4c8c-8ce1-84ab9390654e None admin] RBAC: Authorizing `identity:create_grant(project_id=b050b2dad22a4a06875072e44c8c9824, user_id=2de6decc90df4df58217d5eed9c5e190, role_id=01439ffbf0dd41caadd0cc40b3176062)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:47.844500 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77201e69-cce5-4c8c-8ce1-84ab9390654e None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:47.857227 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 292/587] 10.222.0.60 () {58 vars in 1439 bytes} [Tue Aug 30 01:16:47 2022] PUT /identity/v3/projects/b050b2dad22a4a06875072e44c8c9824/users/2de6decc90df4df58217d5eed9c5e190/roles/01439ffbf0dd41caadd0cc40b3176062 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:16:47.858017 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77201e69-cce5-4c8c-8ce1-84ab9390654e None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:47.885088 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce23b99-518b-421a-ad1d-3ad7d93c4ed0 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:47.924633 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0975ed1-45d7-4fb1-989f-32b642e7031e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:47.927448 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0975ed1-45d7-4fb1-989f-32b642e7031e None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:47.927792 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0975ed1-45d7-4fb1-989f-32b642e7031e None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:47.928041 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0975ed1-45d7-4fb1-989f-32b642e7031e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:47.943273 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0975ed1-45d7-4fb1-989f-32b642e7031e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:47.945049 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0975ed1-45d7-4fb1-989f-32b642e7031e None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:47.947085 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:47.963425 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-f0975ed1-45d7-4fb1-989f-32b642e7031e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:47.963425 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:47.963425 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:47.963425 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:47.963425 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:47.963425 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:47.963425 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:47.963425 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:47.963425 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:47.963425 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:47.963425 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:47.963425 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:47.963425 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:16:47.963425 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:16:47.963425 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:16:47.963425 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:16:47.964506 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:47.964506 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:47.964506 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:47.964506 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:47.964506 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:47.964506 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:47.964506 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:47.964506 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:47.964506 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:47.964506 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:47.964506 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:47.964506 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:47.964506 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:47.964506 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:47.964506 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:47.964506 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:47.964506 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:16:47.965772 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:16:47.965772 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:47.965772 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:16:47.965772 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 296/588] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:16:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:47.966562 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0975ed1-45d7-4fb1-989f-32b642e7031e None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:48.006405 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77201e69-cce5-4c8c-8ce1-84ab9390654e None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:48.047572 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477458e-ea47-442c-87e5-6e174f164e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:48.048213 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477458e-ea47-442c-87e5-6e174f164e2d None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:48.049021 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477458e-ea47-442c-87e5-6e174f164e2d None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:48.049305 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477458e-ea47-442c-87e5-6e174f164e2d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:48.062299 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8477458e-ea47-442c-87e5-6e174f164e2d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:48.063827 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8477458e-ea47-442c-87e5-6e174f164e2d None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:48.077513 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-8477458e-ea47-442c-87e5-6e174f164e2d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 01:16:48.077513 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:48.077513 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:48.077513 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:48.077513 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:48.077513 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:48.077513 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:48.077513 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:48.077513 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:48.077513 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:48.077513 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:48.077513 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:48.077513 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 01:16:48.077513 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 01:16:48.077513 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 01:16:48.077513 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 01:16:48.078486 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:48.078486 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:48.078486 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 01:16:48.078486 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:16:48.078486 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 01:16:48.078486 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:16:48.078486 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:48.078486 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:48.078486 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:48.078486 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:48.078486 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:48.078486 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:48.078486 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:48.078486 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:48.078486 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:48.078486 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:48.078486 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:48.078486 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:48.079415 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:48.079415 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:48.079415 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 01:16:48.079415 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 01:16:48.079415 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 01:16:48.079415 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 01:16:48.079415 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 01:16:48.079415 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 01:16:48.079415 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 01:16:48.079415 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:16:48.079415 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 293/589] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 30 01:16:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:48.079415 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477458e-ea47-442c-87e5-6e174f164e2d None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:48.082125 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0975ed1-45d7-4fb1-989f-32b642e7031e None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:48.094991 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:48.120531 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6ad843-cd8e-471f-a455-9015610497c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:48.121137 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6ad843-cd8e-471f-a455-9015610497c9 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:48.121411 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6ad843-cd8e-471f-a455-9015610497c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:48.121680 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6ad843-cd8e-471f-a455-9015610497c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:48.122401 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6ad843-cd8e-471f-a455-9015610497c9 None admin] RBAC: Adding query filter params (role.id=01439ffbf0dd41caadd0cc40b3176062, scope.project.id=b050b2dad22a4a06875072e44c8c9824, user.id=1e7de1f31ef84d529bf2c53ce0f7e38b) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:48.122704 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6ad843-cd8e-471f-a455-9015610497c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:48.124147 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6ad843-cd8e-471f-a455-9015610497c9 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:48.130528 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 297/590] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 30 01:16:47 2022] GET /identity/v3/role_assignments?user.id=1e7de1f31ef84d529bf2c53ce0f7e38b&scope.project.id=b050b2dad22a4a06875072e44c8c9824&role.id=01439ffbf0dd41caadd0cc40b3176062 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:48.132223 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6ad843-cd8e-471f-a455-9015610497c9 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:48.188170 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477458e-ea47-442c-87e5-6e174f164e2d None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:48.237435 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347b8916-10c3-47ce-a144-793770b3db28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:48.238512 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b8916-10c3-47ce-a144-793770b3db28 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:48.239000 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b8916-10c3-47ce-a144-793770b3db28 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:48.240080 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b8916-10c3-47ce-a144-793770b3db28 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:48.250070 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:48.251596 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347b8916-10c3-47ce-a144-793770b3db28 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:48.253979 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347b8916-10c3-47ce-a144-793770b3db28 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:48.268280 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6ad843-cd8e-471f-a455-9015610497c9 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:48.273334 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-347b8916-10c3-47ce-a144-793770b3db28 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:16:48.273334 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:48.273334 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:48.273334 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:48.273334 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:48.273334 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:48.273334 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:48.273334 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:48.273334 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:48.273334 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:48.273334 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:48.273334 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:48.273334 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 01:16:48.273334 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 01:16:48.273334 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 01:16:48.274492 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 01:16:48.274492 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:48.274492 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:48.274492 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:48.274492 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:48.274492 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:48.274492 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:48.274492 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:48.274492 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:48.274492 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:48.274492 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:48.274492 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:48.274492 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:48.274492 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:48.274492 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:48.274492 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:48.274492 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:48.275627 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 01:16:48.275627 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 01:16:48.275627 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 01:16:48.275627 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 01:16:48.275627 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 01:16:48.275627 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 01:16:48.275627 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:16:48.275627 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:16:48.282579 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 294/591] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 30 01:16:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:48.283729 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347b8916-10c3-47ce-a144-793770b3db28 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:48.317663 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763ff883-d7c9-41c5-8d6b-9f3192737f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:48.318500 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ff883-d7c9-41c5-8d6b-9f3192737f34 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:48.318848 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ff883-d7c9-41c5-8d6b-9f3192737f34 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:48.319136 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ff883-d7c9-41c5-8d6b-9f3192737f34 None admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:48.320118 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763ff883-d7c9-41c5-8d6b-9f3192737f34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:48.320423 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763ff883-d7c9-41c5-8d6b-9f3192737f34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:48.322564 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763ff883-d7c9-41c5-8d6b-9f3192737f34 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:48.339667 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 298/592] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:16:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:48.341057 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763ff883-d7c9-41c5-8d6b-9f3192737f34 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:48.386080 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:48.412803 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347b8916-10c3-47ce-a144-793770b3db28 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:48.459029 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ae2ad5-4347-459f-bb9e-7ccfe8506a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:48.459691 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae2ad5-4347-459f-bb9e-7ccfe8506a2c None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:48.460214 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae2ad5-4347-459f-bb9e-7ccfe8506a2c None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:48.460494 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae2ad5-4347-459f-bb9e-7ccfe8506a2c None admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:48.461638 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ae2ad5-4347-459f-bb9e-7ccfe8506a2c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:48.462005 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ae2ad5-4347-459f-bb9e-7ccfe8506a2c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:48.463985 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ae2ad5-4347-459f-bb9e-7ccfe8506a2c None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:48.471463 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763ff883-d7c9-41c5-8d6b-9f3192737f34 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:48.493628 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 295/593] 10.222.0.60 () {56 vars in 1137 bytes} [Tue Aug 30 01:16:48 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:48.494628 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ae2ad5-4347-459f-bb9e-7ccfe8506a2c None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:48.512890 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb028335-ec35-4e8f-ba5a-3a2943e41c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:48.513765 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb028335-ec35-4e8f-ba5a-3a2943e41c86 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:48.514207 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb028335-ec35-4e8f-ba5a-3a2943e41c86 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:48.514653 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb028335-ec35-4e8f-ba5a-3a2943e41c86 None admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:48.515533 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb028335-ec35-4e8f-ba5a-3a2943e41c86 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:48.515999 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb028335-ec35-4e8f-ba5a-3a2943e41c86 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:48.517580 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb028335-ec35-4e8f-ba5a-3a2943e41c86 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:48.534493 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:48.535417 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 299/594] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 30 01:16:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:48.536491 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb028335-ec35-4e8f-ba5a-3a2943e41c86 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:48.607260 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ae2ad5-4347-459f-bb9e-7ccfe8506a2c None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:48.637408 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:48.645402 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb028335-ec35-4e8f-ba5a-3a2943e41c86 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:48.646966 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d513d1fe-8743-49c2-9700-0d3951427901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:48.648148 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513d1fe-8743-49c2-9700-0d3951427901 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:48.648433 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513d1fe-8743-49c2-9700-0d3951427901 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:48.648709 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513d1fe-8743-49c2-9700-0d3951427901 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:48.657246 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d513d1fe-8743-49c2-9700-0d3951427901 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:48.658843 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d513d1fe-8743-49c2-9700-0d3951427901 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:48.671786 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-d513d1fe-8743-49c2-9700-0d3951427901 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 01:16:48.671786 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:48.671786 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:48.671786 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:48.671786 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:48.671786 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:48.671786 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:48.671786 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:48.671786 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:48.671786 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:48.671786 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:48.671786 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:48.671786 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 01:16:48.671786 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 01:16:48.671786 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 01:16:48.671786 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 01:16:48.672954 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:48.672954 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:48.672954 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 01:16:48.672954 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:16:48.672954 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 01:16:48.672954 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:16:48.672954 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:48.672954 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:48.672954 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:48.672954 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:48.672954 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:48.672954 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:48.672954 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:48.672954 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:48.672954 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:48.672954 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:48.672954 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:48.672954 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:48.674102 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:48.674102 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:48.674102 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 01:16:48.674102 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 01:16:48.674102 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 01:16:48.674102 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 01:16:48.674102 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 01:16:48.674102 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 01:16:48.674102 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 01:16:48.674102 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:16:48.674102 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 296/595] 10.222.0.60 () {56 vars in 1102 bytes} [Tue Aug 30 01:16:48 2022] GET /identity/v3/users/neutron => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:48.674102 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d513d1fe-8743-49c2-9700-0d3951427901 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:48.688150 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9feade-a508-4955-a688-d9e2dafa1075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:48.688788 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9feade-a508-4955-a688-d9e2dafa1075 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:48.689103 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9feade-a508-4955-a688-d9e2dafa1075 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:48.689412 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9feade-a508-4955-a688-d9e2dafa1075 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:48.705645 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9feade-a508-4955-a688-d9e2dafa1075 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:48.708446 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9feade-a508-4955-a688-d9e2dafa1075 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:48.731326 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-9d9feade-a508-4955-a688-d9e2dafa1075 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:48.731326 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:48.731326 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:48.731326 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:48.731326 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:48.731326 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:48.731326 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:48.731326 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:48.731326 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:48.731326 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:48.731326 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:48.731326 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:48.731326 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:16:48.731326 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:16:48.731326 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:16:48.731326 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:16:48.732567 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:48.732567 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:48.732567 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:48.732567 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:48.732567 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:48.732567 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:48.732567 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:48.732567 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:48.732567 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:48.732567 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:48.732567 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:48.732567 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:48.732567 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:48.732567 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:48.732567 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:48.732567 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:48.732567 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:16:48.733741 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:16:48.733741 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:48.733741 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:16:48.733741 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 300/596] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:16:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:48.733741 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9feade-a508-4955-a688-d9e2dafa1075 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:48.813598 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:48.824789 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d513d1fe-8743-49c2-9700-0d3951427901 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:48.854030 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9feade-a508-4955-a688-d9e2dafa1075 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:48.872842 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b808c3-7eff-4134-9f06-b8e496590381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:48.874025 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b808c3-7eff-4134-9f06-b8e496590381 None admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:48.874308 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b808c3-7eff-4134-9f06-b8e496590381 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:48.874578 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b808c3-7eff-4134-9f06-b8e496590381 None admin] PATH_INFO: `/v3/projects/b050b2dad22a4a06875072e44c8c9824/users/8889145228a24fb6bd539a11925e62f2/roles/01439ffbf0dd41caadd0cc40b3176062` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:48.894668 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f856f92a-a8bb-401f-8a32-294eaf85e6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:48.895645 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856f92a-a8bb-401f-8a32-294eaf85e6db None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:48.895824 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b808c3-7eff-4134-9f06-b8e496590381 None admin] RBAC: Authorizing `identity:create_grant(project_id=b050b2dad22a4a06875072e44c8c9824, user_id=8889145228a24fb6bd539a11925e62f2, role_id=01439ffbf0dd41caadd0cc40b3176062)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:48.896270 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856f92a-a8bb-401f-8a32-294eaf85e6db None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:48.896728 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856f92a-a8bb-401f-8a32-294eaf85e6db None admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:48.897640 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f856f92a-a8bb-401f-8a32-294eaf85e6db None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:48.897748 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b808c3-7eff-4134-9f06-b8e496590381 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:48.898232 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f856f92a-a8bb-401f-8a32-294eaf85e6db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:48.899867 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f856f92a-a8bb-401f-8a32-294eaf85e6db None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:48.923469 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 297/597] 10.222.0.60 () {58 vars in 1439 bytes} [Tue Aug 30 01:16:48 2022] PUT /identity/v3/projects/b050b2dad22a4a06875072e44c8c9824/users/8889145228a24fb6bd539a11925e62f2/roles/01439ffbf0dd41caadd0cc40b3176062 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:16:48.923469 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b808c3-7eff-4134-9f06-b8e496590381 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:48.924686 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 301/598] 10.222.0.60 () {56 vars in 1139 bytes} [Tue Aug 30 01:16:48 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:48.929986 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f856f92a-a8bb-401f-8a32-294eaf85e6db None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:48.943821 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:49.080028 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b808c3-7eff-4134-9f06-b8e496590381 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:49.125056 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b875e-6cba-4887-bdb9-71f76c2ee3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:49.125273 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f856f92a-a8bb-401f-8a32-294eaf85e6db None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:49.125664 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b875e-6cba-4887-bdb9-71f76c2ee3ce None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:49.125940 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b875e-6cba-4887-bdb9-71f76c2ee3ce None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:49.126210 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b875e-6cba-4887-bdb9-71f76c2ee3ce None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:49.126847 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43b875e-6cba-4887-bdb9-71f76c2ee3ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:49.127199 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43b875e-6cba-4887-bdb9-71f76c2ee3ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:49.128849 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43b875e-6cba-4887-bdb9-71f76c2ee3ce None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:49.147602 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 298/599] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:16:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:49.152653 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b875e-6cba-4887-bdb9-71f76c2ee3ce None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:49.163216 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:49.180157 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cae9ec-5a70-44b8-9aa0-622cf1e66f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:49.181131 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cae9ec-5a70-44b8-9aa0-622cf1e66f82 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:49.181871 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cae9ec-5a70-44b8-9aa0-622cf1e66f82 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:49.182337 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cae9ec-5a70-44b8-9aa0-622cf1e66f82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:49.201366 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cae9ec-5a70-44b8-9aa0-622cf1e66f82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:49.203780 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cae9ec-5a70-44b8-9aa0-622cf1e66f82 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:49.248028 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-e5cae9ec-5a70-44b8-9aa0-622cf1e66f82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:49.248028 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:49.248028 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:49.248028 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:49.248028 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:49.248028 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:49.248028 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:49.248028 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:49.248028 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:49.248028 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:49.248028 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:49.248028 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:49.248028 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:16:49.248028 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:16:49.248028 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:16:49.248028 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:16:49.249027 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:49.249027 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:49.249027 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:49.249027 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:49.249027 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:49.249027 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:49.249027 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:49.249027 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:49.249027 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:49.249027 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:49.249027 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:49.249027 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:49.249027 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:49.249027 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:49.249027 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:49.249027 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:49.249027 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:16:49.250504 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:16:49.250504 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:49.250504 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:16:49.250504 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 302/600] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:16:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:49.255035 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cae9ec-5a70-44b8-9aa0-622cf1e66f82 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:49.321866 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b875e-6cba-4887-bdb9-71f76c2ee3ce None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:49.376870 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:49.397074 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a53e50-09b7-4f82-868e-4e96316ee87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:49.398609 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a53e50-09b7-4f82-868e-4e96316ee87b None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:49.400076 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a53e50-09b7-4f82-868e-4e96316ee87b None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:49.401619 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a53e50-09b7-4f82-868e-4e96316ee87b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:49.417711 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a53e50-09b7-4f82-868e-4e96316ee87b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:49.419604 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a53e50-09b7-4f82-868e-4e96316ee87b None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:49.445549 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cae9ec-5a70-44b8-9aa0-622cf1e66f82 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:49.452615 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-a1a53e50-09b7-4f82-868e-4e96316ee87b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:16:49.452615 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:49.452615 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:49.452615 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:49.452615 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:49.452615 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:49.452615 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:49.452615 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:49.452615 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:49.452615 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:49.452615 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:49.452615 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:49.452615 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 01:16:49.452615 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 01:16:49.452615 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 01:16:49.453486 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 01:16:49.453486 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:49.453486 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:49.453486 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:49.453486 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:49.453486 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:49.453486 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:49.453486 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:49.453486 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:49.453486 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:49.453486 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:49.453486 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:49.453486 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:49.453486 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:49.453486 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:49.453486 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:49.453486 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:49.454362 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 01:16:49.454362 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 01:16:49.454362 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 01:16:49.454362 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 01:16:49.454362 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 01:16:49.454362 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 01:16:49.454362 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:16:49.454362 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:16:49.460681 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 299/601] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 30 01:16:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:49.466652 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a53e50-09b7-4f82-868e-4e96316ee87b None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:49.509506 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9460f0-89c1-48d2-828d-073566f042ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:49.510468 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9460f0-89c1-48d2-828d-073566f042ca None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:49.511991 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9460f0-89c1-48d2-828d-073566f042ca None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:49.512485 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9460f0-89c1-48d2-828d-073566f042ca None admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:49.513324 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9460f0-89c1-48d2-828d-073566f042ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:49.514046 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9460f0-89c1-48d2-828d-073566f042ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:49.516588 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9460f0-89c1-48d2-828d-073566f042ca None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:49.540504 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 303/602] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:16:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:16:49.545969 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9460f0-89c1-48d2-828d-073566f042ca None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:49.595712 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:49.665370 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a53e50-09b7-4f82-868e-4e96316ee87b None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:49.719120 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9460f0-89c1-48d2-828d-073566f042ca None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:49.733516 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7881bf2d-b15a-49cf-8cfa-bb6c21c39dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:49.734478 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7881bf2d-b15a-49cf-8cfa-bb6c21c39dc5 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:49.734953 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7881bf2d-b15a-49cf-8cfa-bb6c21c39dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:49.735416 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7881bf2d-b15a-49cf-8cfa-bb6c21c39dc5 None admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:49.736322 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7881bf2d-b15a-49cf-8cfa-bb6c21c39dc5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:49.736837 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7881bf2d-b15a-49cf-8cfa-bb6c21c39dc5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:49.738502 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7881bf2d-b15a-49cf-8cfa-bb6c21c39dc5 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:49.755285 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 300/603] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 30 01:16:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:16:49.757181 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:49.762068 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7881bf2d-b15a-49cf-8cfa-bb6c21c39dc5 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:49.792954 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d0713c-1b03-499b-aed8-a0dfe7211973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:49.793978 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d0713c-1b03-499b-aed8-a0dfe7211973 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:49.794632 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d0713c-1b03-499b-aed8-a0dfe7211973 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:49.795810 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d0713c-1b03-499b-aed8-a0dfe7211973 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:49.809901 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d0713c-1b03-499b-aed8-a0dfe7211973 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:49.812405 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d0713c-1b03-499b-aed8-a0dfe7211973 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:49.825709 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-d0d0713c-1b03-499b-aed8-a0dfe7211973 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:16:49.825709 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:49.825709 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:49.825709 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:49.825709 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:49.825709 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:49.825709 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:49.825709 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:49.825709 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:49.825709 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:49.825709 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:49.825709 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:49.825709 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 01:16:49.825709 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 01:16:49.825709 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 01:16:49.826617 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 01:16:49.826617 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:49.826617 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:49.826617 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:49.826617 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:49.826617 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:49.826617 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:49.826617 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:49.826617 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:49.826617 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:49.826617 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:49.826617 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:49.826617 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:49.826617 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:49.826617 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:49.826617 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:49.826617 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:49.827531 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 01:16:49.827531 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 01:16:49.827531 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 01:16:49.827531 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 01:16:49.827531 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 01:16:49.827531 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 01:16:49.827531 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:16:49.827531 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:16:49.829938 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 304/604] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 30 01:16:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:49.836471 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d0713c-1b03-499b-aed8-a0dfe7211973 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:49.897968 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7881bf2d-b15a-49cf-8cfa-bb6c21c39dc5 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:49.931962 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:49.936063 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b988f3e2-d3e2-4d50-b3d1-4ec13b7b89b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:49.937342 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988f3e2-d3e2-4d50-b3d1-4ec13b7b89b5 None admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:49.937626 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988f3e2-d3e2-4d50-b3d1-4ec13b7b89b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:49.937908 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988f3e2-d3e2-4d50-b3d1-4ec13b7b89b5 None admin] PATH_INFO: `/v3/projects/b050b2dad22a4a06875072e44c8c9824/users/e3040f72d52249f1b0e19e3a200bd16e/roles/01439ffbf0dd41caadd0cc40b3176062` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:49.958033 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b988f3e2-d3e2-4d50-b3d1-4ec13b7b89b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=b050b2dad22a4a06875072e44c8c9824, user_id=e3040f72d52249f1b0e19e3a200bd16e, role_id=01439ffbf0dd41caadd0cc40b3176062)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:49.960365 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b988f3e2-d3e2-4d50-b3d1-4ec13b7b89b5 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:49.980625 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 301/605] 10.222.0.60 () {58 vars in 1439 bytes} [Tue Aug 30 01:16:49 2022] PUT /identity/v3/projects/b050b2dad22a4a06875072e44c8c9824/users/e3040f72d52249f1b0e19e3a200bd16e/roles/01439ffbf0dd41caadd0cc40b3176062 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:16:49.982318 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15cf8f-3493-4bdd-89a3-9a4edef50563 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:49.982650 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15cf8f-3493-4bdd-89a3-9a4edef50563 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:49.982924 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15cf8f-3493-4bdd-89a3-9a4edef50563 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:49.983219 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d0713c-1b03-499b-aed8-a0dfe7211973 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:49.984644 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 302/606] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:16:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:16:49.992171 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff20cdff-8a5d-46b9-9bd1-1eeade0dc379 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:49.992492 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff20cdff-8a5d-46b9-9bd1-1eeade0dc379 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:49.992722 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff20cdff-8a5d-46b9-9bd1-1eeade0dc379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:50.032418 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-ff20cdff-8a5d-46b9-9bd1-1eeade0dc379 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:50.033690 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-ff20cdff-8a5d-46b9-9bd1-1eeade0dc379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:50.062488 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb3858-52ec-4ea6-9a9c-a5d55aa1064b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:50.063148 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb3858-52ec-4ea6-9a9c-a5d55aa1064b None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:50.063492 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb3858-52ec-4ea6-9a9c-a5d55aa1064b None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:50.063770 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb3858-52ec-4ea6-9a9c-a5d55aa1064b None admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:50.064476 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cb3858-52ec-4ea6-9a9c-a5d55aa1064b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:50.064788 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cb3858-52ec-4ea6-9a9c-a5d55aa1064b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:50.067988 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cb3858-52ec-4ea6-9a9c-a5d55aa1064b None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:50.093883 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 305/607] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 30 01:16:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:50.099222 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb3858-52ec-4ea6-9a9c-a5d55aa1064b None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:50.180764 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:50.214219 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 303/608] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:16:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 01:16:50.287537 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb3858-52ec-4ea6-9a9c-a5d55aa1064b None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:50.340400 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc2ef9-44c4-4bdb-bdf5-2671aae85661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:50.341475 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc2ef9-44c4-4bdb-bdf5-2671aae85661 None admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:50.341982 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc2ef9-44c4-4bdb-bdf5-2671aae85661 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:50.342464 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc2ef9-44c4-4bdb-bdf5-2671aae85661 None admin] PATH_INFO: `/v3/projects/b050b2dad22a4a06875072e44c8c9824/users/61e48e00a0c34949a4fffae8c372304e/roles/01439ffbf0dd41caadd0cc40b3176062` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:50.372806 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafc2ef9-44c4-4bdb-bdf5-2671aae85661 None admin] RBAC: Authorizing `identity:create_grant(project_id=b050b2dad22a4a06875072e44c8c9824, user_id=61e48e00a0c34949a4fffae8c372304e, role_id=01439ffbf0dd41caadd0cc40b3176062)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:50.374601 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafc2ef9-44c4-4bdb-bdf5-2671aae85661 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:50.411654 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 306/609] 10.222.0.60 () {58 vars in 1439 bytes} [Tue Aug 30 01:16:50 2022] PUT /identity/v3/projects/b050b2dad22a4a06875072e44c8c9824/users/61e48e00a0c34949a4fffae8c372304e/roles/01439ffbf0dd41caadd0cc40b3176062 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:16:50.532150 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff20cdff-8a5d-46b9-9bd1-1eeade0dc379 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:50.546109 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5494c7-bf0c-474a-94e6-93c76bd6ff25 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:50.546439 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5494c7-bf0c-474a-94e6-93c76bd6ff25 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:50.546651 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5494c7-bf0c-474a-94e6-93c76bd6ff25 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:50.548308 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 307/610] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:16:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:16:50.555054 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcde6c6-e60e-48c3-8e77-ca25b0e73b96 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:50.555368 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcde6c6-e60e-48c3-8e77-ca25b0e73b96 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:50.555626 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcde6c6-e60e-48c3-8e77-ca25b0e73b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:50.582307 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-6fcde6c6-e60e-48c3-8e77-ca25b0e73b96 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:50.583598 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-6fcde6c6-e60e-48c3-8e77-ca25b0e73b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:50.711585 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 308/611] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:16:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 01:16:50.737409 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff20cdff-8a5d-46b9-9bd1-1eeade0dc379 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:50.750512 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:50.799665 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59889c5e-11cf-4486-a64d-e819fd2c304e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:50.800231 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59889c5e-11cf-4486-a64d-e819fd2c304e None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:50.800516 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59889c5e-11cf-4486-a64d-e819fd2c304e None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:50.800787 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59889c5e-11cf-4486-a64d-e819fd2c304e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:50.815876 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59889c5e-11cf-4486-a64d-e819fd2c304e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:16:50.820791 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-59889c5e-11cf-4486-a64d-e819fd2c304e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 01:16:50.820791 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:50.820791 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:50.820791 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:50.820791 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:50.820791 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:50.820791 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:50.820791 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:50.820791 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:50.820791 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:50.820791 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:50.820791 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:50.820791 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:16:50.820791 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:16:50.820791 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:16:50.820791 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:16:50.821713 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:16:50.821713 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:16:50.821713 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:16:50.821713 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:16:50.821713 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:50.821713 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:50.821713 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:50.821713 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:50.821713 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:50.821713 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:50.821713 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:50.821713 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:50.821713 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:50.821713 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:50.821713 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:50.821713 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:50.822536 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:50.822536 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:50.822536 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:50.822536 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:50.822536 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:16:50.822536 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:16:50.822536 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:16:50.822536 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:16:50.822536 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:16:50.822536 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:16:50.822536 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 01:16:50.822536 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:16:50.822536 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 304/612] 10.222.0.60 () {56 vars in 1102 bytes} [Tue Aug 30 01:16:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:50.828002 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcde6c6-e60e-48c3-8e77-ca25b0e73b96 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:50.869821 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:51.003464 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcde6c6-e60e-48c3-8e77-ca25b0e73b96 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:51.048389 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4171e4-0b6c-4e6e-a03b-de18217e5555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:51.049003 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4171e4-0b6c-4e6e-a03b-de18217e5555 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:51.049276 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4171e4-0b6c-4e6e-a03b-de18217e5555 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:51.049580 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4171e4-0b6c-4e6e-a03b-de18217e5555 None admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:51.050301 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4171e4-0b6c-4e6e-a03b-de18217e5555 None admin] RBAC: Adding query filter params (name=service) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:51.050543 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4171e4-0b6c-4e6e-a03b-de18217e5555 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:51.051937 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4171e4-0b6c-4e6e-a03b-de18217e5555 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:51.066138 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 309/613] 10.222.0.60 () {56 vars in 1103 bytes} [Tue Aug 30 01:16:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:51.071196 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59889c5e-11cf-4486-a64d-e819fd2c304e None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:51.095103 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4171e4-0b6c-4e6e-a03b-de18217e5555 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:51.186758 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:51.227116 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4171e4-0b6c-4e6e-a03b-de18217e5555 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:51.276247 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59889c5e-11cf-4486-a64d-e819fd2c304e None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:51.295122 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da51e62-0b18-401f-b063-bf76d2b2922a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:51.296047 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da51e62-0b18-401f-b063-bf76d2b2922a None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:51.296813 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da51e62-0b18-401f-b063-bf76d2b2922a None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:51.297089 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da51e62-0b18-401f-b063-bf76d2b2922a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:51.312753 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da51e62-0b18-401f-b063-bf76d2b2922a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:16:51.317575 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd28825-404e-4980-854a-fd648dba5091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:51.318199 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd28825-404e-4980-854a-fd648dba5091 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:51.318573 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd28825-404e-4980-854a-fd648dba5091 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:51.318879 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd28825-404e-4980-854a-fd648dba5091 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:51.319842 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-0da51e62-0b18-401f-b063-bf76d2b2922a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 01:16:51.319842 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:51.319842 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:51.319842 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:51.319842 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:51.319842 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:51.319842 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:51.319842 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:51.319842 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:51.319842 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:51.319842 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:51.319842 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:51.319842 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:16:51.319842 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:16:51.319842 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:16:51.319842 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:16:51.320743 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:16:51.320743 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:16:51.320743 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:16:51.320743 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:16:51.320743 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:51.320743 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:51.320743 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:51.320743 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:51.320743 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:51.320743 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:51.320743 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:51.320743 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:51.320743 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:51.320743 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:51.320743 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:51.320743 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:51.321610 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:51.321610 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:51.321610 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:51.321610 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:51.321610 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:16:51.321610 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:16:51.321610 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:16:51.321610 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:16:51.321610 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:16:51.321610 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:16:51.321610 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 01:16:51.321610 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:16:51.323582 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 310/614] 10.222.0.60 () {56 vars in 1102 bytes} [Tue Aug 30 01:16:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:51.324808 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f8185-f189-40a9-8281-f6fa4d8d8648 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:51.325084 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f8185-f189-40a9-8281-f6fa4d8d8648 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:51.325354 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f8185-f189-40a9-8281-f6fa4d8d8648 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:51.326590 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 311/615] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:16:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:16:51.328238 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03f8185-f189-40a9-8281-f6fa4d8d8648 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:51.340789 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd28825-404e-4980-854a-fd648dba5091 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:51.342335 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd28825-404e-4980-854a-fd648dba5091 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:51.358795 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-8cd28825-404e-4980-854a-fd648dba5091 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:51.358795 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:51.358795 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:51.358795 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:51.358795 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:51.358795 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:51.358795 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:51.358795 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:51.358795 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:51.358795 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:51.358795 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:51.358795 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:51.358795 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:16:51.358795 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:16:51.358795 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:16:51.358795 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:16:51.359831 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:51.359831 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:51.359831 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:51.359831 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:51.359831 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:51.359831 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:51.359831 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:51.359831 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:51.359831 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:51.359831 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:51.359831 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:51.359831 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:51.359831 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:51.359831 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:51.359831 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:51.359831 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:51.359831 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:16:51.360743 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:16:51.360743 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:51.360743 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:16:51.360743 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 305/616] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:16:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:51.362898 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ea2b9-ad22-4aa0-9a2e-d610253bc48f None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:51.362898 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ea2b9-ad22-4aa0-9a2e-d610253bc48f None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:51.362898 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ea2b9-ad22-4aa0-9a2e-d610253bc48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:51.386189 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-fc2ea2b9-ad22-4aa0-9a2e-d610253bc48f None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:51.387311 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-fc2ea2b9-ad22-4aa0-9a2e-d610253bc48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:51.446557 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03f8185-f189-40a9-8281-f6fa4d8d8648 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:51.461819 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:51.462397 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 306/617] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:16:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:16:51.463138 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ea2b9-ad22-4aa0-9a2e-d610253bc48f None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:51.484354 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe6164-2e22-4726-924e-afea382a1c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:51.485332 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe6164-2e22-4726-924e-afea382a1c3f None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:51.485824 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe6164-2e22-4726-924e-afea382a1c3f None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:51.486329 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe6164-2e22-4726-924e-afea382a1c3f None admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:51.487221 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fe6164-2e22-4726-924e-afea382a1c3f None admin] RBAC: Adding query filter params (name=service) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:51.487771 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fe6164-2e22-4726-924e-afea382a1c3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:51.489357 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fe6164-2e22-4726-924e-afea382a1c3f None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:51.503644 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:51.510215 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 312/618] 10.222.0.60 () {56 vars in 1103 bytes} [Tue Aug 30 01:16:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:51.515934 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe6164-2e22-4726-924e-afea382a1c3f None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:51.569648 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ea2b9-ad22-4aa0-9a2e-d610253bc48f None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:51.617042 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79188b4-ad70-4fe3-8cd9-0d6a17416e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:51.617967 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79188b4-ad70-4fe3-8cd9-0d6a17416e00 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:51.618402 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79188b4-ad70-4fe3-8cd9-0d6a17416e00 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:51.618815 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79188b4-ad70-4fe3-8cd9-0d6a17416e00 None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:51.619615 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79188b4-ad70-4fe3-8cd9-0d6a17416e00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:51.620058 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79188b4-ad70-4fe3-8cd9-0d6a17416e00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:51.621706 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79188b4-ad70-4fe3-8cd9-0d6a17416e00 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:51.633998 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 307/619] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:16:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:51.638989 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79188b4-ad70-4fe3-8cd9-0d6a17416e00 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:51.655747 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:51.704725 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe6164-2e22-4726-924e-afea382a1c3f None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:51.747031 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d4cad-fd63-4fa9-844f-ede2d366c587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:51.749068 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d4cad-fd63-4fa9-844f-ede2d366c587 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:51.750643 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d4cad-fd63-4fa9-844f-ede2d366c587 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:51.751061 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d4cad-fd63-4fa9-844f-ede2d366c587 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:51.778381 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482d4cad-fd63-4fa9-844f-ede2d366c587 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:51.780115 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482d4cad-fd63-4fa9-844f-ede2d366c587 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:51.797596 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-482d4cad-fd63-4fa9-844f-ede2d366c587 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:51.797596 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:51.797596 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:51.797596 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:51.797596 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:51.797596 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:51.797596 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:51.797596 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:51.797596 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:51.797596 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:51.797596 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:51.797596 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:51.797596 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:16:51.797596 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:16:51.797596 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:16:51.797596 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:16:51.798596 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:51.798596 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:51.798596 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:51.798596 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:51.798596 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:51.798596 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:51.798596 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:51.798596 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:51.798596 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:51.798596 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:51.798596 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:51.798596 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:51.798596 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:51.798596 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:51.798596 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:51.798596 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:51.798596 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:16:51.799595 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:16:51.799595 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:51.799595 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:16:51.802906 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 313/620] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:16:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:16:51.804272 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d4cad-fd63-4fa9-844f-ede2d366c587 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:51.812513 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79188b4-ad70-4fe3-8cd9-0d6a17416e00 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:51.851366 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829abf0a-ede7-49e3-8d55-fd76800dd137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:51.851940 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829abf0a-ede7-49e3-8d55-fd76800dd137 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:51.852218 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829abf0a-ede7-49e3-8d55-fd76800dd137 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:51.852488 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829abf0a-ede7-49e3-8d55-fd76800dd137 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:51.860683 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829abf0a-ede7-49e3-8d55-fd76800dd137 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:51.862154 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829abf0a-ede7-49e3-8d55-fd76800dd137 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:51.863826 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:51.875494 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-829abf0a-ede7-49e3-8d55-fd76800dd137 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 30 01:16:51.875494 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:51.875494 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:51.875494 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:51.875494 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:51.875494 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:51.875494 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:51.875494 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:51.875494 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:51.875494 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:51.875494 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:51.875494 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:51.875494 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 01:16:51.875494 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 01:16:51.875494 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 01:16:51.875494 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 01:16:51.876780 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:51.876780 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:51.876780 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 01:16:51.876780 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:16:51.876780 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 01:16:51.876780 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:16:51.876780 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:51.876780 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:51.876780 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:51.876780 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:51.876780 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:51.876780 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:51.876780 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:51.876780 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:51.876780 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:51.876780 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:51.876780 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:51.876780 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:51.878420 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:51.878420 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:51.878420 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 01:16:51.878420 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 01:16:51.878420 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 01:16:51.878420 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 01:16:51.878420 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 01:16:51.878420 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 01:16:51.878420 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 30 01:16:51.878420 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:16:51.880756 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 308/621] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 30 01:16:51 2022] GET /identity/v3/users/glance => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:51.881880 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829abf0a-ede7-49e3-8d55-fd76800dd137 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:51.918888 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d4cad-fd63-4fa9-844f-ede2d366c587 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:51.954600 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3786bcdb-90fc-4ae4-b78e-636da162a771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:51.955405 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786bcdb-90fc-4ae4-b78e-636da162a771 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:51.955857 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786bcdb-90fc-4ae4-b78e-636da162a771 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:51.956319 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786bcdb-90fc-4ae4-b78e-636da162a771 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:51.957775 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:51.974039 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3786bcdb-90fc-4ae4-b78e-636da162a771 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:16:51.980656 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-3786bcdb-90fc-4ae4-b78e-636da162a771 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 01:16:51.980656 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:51.980656 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:51.980656 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:51.980656 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:51.980656 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:51.980656 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:51.980656 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:51.980656 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:51.980656 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:51.980656 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:51.980656 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:51.980656 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:16:51.980656 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:16:51.980656 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:16:51.980656 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:16:51.981776 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:16:51.981776 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:16:51.981776 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:16:51.981776 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:16:51.981776 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:51.981776 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:51.981776 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:51.981776 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:51.981776 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:51.981776 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:51.981776 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:51.981776 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:51.981776 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:51.981776 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:51.981776 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:51.981776 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:51.982688 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:51.982688 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:51.982688 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:51.982688 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:51.982688 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:16:51.982688 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:16:51.982688 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:16:51.982688 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:16:51.982688 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:16:51.982688 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:16:51.982688 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 01:16:51.982688 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:16:51.987908 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 314/622] 10.222.0.60 () {56 vars in 1102 bytes} [Tue Aug 30 01:16:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:51.988801 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3786bcdb-90fc-4ae4-b78e-636da162a771 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:52.001432 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829abf0a-ede7-49e3-8d55-fd76800dd137 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:52.038842 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806efba2-e8e0-4d93-b3a3-f71ec9038fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:52.039834 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806efba2-e8e0-4d93-b3a3-f71ec9038fc2 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:52.040441 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806efba2-e8e0-4d93-b3a3-f71ec9038fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:52.040934 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806efba2-e8e0-4d93-b3a3-f71ec9038fc2 None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:52.041830 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806efba2-e8e0-4d93-b3a3-f71ec9038fc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:52.042347 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806efba2-e8e0-4d93-b3a3-f71ec9038fc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:52.043959 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806efba2-e8e0-4d93-b3a3-f71ec9038fc2 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:52.058841 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 309/623] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:16:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:52.060087 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806efba2-e8e0-4d93-b3a3-f71ec9038fc2 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:52.094321 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3786bcdb-90fc-4ae4-b78e-636da162a771 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:52.108816 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:52.132036 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9837c494-ab8e-4e66-875b-806e7e547ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:52.132631 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837c494-ab8e-4e66-875b-806e7e547ac1 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:52.132900 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837c494-ab8e-4e66-875b-806e7e547ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:52.133173 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837c494-ab8e-4e66-875b-806e7e547ac1 None admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:52.133909 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9837c494-ab8e-4e66-875b-806e7e547ac1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:52.134212 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9837c494-ab8e-4e66-875b-806e7e547ac1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:52.135725 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9837c494-ab8e-4e66-875b-806e7e547ac1 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:52.153950 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 315/624] 10.222.0.60 () {56 vars in 1137 bytes} [Tue Aug 30 01:16:51 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:52.154886 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9837c494-ab8e-4e66-875b-806e7e547ac1 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:52.175211 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806efba2-e8e0-4d93-b3a3-f71ec9038fc2 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:52.204432 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:52.214107 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd6692-bbf6-42f7-ad56-a865748dfe8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:52.215389 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd6692-bbf6-42f7-ad56-a865748dfe8d None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:52.215894 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd6692-bbf6-42f7-ad56-a865748dfe8d None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:52.216365 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd6692-bbf6-42f7-ad56-a865748dfe8d None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:52.217238 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bd6692-bbf6-42f7-ad56-a865748dfe8d None admin] RBAC: Adding query filter params (name=service) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:52.217752 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bd6692-bbf6-42f7-ad56-a865748dfe8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:52.219505 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bd6692-bbf6-42f7-ad56-a865748dfe8d None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:52.229220 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 310/625] 10.222.0.60 () {56 vars in 1103 bytes} [Tue Aug 30 01:16:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:52.230443 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd6692-bbf6-42f7-ad56-a865748dfe8d None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:52.270893 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9837c494-ab8e-4e66-875b-806e7e547ac1 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:52.309484 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8367a151-2eec-4677-ab89-14aa21d6c9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:52.310121 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367a151-2eec-4677-ab89-14aa21d6c9b3 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:52.310401 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367a151-2eec-4677-ab89-14aa21d6c9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:52.310675 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367a151-2eec-4677-ab89-14aa21d6c9b3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:52.318827 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8367a151-2eec-4677-ab89-14aa21d6c9b3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:52.320908 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8367a151-2eec-4677-ab89-14aa21d6c9b3 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:52.334413 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-8367a151-2eec-4677-ab89-14aa21d6c9b3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 01:16:52.334413 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:52.334413 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:52.334413 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:52.334413 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:52.334413 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:52.334413 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:52.334413 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:52.334413 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:52.334413 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:52.334413 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:52.334413 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:52.334413 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 01:16:52.334413 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 01:16:52.334413 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 01:16:52.334413 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 01:16:52.335376 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:52.335376 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:52.335376 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 01:16:52.335376 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:16:52.335376 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 01:16:52.335376 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:16:52.335376 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:52.335376 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:52.335376 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:52.335376 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:52.335376 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:52.335376 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:52.335376 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:52.335376 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:52.335376 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:52.335376 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:52.335376 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:52.335376 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:52.336338 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:52.336338 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:52.336338 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 01:16:52.336338 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 01:16:52.336338 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 01:16:52.336338 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 01:16:52.336338 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 01:16:52.336338 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 01:16:52.336338 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 01:16:52.336338 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:16:52.336338 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 316/626] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 30 01:16:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:52.336944 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8367a151-2eec-4677-ab89-14aa21d6c9b3 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:52.342214 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd6692-bbf6-42f7-ad56-a865748dfe8d None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:52.370285 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:52.379904 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c493e09a-e40c-4df9-a271-b9d96e95467f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:52.381522 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c493e09a-e40c-4df9-a271-b9d96e95467f None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:52.381948 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c493e09a-e40c-4df9-a271-b9d96e95467f None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:52.382363 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c493e09a-e40c-4df9-a271-b9d96e95467f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:52.444382 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:52.445308 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8367a151-2eec-4677-ab89-14aa21d6c9b3 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:52.457692 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c493e09a-e40c-4df9-a271-b9d96e95467f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:52.459619 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c493e09a-e40c-4df9-a271-b9d96e95467f None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:52.480829 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8552803b-a265-40af-aa68-29a610e78df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:52.481458 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552803b-a265-40af-aa68-29a610e78df6 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:52.481732 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552803b-a265-40af-aa68-29a610e78df6 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:52.482422 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552803b-a265-40af-aa68-29a610e78df6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:52.493183 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8552803b-a265-40af-aa68-29a610e78df6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:52.494676 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8552803b-a265-40af-aa68-29a610e78df6 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:52.509869 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-8552803b-a265-40af-aa68-29a610e78df6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:52.509869 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:52.509869 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:52.509869 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:52.509869 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:52.509869 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:52.509869 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:52.509869 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:52.509869 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:52.509869 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:52.509869 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:52.509869 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:52.509869 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:16:52.509869 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:16:52.509869 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:16:52.509869 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:16:52.510848 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:52.510848 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:52.510848 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:52.510848 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:52.510848 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:52.510848 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:52.510848 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:52.510848 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:52.510848 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:52.510848 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:52.510848 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:52.510848 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:52.510848 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:52.510848 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:52.510848 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:52.510848 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:52.510848 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:16:52.511786 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:16:52.511786 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:52.511786 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:16:52.511786 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 317/627] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:16:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:52.511786 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8552803b-a265-40af-aa68-29a610e78df6 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:52.570644 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 311/628] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 30 01:16:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:52.571948 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575105c1-f02d-41a8-88a2-7622343afc10 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:52.572355 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575105c1-f02d-41a8-88a2-7622343afc10 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:52.572647 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575105c1-f02d-41a8-88a2-7622343afc10 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:52.578023 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 312/629] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:16:52.578023 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575105c1-f02d-41a8-88a2-7622343afc10 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:52.616314 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:52.637271 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8552803b-a265-40af-aa68-29a610e78df6 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:52.673608 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c75a17d-853e-4d23-9560-f1460589e922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:52.674086 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75a17d-853e-4d23-9560-f1460589e922 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:52.674461 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75a17d-853e-4d23-9560-f1460589e922 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:52.674665 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75a17d-853e-4d23-9560-f1460589e922 None admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:52.675397 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c75a17d-853e-4d23-9560-f1460589e922 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:52.675755 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c75a17d-853e-4d23-9560-f1460589e922 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:52.677319 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c75a17d-853e-4d23-9560-f1460589e922 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:52.683231 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:52.694473 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575105c1-f02d-41a8-88a2-7622343afc10 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:52.697158 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 318/630] 10.222.0.60 () {56 vars in 1135 bytes} [Tue Aug 30 01:16:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:52.697983 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c75a17d-853e-4d23-9560-f1460589e922 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:52.728528 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b418f-7bb9-4fee-8a58-c77c6bd99dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:52.729128 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b418f-7bb9-4fee-8a58-c77c6bd99dd0 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:52.729403 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b418f-7bb9-4fee-8a58-c77c6bd99dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:52.729671 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b418f-7bb9-4fee-8a58-c77c6bd99dd0 None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:52.730304 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b418f-7bb9-4fee-8a58-c77c6bd99dd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:52.730601 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b418f-7bb9-4fee-8a58-c77c6bd99dd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:52.732003 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b418f-7bb9-4fee-8a58-c77c6bd99dd0 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:52.744195 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 313/631] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:16:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:52.745403 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5920d742-407f-4ee7-b928-cb271fae055b None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:52.745692 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5920d742-407f-4ee7-b928-cb271fae055b None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:52.745967 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5920d742-407f-4ee7-b928-cb271fae055b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:52.763627 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-5920d742-407f-4ee7-b928-cb271fae055b None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:52.764812 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-5920d742-407f-4ee7-b928-cb271fae055b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:52.805146 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c75a17d-853e-4d23-9560-f1460589e922 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:52.829810 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 314/632] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:16:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:16:52.831689 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd575779-edd2-44fa-a1cc-169d62c6aa11 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:52.831972 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd575779-edd2-44fa-a1cc-169d62c6aa11 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:52.832319 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd575779-edd2-44fa-a1cc-169d62c6aa11 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:52.835576 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 315/633] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:16:52.835576 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd575779-edd2-44fa-a1cc-169d62c6aa11 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:52.842658 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510fe192-2c61-4e3b-bacb-bb427b102077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:52.843284 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510fe192-2c61-4e3b-bacb-bb427b102077 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:52.843746 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510fe192-2c61-4e3b-bacb-bb427b102077 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:52.843909 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510fe192-2c61-4e3b-bacb-bb427b102077 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:52.853266 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:52.856620 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510fe192-2c61-4e3b-bacb-bb427b102077 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:52.859261 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510fe192-2c61-4e3b-bacb-bb427b102077 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:52.879100 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-510fe192-2c61-4e3b-bacb-bb427b102077 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:52.879100 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:52.879100 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:52.879100 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:52.879100 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:52.879100 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:52.879100 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:52.879100 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:52.879100 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:52.879100 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:52.879100 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:52.879100 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:52.879100 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:16:52.879100 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:16:52.879100 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:16:52.879100 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:16:52.880516 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:52.880516 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:52.880516 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:52.880516 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:52.880516 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:52.880516 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:52.880516 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:52.880516 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:52.880516 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:52.880516 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:52.880516 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:52.880516 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:52.880516 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:52.880516 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:52.880516 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:52.880516 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:52.880516 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:16:52.887006 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:16:52.887006 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:52.887006 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:16:52.887006 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 319/634] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:16:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:52.887006 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510fe192-2c61-4e3b-bacb-bb427b102077 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:52.929354 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:52.951992 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd575779-edd2-44fa-a1cc-169d62c6aa11 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:52.990328 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af88cdb-f201-49d2-a4d3-6b5a3c09d2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:52.991045 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af88cdb-f201-49d2-a4d3-6b5a3c09d2d0 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:52.991319 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af88cdb-f201-49d2-a4d3-6b5a3c09d2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:52.991612 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af88cdb-f201-49d2-a4d3-6b5a3c09d2d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:53.002408 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af88cdb-f201-49d2-a4d3-6b5a3c09d2d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:53.004605 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af88cdb-f201-49d2-a4d3-6b5a3c09d2d0 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:53.009238 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510fe192-2c61-4e3b-bacb-bb427b102077 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:53.023490 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-3af88cdb-f201-49d2-a4d3-6b5a3c09d2d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:53.023490 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:53.023490 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:53.023490 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:53.023490 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:53.023490 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:53.023490 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:53.023490 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:53.023490 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:53.023490 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:53.023490 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:53.023490 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:53.023490 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:16:53.023490 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:16:53.023490 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:16:53.023490 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:16:53.024505 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:53.024505 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:53.024505 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:53.024505 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:53.024505 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:53.024505 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:53.024505 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:53.024505 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:53.024505 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:53.024505 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:53.024505 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:53.024505 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:53.024505 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:53.024505 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:53.024505 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:53.024505 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:53.024505 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:16:53.025408 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:16:53.025408 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:53.025408 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:16:53.029382 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 316/635] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:16:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:53.030686 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2955956-3635-4ce8-a722-25305cff8334 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:53.030968 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2955956-3635-4ce8-a722-25305cff8334 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:53.031241 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2955956-3635-4ce8-a722-25305cff8334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:53.052551 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-d2955956-3635-4ce8-a722-25305cff8334 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:53.053463 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eded9c-7b36-4453-988f-b8b909bd085c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:53.053777 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-d2955956-3635-4ce8-a722-25305cff8334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:53.054101 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eded9c-7b36-4453-988f-b8b909bd085c None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:53.054378 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eded9c-7b36-4453-988f-b8b909bd085c None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:53.054647 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eded9c-7b36-4453-988f-b8b909bd085c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:53.063909 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eded9c-7b36-4453-988f-b8b909bd085c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:53.065987 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eded9c-7b36-4453-988f-b8b909bd085c None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:53.080867 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-b7eded9c-7b36-4453-988f-b8b909bd085c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 01:16:53.080867 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:53.080867 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:53.080867 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:53.080867 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:53.080867 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:53.080867 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:53.080867 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:53.080867 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:53.080867 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:53.080867 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:53.080867 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:53.080867 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 01:16:53.080867 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 01:16:53.080867 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 01:16:53.080867 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 01:16:53.081908 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:53.081908 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:53.081908 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 01:16:53.081908 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:16:53.081908 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 01:16:53.081908 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:16:53.081908 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:53.081908 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:53.081908 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:53.081908 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:53.081908 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:53.081908 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:53.081908 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:53.081908 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:53.081908 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:53.081908 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:53.081908 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:53.081908 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:53.082884 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:53.082884 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:53.082884 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 01:16:53.082884 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 01:16:53.082884 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 01:16:53.082884 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 01:16:53.082884 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 01:16:53.082884 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 01:16:53.082884 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 01:16:53.082884 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:16:53.082884 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 320/636] 10.222.0.60 () {56 vars in 1093 bytes} [Tue Aug 30 01:16:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:53.082884 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eded9c-7b36-4453-988f-b8b909bd085c None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:53.139250 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 317/637] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:16:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:16:53.140432 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2955956-3635-4ce8-a722-25305cff8334 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:53.151475 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:53.214096 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eded9c-7b36-4453-988f-b8b909bd085c None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:53.229188 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:53.250357 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66e9a49-0fa9-499d-bb63-8980429c9a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:53.250970 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e9a49-0fa9-499d-bb63-8980429c9a41 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:53.251253 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e9a49-0fa9-499d-bb63-8980429c9a41 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:53.251553 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e9a49-0fa9-499d-bb63-8980429c9a41 None admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:53.252203 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66e9a49-0fa9-499d-bb63-8980429c9a41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:53.253093 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66e9a49-0fa9-499d-bb63-8980429c9a41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:53.254538 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66e9a49-0fa9-499d-bb63-8980429c9a41 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:53.267751 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 321/638] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:16:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:53.269069 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66e9a49-0fa9-499d-bb63-8980429c9a41 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:53.280325 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2955956-3635-4ce8-a722-25305cff8334 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:53.320880 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602b599-66ed-4689-a4d3-c0a56ab208f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:53.321497 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602b599-66ed-4689-a4d3-c0a56ab208f2 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:53.321793 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602b599-66ed-4689-a4d3-c0a56ab208f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:53.322053 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602b599-66ed-4689-a4d3-c0a56ab208f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:53.322822 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8602b599-66ed-4689-a4d3-c0a56ab208f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:53.323017 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8602b599-66ed-4689-a4d3-c0a56ab208f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:53.324463 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8602b599-66ed-4689-a4d3-c0a56ab208f2 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:53.337229 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 318/639] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:16:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:53.337896 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602b599-66ed-4689-a4d3-c0a56ab208f2 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:53.409721 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66e9a49-0fa9-499d-bb63-8980429c9a41 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:53.424077 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:53.448355 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b53473-895c-4a2a-8518-19584e54c4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:53.448969 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b53473-895c-4a2a-8518-19584e54c4a6 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:53.449250 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b53473-895c-4a2a-8518-19584e54c4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:53.449523 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b53473-895c-4a2a-8518-19584e54c4a6 None admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:53.450269 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b53473-895c-4a2a-8518-19584e54c4a6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:53.450579 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b53473-895c-4a2a-8518-19584e54c4a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:53.452050 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b53473-895c-4a2a-8518-19584e54c4a6 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:53.465431 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602b599-66ed-4689-a4d3-c0a56ab208f2 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:53.472802 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 322/640] 10.222.0.60 () {56 vars in 1133 bytes} [Tue Aug 30 01:16:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:53.473645 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b53473-895c-4a2a-8518-19584e54c4a6 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:53.495750 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:53.509247 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f866f-f187-4a21-bed5-493ec9384bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:53.509884 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f866f-f187-4a21-bed5-493ec9384bb9 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:53.510165 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f866f-f187-4a21-bed5-493ec9384bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:53.510449 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f866f-f187-4a21-bed5-493ec9384bb9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:53.520975 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8f866f-f187-4a21-bed5-493ec9384bb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:16:53.526355 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-8a8f866f-f187-4a21-bed5-493ec9384bb9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 01:16:53.526355 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:53.526355 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:53.526355 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:53.526355 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:53.526355 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:53.526355 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:53.526355 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:53.526355 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:53.526355 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:53.526355 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:53.526355 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:53.526355 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:16:53.526355 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:16:53.526355 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:16:53.526355 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:16:53.527280 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:16:53.527280 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:16:53.527280 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:16:53.527280 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:16:53.527280 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:53.527280 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:53.527280 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:53.527280 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:53.527280 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:53.527280 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:53.527280 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:53.527280 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:53.527280 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:53.527280 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:53.527280 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:53.527280 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:53.528185 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:53.528185 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:53.528185 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:53.528185 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:53.528185 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:16:53.528185 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:16:53.528185 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:16:53.528185 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:16:53.528185 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:16:53.528185 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:16:53.528185 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 01:16:53.528185 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:16:53.528185 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 319/641] 10.222.0.60 () {56 vars in 1102 bytes} [Tue Aug 30 01:16:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:53.528889 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f866f-f187-4a21-bed5-493ec9384bb9 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:53.577945 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b53473-895c-4a2a-8518-19584e54c4a6 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:53.613822 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711fcbf7-f78b-437e-b06f-af226064583f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:53.614457 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711fcbf7-f78b-437e-b06f-af226064583f None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:53.614730 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711fcbf7-f78b-437e-b06f-af226064583f None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:53.614997 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711fcbf7-f78b-437e-b06f-af226064583f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:53.622962 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711fcbf7-f78b-437e-b06f-af226064583f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:53.624732 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711fcbf7-f78b-437e-b06f-af226064583f None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:53.635750 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f866f-f187-4a21-bed5-493ec9384bb9 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:53.636074 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-711fcbf7-f78b-437e-b06f-af226064583f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:16:53.636074 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:53.636074 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:53.636074 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:53.636074 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:53.636074 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:53.636074 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:53.636074 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:53.636074 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:53.636074 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:53.636074 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:53.636074 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:53.636074 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 01:16:53.636074 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 01:16:53.636074 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 01:16:53.637151 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 01:16:53.637151 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:53.637151 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:53.637151 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:53.637151 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:53.637151 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:53.637151 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:53.637151 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:53.637151 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:53.637151 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:53.637151 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:53.637151 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:53.637151 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:53.637151 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:53.637151 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:53.637151 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:53.637151 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:53.638058 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 01:16:53.638058 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 01:16:53.638058 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 01:16:53.638058 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 01:16:53.638058 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 01:16:53.638058 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 01:16:53.638058 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:16:53.638058 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:16:53.638058 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 323/642] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 30 01:16:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:53.638556 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711fcbf7-f78b-437e-b06f-af226064583f None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:53.667698 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:53.677066 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e928994b-ebe6-4bc8-b0f9-f7bd3e11cf94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:53.677697 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e928994b-ebe6-4bc8-b0f9-f7bd3e11cf94 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:53.677980 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e928994b-ebe6-4bc8-b0f9-f7bd3e11cf94 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:53.678252 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e928994b-ebe6-4bc8-b0f9-f7bd3e11cf94 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:53.684895 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e928994b-ebe6-4bc8-b0f9-f7bd3e11cf94 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:53.686355 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e928994b-ebe6-4bc8-b0f9-f7bd3e11cf94 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:53.698441 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-e928994b-ebe6-4bc8-b0f9-f7bd3e11cf94 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:16:53.698441 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:53.698441 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:53.698441 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:53.698441 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:53.698441 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:53.698441 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:53.698441 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:53.698441 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:53.698441 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:53.698441 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:53.698441 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:53.698441 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 01:16:53.698441 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 01:16:53.698441 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 01:16:53.699363 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 01:16:53.699363 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:53.699363 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:53.699363 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:53.699363 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:53.699363 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:53.699363 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:53.699363 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:53.699363 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:53.699363 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:53.699363 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:53.699363 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:53.699363 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:53.699363 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:53.699363 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:53.699363 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:53.699363 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:53.700455 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 01:16:53.700455 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 01:16:53.700455 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 01:16:53.700455 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 01:16:53.700455 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 01:16:53.700455 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 01:16:53.700455 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:16:53.700455 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:16:53.700455 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 320/643] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 30 01:16:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:53.700455 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e928994b-ebe6-4bc8-b0f9-f7bd3e11cf94 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:53.744201 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711fcbf7-f78b-437e-b06f-af226064583f None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:53.744496 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:53.776890 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b58b56-5e77-46b0-b705-8d5d88d1013f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:53.777514 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b58b56-5e77-46b0-b705-8d5d88d1013f None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:53.777795 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b58b56-5e77-46b0-b705-8d5d88d1013f None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:53.778064 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b58b56-5e77-46b0-b705-8d5d88d1013f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:53.789040 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b58b56-5e77-46b0-b705-8d5d88d1013f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:16:53.794357 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-32b58b56-5e77-46b0-b705-8d5d88d1013f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 01:16:53.794357 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:53.794357 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:53.794357 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:53.794357 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:53.794357 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:53.794357 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:53.794357 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:53.794357 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:53.794357 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:53.794357 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:53.794357 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:53.794357 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:16:53.794357 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:16:53.794357 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:16:53.794357 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:16:53.795345 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:16:53.795345 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:16:53.795345 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:16:53.795345 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:16:53.795345 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:53.795345 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:53.795345 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:53.795345 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:53.795345 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:53.795345 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:53.795345 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:53.795345 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:53.795345 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:53.795345 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:53.795345 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:53.795345 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:53.796204 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:53.796204 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:53.796204 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:53.796204 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:53.796204 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:16:53.796204 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:16:53.796204 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:16:53.796204 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:16:53.796204 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:16:53.796204 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:16:53.796204 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 01:16:53.796204 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:16:53.796204 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 324/644] 10.222.0.60 () {56 vars in 1102 bytes} [Tue Aug 30 01:16:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:53.796899 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b58b56-5e77-46b0-b705-8d5d88d1013f None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:53.805756 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e928994b-ebe6-4bc8-b0f9-f7bd3e11cf94 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:53.838893 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c7438-50bc-4866-8f62-bcf91d8f7767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:53.839545 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c7438-50bc-4866-8f62-bcf91d8f7767 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:53.839825 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c7438-50bc-4866-8f62-bcf91d8f7767 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:53.840093 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c7438-50bc-4866-8f62-bcf91d8f7767 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:53.884687 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:53.895517 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b58b56-5e77-46b0-b705-8d5d88d1013f None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:53.906997 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933c7438-50bc-4866-8f62-bcf91d8f7767 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:53.908474 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933c7438-50bc-4866-8f62-bcf91d8f7767 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:53.930055 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f8e7f3-ef76-4c1c-831c-554626a755a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:53.930795 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8e7f3-ef76-4c1c-831c-554626a755a3 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:53.931079 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8e7f3-ef76-4c1c-831c-554626a755a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:53.931404 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8e7f3-ef76-4c1c-831c-554626a755a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:53.932102 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f8e7f3-ef76-4c1c-831c-554626a755a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:53.932406 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f8e7f3-ef76-4c1c-831c-554626a755a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:53.933782 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f8e7f3-ef76-4c1c-831c-554626a755a3 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:53.941469 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 325/645] 10.222.0.60 () {56 vars in 1103 bytes} [Tue Aug 30 01:16:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:53.942250 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f8e7f3-ef76-4c1c-831c-554626a755a3 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:53.950296 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:54.008998 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 321/646] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 30 01:16:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:54.009764 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c7438-50bc-4866-8f62-bcf91d8f7767 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:54.043347 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f8e7f3-ef76-4c1c-831c-554626a755a3 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:54.076508 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddebbbb-b897-432b-89fd-869898ba4c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:54.077103 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddebbbb-b897-432b-89fd-869898ba4c05 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:54.077380 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddebbbb-b897-432b-89fd-869898ba4c05 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:54.077652 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddebbbb-b897-432b-89fd-869898ba4c05 None admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:54.078335 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddebbbb-b897-432b-89fd-869898ba4c05 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:54.078641 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddebbbb-b897-432b-89fd-869898ba4c05 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:54.080136 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddebbbb-b897-432b-89fd-869898ba4c05 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:54.093275 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 326/647] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 30 01:16:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:54.094065 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddebbbb-b897-432b-89fd-869898ba4c05 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:54.108156 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:54.114479 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c7438-50bc-4866-8f62-bcf91d8f7767 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:54.149911 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9485e7-478a-4c5b-9c93-7c37e4aa3b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:54.150516 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9485e7-478a-4c5b-9c93-7c37e4aa3b6e None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:54.150792 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9485e7-478a-4c5b-9c93-7c37e4aa3b6e None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:54.151068 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9485e7-478a-4c5b-9c93-7c37e4aa3b6e None admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:54.151787 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9485e7-478a-4c5b-9c93-7c37e4aa3b6e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:54.152091 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9485e7-478a-4c5b-9c93-7c37e4aa3b6e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:54.153520 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9485e7-478a-4c5b-9c93-7c37e4aa3b6e None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:54.165185 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 322/648] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 30 01:16:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:54.165973 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9485e7-478a-4c5b-9c93-7c37e4aa3b6e None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:54.168431 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:54.193819 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddebbbb-b897-432b-89fd-869898ba4c05 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:54.228475 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd0e88-b6bf-4433-ab00-efcf2245be66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:54.229207 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd0e88-b6bf-4433-ab00-efcf2245be66 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:54.229587 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd0e88-b6bf-4433-ab00-efcf2245be66 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:54.229961 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd0e88-b6bf-4433-ab00-efcf2245be66 None admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:54.230723 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbd0e88-b6bf-4433-ab00-efcf2245be66 None admin] RBAC: Adding query filter params (name=service) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:54.231030 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbd0e88-b6bf-4433-ab00-efcf2245be66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:54.232461 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbd0e88-b6bf-4433-ab00-efcf2245be66 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:54.240146 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 327/649] 10.222.0.60 () {56 vars in 1103 bytes} [Tue Aug 30 01:16:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:54.240939 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd0e88-b6bf-4433-ab00-efcf2245be66 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:54.266773 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9485e7-478a-4c5b-9c93-7c37e4aa3b6e None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:54.307180 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a615fb2-26ac-4d9a-9605-6996f04cfc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:54.307838 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a615fb2-26ac-4d9a-9605-6996f04cfc7e None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:54.308121 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a615fb2-26ac-4d9a-9605-6996f04cfc7e None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:54.308394 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a615fb2-26ac-4d9a-9605-6996f04cfc7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:54.314144 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:54.319456 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a615fb2-26ac-4d9a-9605-6996f04cfc7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:54.320926 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a615fb2-26ac-4d9a-9605-6996f04cfc7e None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:54.335469 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-9a615fb2-26ac-4d9a-9605-6996f04cfc7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:54.335469 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:54.335469 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:54.335469 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:54.335469 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:54.335469 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:54.335469 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:54.335469 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:54.335469 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:54.335469 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:54.335469 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:54.335469 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:54.335469 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:16:54.335469 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:16:54.335469 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:16:54.335469 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:16:54.336590 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:54.336590 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:54.336590 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:54.336590 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:54.336590 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:54.336590 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:54.336590 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:54.336590 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:54.336590 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:54.336590 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:54.336590 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:54.336590 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:54.336590 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:54.336590 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:54.336590 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:54.336590 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:54.336590 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:16:54.337486 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:16:54.337486 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:54.337486 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:16:54.337486 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 323/650] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:16:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:54.337486 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a615fb2-26ac-4d9a-9605-6996f04cfc7e None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:54.342973 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd0e88-b6bf-4433-ab00-efcf2245be66 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:54.376002 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d1ca2-b306-42b3-b144-e535e7a87a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:54.376620 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d1ca2-b306-42b3-b144-e535e7a87a91 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:54.376897 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d1ca2-b306-42b3-b144-e535e7a87a91 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:54.377164 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d1ca2-b306-42b3-b144-e535e7a87a91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:54.388264 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797d1ca2-b306-42b3-b144-e535e7a87a91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:54.389695 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797d1ca2-b306-42b3-b144-e535e7a87a91 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:54.396389 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:54.404314 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-797d1ca2-b306-42b3-b144-e535e7a87a91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:54.404314 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:54.404314 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:54.404314 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:54.404314 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:54.404314 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:54.404314 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:54.404314 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:54.404314 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:54.404314 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:54.404314 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:54.404314 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:54.404314 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:16:54.404314 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:16:54.404314 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:16:54.404314 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:16:54.405485 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:54.405485 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:54.405485 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:54.405485 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:54.405485 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:54.405485 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:54.405485 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:54.405485 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:54.405485 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:54.405485 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:54.405485 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:54.405485 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:54.405485 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:54.405485 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:54.405485 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:54.405485 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:54.405485 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:16:54.406432 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:16:54.406432 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:54.406432 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:16:54.406432 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 328/651] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:16:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:54.406432 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d1ca2-b306-42b3-b144-e535e7a87a91 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:54.444276 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a615fb2-26ac-4d9a-9605-6996f04cfc7e None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:54.478452 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa64b5d-180f-496f-85bb-5f881ec1ffdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:54.479046 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa64b5d-180f-496f-85bb-5f881ec1ffdf None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:54.479320 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa64b5d-180f-496f-85bb-5f881ec1ffdf None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:54.479620 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa64b5d-180f-496f-85bb-5f881ec1ffdf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:54.480336 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa64b5d-180f-496f-85bb-5f881ec1ffdf None admin] RBAC: Adding query filter params (role.id=01439ffbf0dd41caadd0cc40b3176062, scope.project.id=b050b2dad22a4a06875072e44c8c9824, user.id=2de6decc90df4df58217d5eed9c5e190) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:54.480637 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa64b5d-180f-496f-85bb-5f881ec1ffdf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:54.482067 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa64b5d-180f-496f-85bb-5f881ec1ffdf None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:54.488268 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 324/652] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 30 01:16:54 2022] GET /identity/v3/role_assignments?user.id=2de6decc90df4df58217d5eed9c5e190&scope.project.id=b050b2dad22a4a06875072e44c8c9824&role.id=01439ffbf0dd41caadd0cc40b3176062 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:54.489030 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa64b5d-180f-496f-85bb-5f881ec1ffdf None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:54.511756 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d1ca2-b306-42b3-b144-e535e7a87a91 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:54.543120 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:54.554677 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79138f85-e3a4-414d-aa55-65b20a6735d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:54.555465 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79138f85-e3a4-414d-aa55-65b20a6735d2 None admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:54.555740 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79138f85-e3a4-414d-aa55-65b20a6735d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:54.556008 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79138f85-e3a4-414d-aa55-65b20a6735d2 None admin] PATH_INFO: `/v3/projects/b050b2dad22a4a06875072e44c8c9824/users/1e7de1f31ef84d529bf2c53ce0f7e38b/roles/01439ffbf0dd41caadd0cc40b3176062` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:54.574958 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79138f85-e3a4-414d-aa55-65b20a6735d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=b050b2dad22a4a06875072e44c8c9824, user_id=1e7de1f31ef84d529bf2c53ce0f7e38b, role_id=01439ffbf0dd41caadd0cc40b3176062)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:54.576562 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79138f85-e3a4-414d-aa55-65b20a6735d2 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:54.597924 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 329/653] 10.222.0.60 () {58 vars in 1439 bytes} [Tue Aug 30 01:16:54 2022] PUT /identity/v3/projects/b050b2dad22a4a06875072e44c8c9824/users/1e7de1f31ef84d529bf2c53ce0f7e38b/roles/01439ffbf0dd41caadd0cc40b3176062 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:16:54.597924 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79138f85-e3a4-414d-aa55-65b20a6735d2 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:54.614391 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa64b5d-180f-496f-85bb-5f881ec1ffdf None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:54.640349 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:54.668060 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5651f8-8449-4161-b7d5-ade9c794d880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:54.669633 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5651f8-8449-4161-b7d5-ade9c794d880 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:54.670524 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5651f8-8449-4161-b7d5-ade9c794d880 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:54.670524 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5651f8-8449-4161-b7d5-ade9c794d880 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:54.687839 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5651f8-8449-4161-b7d5-ade9c794d880 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:54.689652 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5651f8-8449-4161-b7d5-ade9c794d880 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:54.706509 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-4a5651f8-8449-4161-b7d5-ade9c794d880 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:54.706509 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:54.706509 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:54.706509 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:54.706509 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:54.706509 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:54.706509 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:54.706509 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:54.706509 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:54.706509 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:54.706509 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:54.706509 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:54.706509 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:16:54.706509 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:16:54.706509 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:16:54.706509 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:16:54.707599 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:54.707599 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:54.707599 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:54.707599 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:54.707599 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:54.707599 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:54.707599 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:54.707599 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:54.707599 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:54.707599 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:54.707599 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:54.707599 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:54.707599 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:54.707599 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:54.707599 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:54.707599 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:54.707599 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:16:54.708509 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:16:54.708509 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:54.708509 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:16:54.708509 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 325/654] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:16:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:54.708841 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5651f8-8449-4161-b7d5-ade9c794d880 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:54.748652 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79138f85-e3a4-414d-aa55-65b20a6735d2 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:54.796075 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ecc28-d57c-42a4-ae94-96e06ef460b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:54.796611 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ecc28-d57c-42a4-ae94-96e06ef460b3 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:54.796889 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ecc28-d57c-42a4-ae94-96e06ef460b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:54.797187 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ecc28-d57c-42a4-ae94-96e06ef460b3 None admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:54.797797 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85ecc28-d57c-42a4-ae94-96e06ef460b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:54.798104 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85ecc28-d57c-42a4-ae94-96e06ef460b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:54.800096 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85ecc28-d57c-42a4-ae94-96e06ef460b3 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:54.815017 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 330/655] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:16:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:54.816367 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ecc28-d57c-42a4-ae94-96e06ef460b3 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:54.843184 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5651f8-8449-4161-b7d5-ade9c794d880 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:54.856382 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:54.887555 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e069c0-a1f1-444d-83f3-fc8ba7df24ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:54.888179 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e069c0-a1f1-444d-83f3-fc8ba7df24ac None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:54.888701 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e069c0-a1f1-444d-83f3-fc8ba7df24ac None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:54.888980 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e069c0-a1f1-444d-83f3-fc8ba7df24ac None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:54.890308 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e069c0-a1f1-444d-83f3-fc8ba7df24ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:54.890621 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e069c0-a1f1-444d-83f3-fc8ba7df24ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:54.892051 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e069c0-a1f1-444d-83f3-fc8ba7df24ac None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:54.911604 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 326/656] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:16:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:54.912484 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e069c0-a1f1-444d-83f3-fc8ba7df24ac None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:54.944415 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ecc28-d57c-42a4-ae94-96e06ef460b3 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:54.955043 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:54.997144 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e03ce2-1e83-47a4-a883-98802c74f0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:54.998315 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e03ce2-1e83-47a4-a883-98802c74f0af None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:54.999339 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e03ce2-1e83-47a4-a883-98802c74f0af None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:54.999804 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e03ce2-1e83-47a4-a883-98802c74f0af None admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:55.000897 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e03ce2-1e83-47a4-a883-98802c74f0af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:55.001363 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e03ce2-1e83-47a4-a883-98802c74f0af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:55.004232 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e03ce2-1e83-47a4-a883-98802c74f0af None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:55.020671 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 331/657] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:16:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:55.021649 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e03ce2-1e83-47a4-a883-98802c74f0af None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:55.040402 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e069c0-a1f1-444d-83f3-fc8ba7df24ac None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:55.077902 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa82da-13b2-4a89-aac5-8f2b2ea024d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:55.078481 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa82da-13b2-4a89-aac5-8f2b2ea024d6 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:55.078763 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa82da-13b2-4a89-aac5-8f2b2ea024d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:55.079033 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa82da-13b2-4a89-aac5-8f2b2ea024d6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:55.087320 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aa82da-13b2-4a89-aac5-8f2b2ea024d6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:55.088832 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aa82da-13b2-4a89-aac5-8f2b2ea024d6 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:55.102887 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-71aa82da-13b2-4a89-aac5-8f2b2ea024d6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 01:16:55.102887 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:55.102887 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:55.102887 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:55.102887 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:55.102887 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:55.102887 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:55.102887 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:55.102887 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:55.102887 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:55.102887 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:55.102887 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:55.102887 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 01:16:55.102887 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 01:16:55.102887 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 01:16:55.102887 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 01:16:55.104052 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:55.104052 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:55.104052 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 01:16:55.104052 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:16:55.104052 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 01:16:55.104052 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:16:55.104052 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:55.104052 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:55.104052 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:55.104052 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:55.104052 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:55.104052 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:55.104052 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:55.104052 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:55.104052 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:55.104052 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:55.104052 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:55.104052 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:55.105088 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:55.105088 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:55.105088 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 01:16:55.105088 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 01:16:55.105088 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 01:16:55.105088 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 01:16:55.105088 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 01:16:55.105088 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 01:16:55.105088 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 01:16:55.105088 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:16:55.108666 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 327/658] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 30 01:16:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:55.109492 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa82da-13b2-4a89-aac5-8f2b2ea024d6 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:55.143799 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:55.155752 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e03ce2-1e83-47a4-a883-98802c74f0af None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:55.201259 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53a34bc-648f-4f8f-a4ef-08c5118f9604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:55.202357 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a34bc-648f-4f8f-a4ef-08c5118f9604 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:55.202641 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a34bc-648f-4f8f-a4ef-08c5118f9604 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:55.203191 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a34bc-648f-4f8f-a4ef-08c5118f9604 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:55.211997 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:55.214027 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53a34bc-648f-4f8f-a4ef-08c5118f9604 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:55.216210 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53a34bc-648f-4f8f-a4ef-08c5118f9604 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:55.224142 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa82da-13b2-4a89-aac5-8f2b2ea024d6 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:55.232569 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-b53a34bc-648f-4f8f-a4ef-08c5118f9604 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:16:55.232569 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:55.232569 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:55.232569 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:55.232569 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:55.232569 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:55.232569 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:55.232569 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:55.232569 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:55.232569 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:55.232569 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:55.232569 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:55.232569 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 01:16:55.232569 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 01:16:55.232569 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 01:16:55.233660 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 01:16:55.233660 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:55.233660 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:55.233660 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:55.233660 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:55.233660 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:55.233660 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:55.233660 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:55.233660 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:55.233660 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:55.233660 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:55.233660 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:55.233660 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:55.233660 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:55.233660 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:55.233660 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:55.233660 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:55.234762 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 01:16:55.234762 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 01:16:55.234762 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 01:16:55.234762 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 01:16:55.234762 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 01:16:55.234762 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 01:16:55.234762 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:16:55.234762 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:16:55.241216 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 332/659] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 30 01:16:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:55.241216 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53a34bc-648f-4f8f-a4ef-08c5118f9604 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:55.275291 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b0719-94a6-4dc7-9b71-e385b02bb5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:55.277101 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b0719-94a6-4dc7-9b71-e385b02bb5ba None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:55.277547 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b0719-94a6-4dc7-9b71-e385b02bb5ba None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:55.277978 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b0719-94a6-4dc7-9b71-e385b02bb5ba None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:55.290079 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9b0719-94a6-4dc7-9b71-e385b02bb5ba None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:55.292324 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9b0719-94a6-4dc7-9b71-e385b02bb5ba None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:55.308475 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-bf9b0719-94a6-4dc7-9b71-e385b02bb5ba None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 01:16:55.308475 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:55.308475 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:55.308475 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:55.308475 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:55.308475 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:55.308475 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:55.308475 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:55.308475 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:55.308475 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:55.308475 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:55.308475 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:55.308475 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 01:16:55.308475 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 01:16:55.308475 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 01:16:55.308475 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 01:16:55.309748 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:55.309748 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:55.309748 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 01:16:55.309748 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:16:55.309748 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 01:16:55.309748 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:16:55.309748 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:55.309748 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:55.309748 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:55.309748 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:55.309748 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:55.309748 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:55.309748 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:55.309748 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:55.309748 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:55.309748 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:55.309748 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:55.309748 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:55.310914 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:55.310914 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:55.310914 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 01:16:55.310914 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 01:16:55.310914 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 01:16:55.310914 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 01:16:55.310914 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 01:16:55.310914 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 01:16:55.310914 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 01:16:55.310914 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:16:55.313963 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 328/660] 10.222.0.60 () {56 vars in 1102 bytes} [Tue Aug 30 01:16:55 2022] GET /identity/v3/users/neutron => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:55.315291 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b0719-94a6-4dc7-9b71-e385b02bb5ba None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:55.358738 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53a34bc-648f-4f8f-a4ef-08c5118f9604 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:55.405157 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea46807-a111-4f28-a26c-3dbc04c8635b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:55.405909 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea46807-a111-4f28-a26c-3dbc04c8635b None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:55.406282 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea46807-a111-4f28-a26c-3dbc04c8635b None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:55.406681 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea46807-a111-4f28-a26c-3dbc04c8635b None admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:55.407551 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea46807-a111-4f28-a26c-3dbc04c8635b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:55.407958 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea46807-a111-4f28-a26c-3dbc04c8635b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:55.410243 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea46807-a111-4f28-a26c-3dbc04c8635b None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:55.433420 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 333/661] 10.222.0.60 () {56 vars in 1137 bytes} [Tue Aug 30 01:16:55 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:55.434415 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea46807-a111-4f28-a26c-3dbc04c8635b None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:55.439237 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b0719-94a6-4dc7-9b71-e385b02bb5ba None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:55.451398 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:55.489529 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f029d3-a046-49f5-91e1-4ac6362f6376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:55.490133 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f029d3-a046-49f5-91e1-4ac6362f6376 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:55.490441 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f029d3-a046-49f5-91e1-4ac6362f6376 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:55.490807 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f029d3-a046-49f5-91e1-4ac6362f6376 None admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:55.491802 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f029d3-a046-49f5-91e1-4ac6362f6376 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:55.492106 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f029d3-a046-49f5-91e1-4ac6362f6376 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:55.493538 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f029d3-a046-49f5-91e1-4ac6362f6376 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:55.511559 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 329/662] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 30 01:16:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:55.511559 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f029d3-a046-49f5-91e1-4ac6362f6376 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:55.525903 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:55.571774 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea46807-a111-4f28-a26c-3dbc04c8635b None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:55.631991 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f029d3-a046-49f5-91e1-4ac6362f6376 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:55.635911 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70af8da-6c51-4212-a26f-8a9644c7c9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:55.639095 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70af8da-6c51-4212-a26f-8a9644c7c9aa None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:55.639636 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70af8da-6c51-4212-a26f-8a9644c7c9aa None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:55.640155 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70af8da-6c51-4212-a26f-8a9644c7c9aa None admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:55.641083 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70af8da-6c51-4212-a26f-8a9644c7c9aa None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:55.641563 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70af8da-6c51-4212-a26f-8a9644c7c9aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:55.643746 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70af8da-6c51-4212-a26f-8a9644c7c9aa None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:55.670979 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 334/663] 10.222.0.60 () {56 vars in 1139 bytes} [Tue Aug 30 01:16:55 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:55.671834 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a78217-b955-42c5-a39d-9811b47efe5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:55.672515 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a78217-b955-42c5-a39d-9811b47efe5e None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:55.672741 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70af8da-6c51-4212-a26f-8a9644c7c9aa None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:55.672887 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a78217-b955-42c5-a39d-9811b47efe5e None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:55.673256 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a78217-b955-42c5-a39d-9811b47efe5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:55.752362 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a78217-b955-42c5-a39d-9811b47efe5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:55.754603 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a78217-b955-42c5-a39d-9811b47efe5e None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:55.766099 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:55.771186 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:55.811869 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70af8da-6c51-4212-a26f-8a9644c7c9aa None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:55.857928 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603792a-2201-4a21-8739-ade35f9a0d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:55.859146 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603792a-2201-4a21-8739-ade35f9a0d3c None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:55.860075 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603792a-2201-4a21-8739-ade35f9a0d3c None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:55.860805 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603792a-2201-4a21-8739-ade35f9a0d3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:55.861996 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f603792a-2201-4a21-8739-ade35f9a0d3c None admin] RBAC: Adding query filter params (role.id=01439ffbf0dd41caadd0cc40b3176062, scope.project.id=b050b2dad22a4a06875072e44c8c9824, user.id=8889145228a24fb6bd539a11925e62f2) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:55.862920 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f603792a-2201-4a21-8739-ade35f9a0d3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:55.865093 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f603792a-2201-4a21-8739-ade35f9a0d3c None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:55.873639 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 330/664] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 30 01:16:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:55.873639 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a78217-b955-42c5-a39d-9811b47efe5e None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:55.878552 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 335/665] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 30 01:16:55 2022] GET /identity/v3/role_assignments?user.id=8889145228a24fb6bd539a11925e62f2&scope.project.id=b050b2dad22a4a06875072e44c8c9824&role.id=01439ffbf0dd41caadd0cc40b3176062 => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:55.879609 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603792a-2201-4a21-8739-ade35f9a0d3c None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:56.064815 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a78217-b955-42c5-a39d-9811b47efe5e None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:56.077244 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:56.083603 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603792a-2201-4a21-8739-ade35f9a0d3c None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:56.110737 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfec28-af66-49df-a7ff-44107b42d769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:56.111512 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfec28-af66-49df-a7ff-44107b42d769 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:56.112426 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfec28-af66-49df-a7ff-44107b42d769 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:56.112788 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfec28-af66-49df-a7ff-44107b42d769 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:56.126687 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd9493-caea-4d2a-b344-e8c4d4393997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:56.128177 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd9493-caea-4d2a-b344-e8c4d4393997 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:56.128634 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd9493-caea-4d2a-b344-e8c4d4393997 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:56.129082 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd9493-caea-4d2a-b344-e8c4d4393997 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:56.132438 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:56.141795 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd9493-caea-4d2a-b344-e8c4d4393997 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:56.144633 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd9493-caea-4d2a-b344-e8c4d4393997 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:56.164993 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-02bd9493-caea-4d2a-b344-e8c4d4393997 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:56.164993 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:56.164993 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:56.164993 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:56.164993 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:56.164993 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:56.164993 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:56.164993 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:56.164993 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:56.164993 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:56.164993 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:56.164993 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:56.164993 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:16:56.164993 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:16:56.164993 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:16:56.164993 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:16:56.166170 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:56.166170 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:56.166170 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:56.166170 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:56.166170 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:56.166170 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:56.166170 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:56.166170 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:56.166170 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:56.166170 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:56.166170 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:56.166170 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:56.166170 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:56.166170 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:56.166170 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:56.166170 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:56.166170 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:16:56.167073 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:16:56.167073 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:56.167073 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:16:56.169229 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 336/666] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:16:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:56.175536 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd9493-caea-4d2a-b344-e8c4d4393997 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:56.196108 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cfec28-af66-49df-a7ff-44107b42d769 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:56.197829 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cfec28-af66-49df-a7ff-44107b42d769 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:56.287216 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd9493-caea-4d2a-b344-e8c4d4393997 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:56.306752 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 331/667] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 30 01:16:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:56.311883 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfec28-af66-49df-a7ff-44107b42d769 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:56.325033 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:56.328307 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d2f3c1-df25-417e-8862-48d1e1178263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:56.330622 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d2f3c1-df25-417e-8862-48d1e1178263 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:56.330622 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d2f3c1-df25-417e-8862-48d1e1178263 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:56.330622 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d2f3c1-df25-417e-8862-48d1e1178263 None admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:56.330622 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d2f3c1-df25-417e-8862-48d1e1178263 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:56.331208 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d2f3c1-df25-417e-8862-48d1e1178263 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:56.332874 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d2f3c1-df25-417e-8862-48d1e1178263 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:56.348507 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 337/668] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:16:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:16:56.354180 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d2f3c1-df25-417e-8862-48d1e1178263 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:56.412147 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:56.426072 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfec28-af66-49df-a7ff-44107b42d769 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:56.462984 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ac784-318c-4c18-ab09-50b7b6d1b53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:56.463647 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ac784-318c-4c18-ab09-50b7b6d1b53e None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:56.463922 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ac784-318c-4c18-ab09-50b7b6d1b53e None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:56.464189 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ac784-318c-4c18-ab09-50b7b6d1b53e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:56.470440 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d2f3c1-df25-417e-8862-48d1e1178263 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:56.476278 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ac784-318c-4c18-ab09-50b7b6d1b53e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:56.477871 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ac784-318c-4c18-ab09-50b7b6d1b53e None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:56.494226 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-296ac784-318c-4c18-ab09-50b7b6d1b53e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:56.494226 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:56.494226 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:56.494226 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:56.494226 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:56.494226 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:56.494226 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:56.494226 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:56.494226 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:56.494226 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:56.494226 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:56.494226 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:56.494226 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:16:56.494226 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:16:56.494226 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:16:56.494226 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:16:56.495235 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:56.495235 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:56.495235 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:56.495235 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:56.495235 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:56.495235 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:56.495235 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:56.495235 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:56.495235 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:56.495235 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:56.495235 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:56.495235 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:56.495235 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:56.495235 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:56.495235 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:56.495235 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:56.495235 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:16:56.496229 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:16:56.496229 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:56.496229 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:16:56.496229 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 332/669] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:16:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:16:56.504407 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ac784-318c-4c18-ab09-50b7b6d1b53e None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:56.523371 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a9199-ff10-4c27-92c7-88324c5292eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:56.524279 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a9199-ff10-4c27-92c7-88324c5292eb None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:56.524711 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a9199-ff10-4c27-92c7-88324c5292eb None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:56.525155 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a9199-ff10-4c27-92c7-88324c5292eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:56.533086 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047a9199-ff10-4c27-92c7-88324c5292eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:56.535564 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047a9199-ff10-4c27-92c7-88324c5292eb None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:56.549169 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-047a9199-ff10-4c27-92c7-88324c5292eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:16:56.549169 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:56.549169 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:56.549169 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:56.549169 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:56.549169 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:56.549169 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:56.549169 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:56.549169 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:56.549169 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:56.549169 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:56.549169 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:56.549169 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 01:16:56.549169 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 01:16:56.549169 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 01:16:56.550950 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 01:16:56.550950 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:56.550950 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:56.550950 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:56.550950 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:56.550950 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:56.550950 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:56.550950 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:56.550950 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:56.550950 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:56.550950 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:56.550950 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:56.550950 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:56.550950 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:56.550950 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:56.550950 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:56.550950 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:56.552107 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 01:16:56.552107 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 01:16:56.552107 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 01:16:56.552107 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 01:16:56.552107 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 01:16:56.552107 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 01:16:56.552107 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:16:56.552107 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:16:56.554256 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 338/670] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 30 01:16:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:16:56.560105 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a9199-ff10-4c27-92c7-88324c5292eb None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:56.578245 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:56.646317 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ac784-318c-4c18-ab09-50b7b6d1b53e None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:56.677950 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a9199-ff10-4c27-92c7-88324c5292eb None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:56.681546 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37089b9a-1efb-4453-9467-4a4b9e5d42bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:56.682031 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37089b9a-1efb-4453-9467-4a4b9e5d42bf None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:56.682367 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37089b9a-1efb-4453-9467-4a4b9e5d42bf None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:56.682639 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37089b9a-1efb-4453-9467-4a4b9e5d42bf None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:56.683283 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37089b9a-1efb-4453-9467-4a4b9e5d42bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:56.683655 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37089b9a-1efb-4453-9467-4a4b9e5d42bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:56.685036 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37089b9a-1efb-4453-9467-4a4b9e5d42bf None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:56.689808 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:56.699988 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 333/671] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:16:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:56.701323 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbac6d3-1f02-4cab-aae4-464927c26990 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:56.701604 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbac6d3-1f02-4cab-aae4-464927c26990 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:56.701879 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbac6d3-1f02-4cab-aae4-464927c26990 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:56.707849 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 334/672] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:16:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:16:56.708734 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbac6d3-1f02-4cab-aae4-464927c26990 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:56.718421 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aec038-4cc5-4ed8-baa8-601a0eef5733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:56.719299 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aec038-4cc5-4ed8-baa8-601a0eef5733 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:56.719820 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aec038-4cc5-4ed8-baa8-601a0eef5733 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:56.720353 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aec038-4cc5-4ed8-baa8-601a0eef5733 None admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:56.721937 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aec038-4cc5-4ed8-baa8-601a0eef5733 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:56.722439 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aec038-4cc5-4ed8-baa8-601a0eef5733 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:56.724128 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aec038-4cc5-4ed8-baa8-601a0eef5733 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:56.738223 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 339/673] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 30 01:16:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:56.744866 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43841d62-d097-4c22-b896-2992e03b53ca None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:56.745372 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43841d62-d097-4c22-b896-2992e03b53ca None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:56.745848 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43841d62-d097-4c22-b896-2992e03b53ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:56.765713 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-43841d62-d097-4c22-b896-2992e03b53ca None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:56.767426 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-43841d62-d097-4c22-b896-2992e03b53ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:56.821750 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbac6d3-1f02-4cab-aae4-464927c26990 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:56.847765 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 340/674] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:16:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:16:56.847765 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43841d62-d097-4c22-b896-2992e03b53ca None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:56.850880 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:56.865360 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c87df1a-ed85-46ea-ac50-5585753c03f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:56.866300 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87df1a-ed85-46ea-ac50-5585753c03f4 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:56.866732 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87df1a-ed85-46ea-ac50-5585753c03f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:56.867245 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87df1a-ed85-46ea-ac50-5585753c03f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:56.874864 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c87df1a-ed85-46ea-ac50-5585753c03f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:56.877065 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c87df1a-ed85-46ea-ac50-5585753c03f4 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:56.889467 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-1c87df1a-ed85-46ea-ac50-5585753c03f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:16:56.889467 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:56.889467 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:56.889467 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:56.889467 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:56.889467 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:56.889467 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:56.889467 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:56.889467 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:56.889467 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:56.889467 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:56.889467 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:56.889467 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 01:16:56.889467 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 01:16:56.889467 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 01:16:56.890406 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 01:16:56.890406 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:56.890406 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:56.890406 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:56.890406 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:56.890406 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:56.890406 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:56.890406 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:56.890406 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:56.890406 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:56.890406 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:56.890406 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:56.890406 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:56.890406 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:56.890406 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:56.890406 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:56.890406 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:56.891733 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 01:16:56.891733 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 01:16:56.891733 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 01:16:56.891733 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 01:16:56.891733 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 01:16:56.891733 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 01:16:56.891733 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:16:56.891733 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:16:56.891733 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 335/675] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 30 01:16:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:56.897797 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dfd4d7-0417-4861-830f-8ad89a8dcbc4 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:56.897797 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dfd4d7-0417-4861-830f-8ad89a8dcbc4 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:56.897797 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dfd4d7-0417-4861-830f-8ad89a8dcbc4 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:56.899199 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 336/676] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:16:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:16:56.899952 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dfd4d7-0417-4861-830f-8ad89a8dcbc4 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:56.972014 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:56.978577 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43841d62-d097-4c22-b896-2992e03b53ca None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:57.021703 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc7047b-c4e9-44b9-919a-b2c87934c327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:57.022586 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7047b-c4e9-44b9-919a-b2c87934c327 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:57.022879 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7047b-c4e9-44b9-919a-b2c87934c327 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:57.023147 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7047b-c4e9-44b9-919a-b2c87934c327 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:57.023956 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc7047b-c4e9-44b9-919a-b2c87934c327 None admin] RBAC: Adding query filter params (role.id=01439ffbf0dd41caadd0cc40b3176062, scope.project.id=b050b2dad22a4a06875072e44c8c9824, user.id=e3040f72d52249f1b0e19e3a200bd16e) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:57.024264 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc7047b-c4e9-44b9-919a-b2c87934c327 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:57.025743 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc7047b-c4e9-44b9-919a-b2c87934c327 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:57.033650 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 341/677] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 30 01:16:56 2022] GET /identity/v3/role_assignments?user.id=e3040f72d52249f1b0e19e3a200bd16e&scope.project.id=b050b2dad22a4a06875072e44c8c9824&role.id=01439ffbf0dd41caadd0cc40b3176062 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:57.036222 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180bbc32-3695-42bc-9847-349428612598 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:57.036506 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180bbc32-3695-42bc-9847-349428612598 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:57.036774 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180bbc32-3695-42bc-9847-349428612598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:57.042691 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dfd4d7-0417-4861-830f-8ad89a8dcbc4 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:57.058331 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-180bbc32-3695-42bc-9847-349428612598 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:57.059661 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-180bbc32-3695-42bc-9847-349428612598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:57.108013 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85246955-1496-4044-8e92-7a790a39c3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:57.108544 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85246955-1496-4044-8e92-7a790a39c3bb None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:57.108819 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85246955-1496-4044-8e92-7a790a39c3bb None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:57.109457 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85246955-1496-4044-8e92-7a790a39c3bb None admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:57.109785 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85246955-1496-4044-8e92-7a790a39c3bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:57.110078 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85246955-1496-4044-8e92-7a790a39c3bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:57.111553 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85246955-1496-4044-8e92-7a790a39c3bb None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:57.125856 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 337/678] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 30 01:16:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:57.132341 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85246955-1496-4044-8e92-7a790a39c3bb None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:57.191832 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:57.197582 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 342/679] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:16:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:16:57.198461 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180bbc32-3695-42bc-9847-349428612598 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:57.283257 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85246955-1496-4044-8e92-7a790a39c3bb None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:57.319583 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:57.329449 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180bbc32-3695-42bc-9847-349428612598 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:57.337030 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38784a96-df52-4951-b774-5a8a32752295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:57.337660 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38784a96-df52-4951-b774-5a8a32752295 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:57.337950 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38784a96-df52-4951-b774-5a8a32752295 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:57.338339 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38784a96-df52-4951-b774-5a8a32752295 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:57.339083 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38784a96-df52-4951-b774-5a8a32752295 None admin] RBAC: Adding query filter params (role.id=01439ffbf0dd41caadd0cc40b3176062, scope.project.id=b050b2dad22a4a06875072e44c8c9824, user.id=61e48e00a0c34949a4fffae8c372304e) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:57.339391 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38784a96-df52-4951-b774-5a8a32752295 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:57.342391 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38784a96-df52-4951-b774-5a8a32752295 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:57.350301 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 338/680] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 30 01:16:57 2022] GET /identity/v3/role_assignments?user.id=61e48e00a0c34949a4fffae8c372304e&scope.project.id=b050b2dad22a4a06875072e44c8c9824&role.id=01439ffbf0dd41caadd0cc40b3176062 => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:57.375026 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b61c7-2823-4541-ac28-60334dac4ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:57.375678 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b61c7-2823-4541-ac28-60334dac4ae1 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:57.375961 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b61c7-2823-4541-ac28-60334dac4ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:57.376237 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b61c7-2823-4541-ac28-60334dac4ae1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:57.389414 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6b61c7-2823-4541-ac28-60334dac4ae1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:57.390894 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6b61c7-2823-4541-ac28-60334dac4ae1 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:57.415957 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-5e6b61c7-2823-4541-ac28-60334dac4ae1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:57.415957 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:57.415957 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:57.415957 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:57.415957 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:57.415957 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:57.415957 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:57.415957 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:57.415957 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:57.415957 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:57.415957 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:57.415957 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:57.415957 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:16:57.415957 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:16:57.415957 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:16:57.415957 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:16:57.417025 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:57.417025 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:57.417025 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:57.417025 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:57.417025 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:57.417025 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:57.417025 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:57.417025 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:57.417025 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:57.417025 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:57.417025 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:57.417025 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:57.417025 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:57.417025 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:57.417025 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:57.417025 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:57.417025 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:16:57.417919 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:16:57.417919 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:57.417919 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:16:57.417919 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 343/681] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:16:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:57.428705 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38784a96-df52-4951-b774-5a8a32752295 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:57.522050 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b61c7-2823-4541-ac28-60334dac4ae1 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:57.570097 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38784a96-df52-4951-b774-5a8a32752295 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:57.583263 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:57.622180 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b79835-0e8a-4701-a7ba-3d087d26aeb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:57.622804 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b79835-0e8a-4701-a7ba-3d087d26aeb1 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:57.623311 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b79835-0e8a-4701-a7ba-3d087d26aeb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:57.623608 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b79835-0e8a-4701-a7ba-3d087d26aeb1 None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:57.624748 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b79835-0e8a-4701-a7ba-3d087d26aeb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:57.625338 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b79835-0e8a-4701-a7ba-3d087d26aeb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:57.626987 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b79835-0e8a-4701-a7ba-3d087d26aeb1 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:57.642598 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 339/682] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:16:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:57.649146 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b79835-0e8a-4701-a7ba-3d087d26aeb1 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:57.654599 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b61c7-2823-4541-ac28-60334dac4ae1 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:57.701377 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22d482c-17f5-4588-8482-00af63778876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:57.702891 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d482c-17f5-4588-8482-00af63778876 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:57.703481 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d482c-17f5-4588-8482-00af63778876 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:57.703939 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d482c-17f5-4588-8482-00af63778876 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:57.718642 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22d482c-17f5-4588-8482-00af63778876 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:16:57.726201 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-a22d482c-17f5-4588-8482-00af63778876 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 01:16:57.726201 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:57.726201 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:57.726201 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:57.726201 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:57.726201 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:57.726201 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:57.726201 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:57.726201 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:57.726201 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:57.726201 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:57.726201 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:57.726201 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:16:57.726201 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:16:57.726201 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:16:57.726201 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:16:57.727171 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:16:57.727171 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:16:57.727171 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:16:57.727171 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:16:57.727171 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:57.727171 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:57.727171 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:57.727171 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:57.727171 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:57.727171 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:57.727171 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:57.727171 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:57.727171 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:57.727171 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:57.727171 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:57.727171 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:57.728060 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:57.728060 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:57.728060 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:57.728060 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:57.728060 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:16:57.728060 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:16:57.728060 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:16:57.728060 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:16:57.728060 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:16:57.728060 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:16:57.728060 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 01:16:57.728060 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:16:57.728060 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 344/683] 10.222.0.60 () {56 vars in 1102 bytes} [Tue Aug 30 01:16:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:16:57.733375 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22d482c-17f5-4588-8482-00af63778876 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:57.738054 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:57.779688 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b79835-0e8a-4701-a7ba-3d087d26aeb1 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:57.826258 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bdd65d-f1dd-41a5-816f-6e953e5bc90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:57.827636 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bdd65d-f1dd-41a5-816f-6e953e5bc90c None admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:57.828527 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bdd65d-f1dd-41a5-816f-6e953e5bc90c None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:57.829051 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bdd65d-f1dd-41a5-816f-6e953e5bc90c None admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:57.830099 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bdd65d-f1dd-41a5-816f-6e953e5bc90c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:57.833095 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bdd65d-f1dd-41a5-816f-6e953e5bc90c None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:57.861548 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22d482c-17f5-4588-8482-00af63778876 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:57.865055 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 340/684] 10.222.0.60 () {60 vars in 1132 bytes} [Tue Aug 30 01:16:57 2022] POST /identity/v3/users => generated 254 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:16:57.926793 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff3b62-5ff4-4265-9a2f-3d0a5124331a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:57.927765 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff3b62-5ff4-4265-9a2f-3d0a5124331a None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:57.928252 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff3b62-5ff4-4265-9a2f-3d0a5124331a None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:57.928681 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff3b62-5ff4-4265-9a2f-3d0a5124331a None admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:57.929534 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ff3b62-5ff4-4265-9a2f-3d0a5124331a None admin] RBAC: Adding query filter params (name=service) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:57.930015 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ff3b62-5ff4-4265-9a2f-3d0a5124331a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:57.931658 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ff3b62-5ff4-4265-9a2f-3d0a5124331a None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:57.946904 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 345/685] 10.222.0.60 () {56 vars in 1103 bytes} [Tue Aug 30 01:16:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:16:57.952800 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bdd65d-f1dd-41a5-816f-6e953e5bc90c None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:57.986381 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:58.083731 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bdd65d-f1dd-41a5-816f-6e953e5bc90c None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:58.118634 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780c90cf-8955-491b-a550-37cc641f62d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:58.119272 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c90cf-8955-491b-a550-37cc641f62d7 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:58.119584 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c90cf-8955-491b-a550-37cc641f62d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:58.119861 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c90cf-8955-491b-a550-37cc641f62d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:58.131626 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780c90cf-8955-491b-a550-37cc641f62d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:58.133163 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780c90cf-8955-491b-a550-37cc641f62d7 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:58.148462 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-780c90cf-8955-491b-a550-37cc641f62d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:58.148462 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:58.148462 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:58.148462 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:58.148462 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:58.148462 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:58.148462 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:58.148462 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:58.148462 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:58.148462 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:58.148462 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:58.148462 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:58.148462 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:16:58.148462 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:16:58.148462 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:16:58.148462 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:16:58.149414 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:58.149414 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:58.149414 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:58.149414 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:58.149414 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:58.149414 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:58.149414 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:58.149414 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:58.149414 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:58.149414 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:58.149414 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:58.149414 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:58.149414 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:58.149414 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:58.149414 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:58.149414 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:58.149414 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:16:58.150340 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:16:58.150340 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:58.150340 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:16:58.150340 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 341/686] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:16:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:58.155395 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff3b62-5ff4-4265-9a2f-3d0a5124331a None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:58.238313 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:58.277742 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff3b62-5ff4-4265-9a2f-3d0a5124331a None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:58.313895 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e75ad-9393-4fd4-82bd-6115b9ce262c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:58.314513 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e75ad-9393-4fd4-82bd-6115b9ce262c None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:58.314793 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e75ad-9393-4fd4-82bd-6115b9ce262c None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:58.315657 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e75ad-9393-4fd4-82bd-6115b9ce262c None admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:58.316317 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63e75ad-9393-4fd4-82bd-6115b9ce262c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:58.316621 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63e75ad-9393-4fd4-82bd-6115b9ce262c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:58.318007 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63e75ad-9393-4fd4-82bd-6115b9ce262c None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:58.331603 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 346/687] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:16:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:58.338159 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780c90cf-8955-491b-a550-37cc641f62d7 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:58.422605 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:58.449055 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780c90cf-8955-491b-a550-37cc641f62d7 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:58.489729 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ec24f8-09d3-4861-badc-ee2b4dde5088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:58.490315 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec24f8-09d3-4861-badc-ee2b4dde5088 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:58.490597 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec24f8-09d3-4861-badc-ee2b4dde5088 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:58.490869 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec24f8-09d3-4861-badc-ee2b4dde5088 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:58.499596 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ec24f8-09d3-4861-badc-ee2b4dde5088 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:58.501145 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ec24f8-09d3-4861-badc-ee2b4dde5088 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:58.518082 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-d4ec24f8-09d3-4861-badc-ee2b4dde5088 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 01:16:58.518082 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:58.518082 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:58.518082 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:58.518082 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:58.518082 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:58.518082 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:58.518082 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:58.518082 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:58.518082 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:58.518082 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:58.518082 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:58.518082 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 01:16:58.518082 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 01:16:58.518082 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 01:16:58.518082 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 01:16:58.519093 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:58.519093 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:58.519093 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 01:16:58.519093 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:16:58.519093 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 01:16:58.519093 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:16:58.519093 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:58.519093 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:58.519093 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:58.519093 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:58.519093 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:58.519093 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:58.519093 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:58.519093 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:58.519093 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:58.519093 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:58.519093 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:58.519093 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:58.520093 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:58.520093 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:58.520093 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 01:16:58.520093 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 01:16:58.520093 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 01:16:58.520093 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 01:16:58.520093 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 01:16:58.520093 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 01:16:58.520093 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 01:16:58.520093 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:16:58.520093 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 342/688] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 30 01:16:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:58.527285 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e75ad-9393-4fd4-82bd-6115b9ce262c None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:58.669336 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1ea5e-e104-4b05-a628-a3dc896c4c56 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:58.669691 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1ea5e-e104-4b05-a628-a3dc896c4c56 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:58.669888 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1ea5e-e104-4b05-a628-a3dc896c4c56 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:58.670510 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e75ad-9393-4fd4-82bd-6115b9ce262c None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:58.672675 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 343/689] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:16:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:16:58.677014 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f717fc0-2c1a-42de-b839-b2f9d9dfaffb None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:58.677289 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f717fc0-2c1a-42de-b839-b2f9d9dfaffb None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:58.677571 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f717fc0-2c1a-42de-b839-b2f9d9dfaffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:58.700248 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:58.709476 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea345986-4154-4e52-a55e-fac689937251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:58.710382 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea345986-4154-4e52-a55e-fac689937251 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:58.710492 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-9f717fc0-2c1a-42de-b839-b2f9d9dfaffb None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:58.711005 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea345986-4154-4e52-a55e-fac689937251 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:58.711569 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea345986-4154-4e52-a55e-fac689937251 None admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:58.711785 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-9f717fc0-2c1a-42de-b839-b2f9d9dfaffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:58.712706 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea345986-4154-4e52-a55e-fac689937251 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:58.713206 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea345986-4154-4e52-a55e-fac689937251 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:58.714837 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea345986-4154-4e52-a55e-fac689937251 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:58.735342 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 347/690] 10.222.0.60 () {56 vars in 1135 bytes} [Tue Aug 30 01:16:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:58.745927 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea345986-4154-4e52-a55e-fac689937251 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:58.823179 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 344/691] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:16:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:16:58.889594 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea345986-4154-4e52-a55e-fac689937251 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:58.927269 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d98be5-b9e8-4024-997b-274ded081ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:58.928300 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d98be5-b9e8-4024-997b-274ded081ba9 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:58.928805 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d98be5-b9e8-4024-997b-274ded081ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:58.929277 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d98be5-b9e8-4024-997b-274ded081ba9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:58.984094 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:58.999782 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d98be5-b9e8-4024-997b-274ded081ba9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:59.001713 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d98be5-b9e8-4024-997b-274ded081ba9 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:59.106896 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 348/692] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 30 01:16:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:59.112674 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f717fc0-2c1a-42de-b839-b2f9d9dfaffb None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:59.141247 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d98be5-b9e8-4024-997b-274ded081ba9 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:59.233898 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:59.295045 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f717fc0-2c1a-42de-b839-b2f9d9dfaffb None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:59.300909 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:59.334308 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3365db40-35e7-481b-9884-69b5069435d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:59.334965 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365db40-35e7-481b-9884-69b5069435d4 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:59.335251 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365db40-35e7-481b-9884-69b5069435d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:59.335591 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365db40-35e7-481b-9884-69b5069435d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:59.345392 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d98be5-b9e8-4024-997b-274ded081ba9 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:59.346595 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3365db40-35e7-481b-9884-69b5069435d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:59.348274 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3365db40-35e7-481b-9884-69b5069435d4 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:59.364111 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-3365db40-35e7-481b-9884-69b5069435d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:59.364111 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:59.364111 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:59.364111 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:59.364111 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:59.364111 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:59.364111 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:59.364111 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:59.364111 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:59.364111 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:59.364111 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:59.364111 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:59.364111 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:16:59.364111 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:16:59.364111 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:16:59.364111 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:16:59.365140 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:59.365140 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:59.365140 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:59.365140 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:59.365140 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:59.365140 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:59.365140 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:59.365140 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:59.365140 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:59.365140 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:59.365140 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:59.365140 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:59.365140 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:59.365140 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:59.365140 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:59.365140 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:59.365140 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:16:59.366130 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:16:59.366130 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:59.366130 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:16:59.369994 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 345/693] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:16:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:59.371257 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3365db40-35e7-481b-9884-69b5069435d4 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:59.418869 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31abd87a-395f-4fa3-8978-80b5f7e361e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:59.419531 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31abd87a-395f-4fa3-8978-80b5f7e361e3 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:59.419814 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31abd87a-395f-4fa3-8978-80b5f7e361e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:59.420086 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31abd87a-395f-4fa3-8978-80b5f7e361e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:59.437936 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31abd87a-395f-4fa3-8978-80b5f7e361e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:16:59.443412 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-31abd87a-395f-4fa3-8978-80b5f7e361e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:16:59.443412 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:59.443412 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:59.443412 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:59.443412 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:59.443412 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:59.443412 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:59.443412 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:59.443412 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:59.443412 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:59.443412 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:59.443412 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:59.443412 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:16:59.443412 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:16:59.443412 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:16:59.443412 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:16:59.444371 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:16:59.444371 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:16:59.444371 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:16:59.444371 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:16:59.444371 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:59.444371 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:59.444371 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:59.444371 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:59.444371 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:59.444371 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:59.444371 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:59.444371 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:59.444371 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:59.444371 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:59.444371 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:59.444371 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:59.445236 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:59.445236 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:59.445236 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:59.445236 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:59.445236 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:16:59.445236 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:16:59.445236 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:16:59.445236 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:16:59.445236 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:16:59.445236 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:16:59.445236 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:16:59.445236 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:16:59.452976 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 349/694] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 30 01:16:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:16:59.458781 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31abd87a-395f-4fa3-8978-80b5f7e361e3 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:59.479547 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3365db40-35e7-481b-9884-69b5069435d4 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:59.507821 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:59.565657 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e270f9-b046-4794-825e-a00c413ba52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:59.565867 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e270f9-b046-4794-825e-a00c413ba52d None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:59.566095 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e270f9-b046-4794-825e-a00c413ba52d None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:59.566361 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e270f9-b046-4794-825e-a00c413ba52d None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:59.567140 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e270f9-b046-4794-825e-a00c413ba52d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:59.567473 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e270f9-b046-4794-825e-a00c413ba52d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:59.568853 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e270f9-b046-4794-825e-a00c413ba52d None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:59.595104 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 346/695] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:16:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:59.610816 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31abd87a-395f-4fa3-8978-80b5f7e361e3 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:59.612899 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e270f9-b046-4794-825e-a00c413ba52d None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:59.713075 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85df6c4f-bdb3-464d-92f9-4d57d4229794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:59.713806 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df6c4f-bdb3-464d-92f9-4d57d4229794 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:59.714091 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df6c4f-bdb3-464d-92f9-4d57d4229794 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:59.714389 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df6c4f-bdb3-464d-92f9-4d57d4229794 None admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:59.715126 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85df6c4f-bdb3-464d-92f9-4d57d4229794 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:16:59.715742 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85df6c4f-bdb3-464d-92f9-4d57d4229794 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:59.717123 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85df6c4f-bdb3-464d-92f9-4d57d4229794 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:59.726485 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 350/696] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 30 01:16:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:16:59.728053 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ad7e9-1e3b-4c4f-9f51-4e86d5b08456 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:59.728338 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ad7e9-1e3b-4c4f-9f51-4e86d5b08456 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:59.728674 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ad7e9-1e3b-4c4f-9f51-4e86d5b08456 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:59.734021 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 351/697] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:16:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:16:59.734981 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123ad7e9-1e3b-4c4f-9f51-4e86d5b08456 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:59.749618 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e270f9-b046-4794-825e-a00c413ba52d None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:59.756274 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:59.793479 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84de742-e01c-4a2d-aead-80497c1f4ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:59.794262 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84de742-e01c-4a2d-aead-80497c1f4ea7 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:59.794543 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84de742-e01c-4a2d-aead-80497c1f4ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:59.794811 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84de742-e01c-4a2d-aead-80497c1f4ea7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:59.804619 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84de742-e01c-4a2d-aead-80497c1f4ea7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:59.806289 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84de742-e01c-4a2d-aead-80497c1f4ea7 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:59.823029 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-d84de742-e01c-4a2d-aead-80497c1f4ea7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:16:59.823029 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:59.823029 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:59.823029 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:59.823029 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:59.823029 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:59.823029 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:59.823029 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:59.823029 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:59.823029 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:59.823029 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:59.823029 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:59.823029 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 01:16:59.823029 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 01:16:59.823029 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 01:16:59.823986 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 01:16:59.823986 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:59.823986 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:59.823986 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:59.823986 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:59.823986 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:59.823986 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:59.823986 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:59.823986 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:59.823986 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:59.823986 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:59.823986 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:59.823986 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:59.823986 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:59.823986 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:59.823986 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:59.823986 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:59.824878 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 01:16:59.824878 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 01:16:59.824878 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 01:16:59.824878 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 01:16:59.824878 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 01:16:59.824878 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 01:16:59.824878 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:16:59.824878 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:16:59.824878 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 347/698] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 30 01:16:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:16:59.825817 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d949e32-4a66-4081-8343-3621ada26aea None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:59.825976 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d949e32-4a66-4081-8343-3621ada26aea None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:59.831457 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d949e32-4a66-4081-8343-3621ada26aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:59.849231 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-4d949e32-4a66-4081-8343-3621ada26aea None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:16:59.850428 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-4d949e32-4a66-4081-8343-3621ada26aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:16:59.862384 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123ad7e9-1e3b-4c4f-9f51-4e86d5b08456 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:16:59.884346 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:59.897663 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60ff0aa-121b-454d-ad40-b52df86bb597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:16:59.898294 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ff0aa-121b-454d-ad40-b52df86bb597 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:16:59.898570 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ff0aa-121b-454d-ad40-b52df86bb597 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:16:59.898840 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ff0aa-121b-454d-ad40-b52df86bb597 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:16:59.909766 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60ff0aa-121b-454d-ad40-b52df86bb597 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:16:59.911329 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60ff0aa-121b-454d-ad40-b52df86bb597 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:16:59.926259 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-e60ff0aa-121b-454d-ad40-b52df86bb597 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:59.926259 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:16:59.926259 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:16:59.926259 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:16:59.926259 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:16:59.926259 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:16:59.926259 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:16:59.926259 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:16:59.926259 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:16:59.926259 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:16:59.926259 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:16:59.926259 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:16:59.926259 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:16:59.926259 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:16:59.926259 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:16:59.926259 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:16:59.927498 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:16:59.927498 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:16:59.927498 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:16:59.927498 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:16:59.927498 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:16:59.927498 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:16:59.927498 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:16:59.927498 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:16:59.927498 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:16:59.927498 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:16:59.927498 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:16:59.927498 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:16:59.927498 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:16:59.927498 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:16:59.927498 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:16:59.927498 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:16:59.927498 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:16:59.928533 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:16:59.928533 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:16:59.928533 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:16:59.939498 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 352/699] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:16:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:16:59.939498 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60ff0aa-121b-454d-ad40-b52df86bb597 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:16:59.939713 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 348/700] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:16:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:16:59.940508 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d949e32-4a66-4081-8343-3621ada26aea None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:00.012701 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:00.063211 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60ff0aa-121b-454d-ad40-b52df86bb597 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:00.072790 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d949e32-4a66-4081-8343-3621ada26aea None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:00.101515 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf3767e-ad57-4154-9b15-17f7c0aaa7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:00.102093 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3767e-ad57-4154-9b15-17f7c0aaa7c3 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:00.102374 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3767e-ad57-4154-9b15-17f7c0aaa7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:00.102644 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3767e-ad57-4154-9b15-17f7c0aaa7c3 None admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:00.103585 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf3767e-ad57-4154-9b15-17f7c0aaa7c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:00.103921 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf3767e-ad57-4154-9b15-17f7c0aaa7c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:00.105533 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf3767e-ad57-4154-9b15-17f7c0aaa7c3 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:00.112423 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebfe31c-dcfb-43a6-b28f-51a1cd412864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:00.113289 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebfe31c-dcfb-43a6-b28f-51a1cd412864 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:00.114240 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebfe31c-dcfb-43a6-b28f-51a1cd412864 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:00.114723 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebfe31c-dcfb-43a6-b28f-51a1cd412864 None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:00.115641 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebfe31c-dcfb-43a6-b28f-51a1cd412864 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:00.116194 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebfe31c-dcfb-43a6-b28f-51a1cd412864 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:00.117763 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebfe31c-dcfb-43a6-b28f-51a1cd412864 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:00.124044 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 353/701] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 30 01:16:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:00.124044 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1950390-71ed-4e36-93af-071479bdb95b None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:00.124044 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1950390-71ed-4e36-93af-071479bdb95b None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:00.124044 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1950390-71ed-4e36-93af-071479bdb95b None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:00.124044 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 354/702] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:17:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:17:00.125607 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1950390-71ed-4e36-93af-071479bdb95b None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:00.137461 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 349/703] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:16:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:00.143550 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2334fa7-16c5-4d7d-a213-496737cdb05a None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:00.143841 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2334fa7-16c5-4d7d-a213-496737cdb05a None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:00.144112 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2334fa7-16c5-4d7d-a213-496737cdb05a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:00.163689 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-e2334fa7-16c5-4d7d-a213-496737cdb05a None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:00.164693 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-e2334fa7-16c5-4d7d-a213-496737cdb05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:00.185487 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:00.239270 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 350/704] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:17:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:17:00.240155 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2334fa7-16c5-4d7d-a213-496737cdb05a None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:00.259898 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1950390-71ed-4e36-93af-071479bdb95b None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:00.282506 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:00.302671 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5a23d3-9cb6-4bf0-af65-899d544e8286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:00.303580 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a23d3-9cb6-4bf0-af65-899d544e8286 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:00.304020 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a23d3-9cb6-4bf0-af65-899d544e8286 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:00.304296 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a23d3-9cb6-4bf0-af65-899d544e8286 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:00.305340 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5a23d3-9cb6-4bf0-af65-899d544e8286 None admin] RBAC: Adding query filter params (role.id=01439ffbf0dd41caadd0cc40b3176062, scope.project.id=b050b2dad22a4a06875072e44c8c9824, user.id=1e7de1f31ef84d529bf2c53ce0f7e38b) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:00.305340 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5a23d3-9cb6-4bf0-af65-899d544e8286 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:00.306748 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5a23d3-9cb6-4bf0-af65-899d544e8286 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:00.315480 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 355/705] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 30 01:17:00 2022] GET /identity/v3/role_assignments?user.id=1e7de1f31ef84d529bf2c53ce0f7e38b&scope.project.id=b050b2dad22a4a06875072e44c8c9824&role.id=01439ffbf0dd41caadd0cc40b3176062 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:17:00.315480 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5a23d3-9cb6-4bf0-af65-899d544e8286 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:00.390990 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2334fa7-16c5-4d7d-a213-496737cdb05a None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:00.429018 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16333687-2157-46cc-800b-b774c3757819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:00.429656 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16333687-2157-46cc-800b-b774c3757819 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:00.429935 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16333687-2157-46cc-800b-b774c3757819 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:00.430207 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16333687-2157-46cc-800b-b774c3757819 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:00.439683 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16333687-2157-46cc-800b-b774c3757819 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:00.441493 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16333687-2157-46cc-800b-b774c3757819 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:00.454831 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-16333687-2157-46cc-800b-b774c3757819 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 01:17:00.454831 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:00.454831 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:00.454831 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:00.454831 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:00.454831 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:00.454831 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:00.454831 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:00.454831 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:00.454831 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:00.454831 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:00.454831 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:00.454831 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 01:17:00.454831 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 01:17:00.454831 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 01:17:00.454831 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 01:17:00.456612 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:00.456612 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:00.456612 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 01:17:00.456612 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:17:00.456612 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 01:17:00.456612 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:17:00.456612 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:00.456612 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:00.456612 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:00.456612 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:00.456612 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:00.456612 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:00.456612 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:00.456612 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:00.456612 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:00.456612 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:00.456612 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:00.456612 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:00.457547 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:00.457547 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:00.457547 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 01:17:00.457547 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 01:17:00.457547 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 01:17:00.457547 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 01:17:00.457547 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 01:17:00.457547 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 01:17:00.457547 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 01:17:00.457547 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:00.461417 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 351/706] 10.222.0.60 () {56 vars in 1093 bytes} [Tue Aug 30 01:17:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:00.462841 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58989bb7-7676-4a9e-9fc0-38975f83bf87 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:00.463127 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58989bb7-7676-4a9e-9fc0-38975f83bf87 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:00.463414 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58989bb7-7676-4a9e-9fc0-38975f83bf87 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:00.465047 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 352/707] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:17:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:17:00.466093 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58989bb7-7676-4a9e-9fc0-38975f83bf87 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:00.476118 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5a23d3-9cb6-4bf0-af65-899d544e8286 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:00.493994 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:00.517550 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10099577-31aa-44f4-b6ef-a8430d0053f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:00.518371 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10099577-31aa-44f4-b6ef-a8430d0053f2 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:00.518646 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10099577-31aa-44f4-b6ef-a8430d0053f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:00.518916 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10099577-31aa-44f4-b6ef-a8430d0053f2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:00.519937 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10099577-31aa-44f4-b6ef-a8430d0053f2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:00.520892 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10099577-31aa-44f4-b6ef-a8430d0053f2 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:00.535632 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-10099577-31aa-44f4-b6ef-a8430d0053f2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 01:17:00.535632 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:00.535632 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 01:17:00.535632 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 01:17:00.535632 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 01:17:00.535632 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 01:17:00.535632 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 01:17:00.535632 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:17:00.535632 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 01:17:00.535632 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:00.535632 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 01:17:00.535632 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:00.535632 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:00.535632 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:00.535632 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:00.535632 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:00.535632 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:00.536798 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:00.536798 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:00.536798 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:00.536798 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:00.536798 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:00.536798 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:00.536798 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 01:17:00.536798 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 01:17:00.536798 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 01:17:00.536798 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 01:17:00.536798 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:00.536798 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:00.536798 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:00.536798 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:00.536798 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:00.536798 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:00.537686 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:00.537686 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:00.537686 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:00.537686 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:00.537686 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:00.537686 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:00.537686 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:00.537686 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:00.537686 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:00.537686 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:00.537686 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 01:17:00.537686 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:17:00.537686 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 01:17:00.537686 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:00.537686 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 356/708] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Aug 30 01:17:00 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:00.538506 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635bbd6-948a-48ba-86b2-59aa8aa29857 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:00.538506 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635bbd6-948a-48ba-86b2-59aa8aa29857 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:00.538637 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635bbd6-948a-48ba-86b2-59aa8aa29857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:00.557446 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-6635bbd6-948a-48ba-86b2-59aa8aa29857 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:00.558647 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-6635bbd6-948a-48ba-86b2-59aa8aa29857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:00.614802 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:00.619582 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58989bb7-7676-4a9e-9fc0-38975f83bf87 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:00.646848 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 357/709] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:17:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:17:00.648339 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6635bbd6-948a-48ba-86b2-59aa8aa29857 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:00.655626 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f5e71a-4fb9-4ea9-ae71-af602431e826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:00.660661 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5e71a-4fb9-4ea9-ae71-af602431e826 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:00.661093 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5e71a-4fb9-4ea9-ae71-af602431e826 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:00.661532 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5e71a-4fb9-4ea9-ae71-af602431e826 None admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:00.662494 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f5e71a-4fb9-4ea9-ae71-af602431e826 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:00.662949 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f5e71a-4fb9-4ea9-ae71-af602431e826 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:00.664563 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f5e71a-4fb9-4ea9-ae71-af602431e826 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:00.684033 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 353/710] 10.222.0.60 () {56 vars in 1133 bytes} [Tue Aug 30 01:17:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:00.685099 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f5e71a-4fb9-4ea9-ae71-af602431e826 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:00.773148 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:00.789034 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6635bbd6-948a-48ba-86b2-59aa8aa29857 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:00.801076 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f5e71a-4fb9-4ea9-ae71-af602431e826 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:00.834049 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9468d91b-3434-409f-a0d2-aeb43431f756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:00.835089 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468d91b-3434-409f-a0d2-aeb43431f756 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:00.835535 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468d91b-3434-409f-a0d2-aeb43431f756 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:00.835943 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468d91b-3434-409f-a0d2-aeb43431f756 None admin] PATH_INFO: `/v3/services/network` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:00.836664 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9468d91b-3434-409f-a0d2-aeb43431f756 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:00.838520 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9468d91b-3434-409f-a0d2-aeb43431f756 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:00.843998 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e948eb-7236-424b-9675-3c563279f466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:00.844720 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e948eb-7236-424b-9675-3c563279f466 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:00.845095 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e948eb-7236-424b-9675-3c563279f466 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:00.845462 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e948eb-7236-424b-9675-3c563279f466 None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:00.846713 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e948eb-7236-424b-9675-3c563279f466 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:00.847109 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e948eb-7236-424b-9675-3c563279f466 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:00.848679 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e948eb-7236-424b-9675-3c563279f466 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:00.850675 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-9468d91b-3434-409f-a0d2-aeb43431f756 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 01:17:00.850675 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:00.850675 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 01:17:00.850675 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 01:17:00.850675 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 01:17:00.850675 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 01:17:00.850675 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 01:17:00.850675 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:17:00.850675 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 01:17:00.850675 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:00.850675 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 01:17:00.850675 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:00.850675 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:00.850675 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:00.850675 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:00.850675 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:00.850675 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:00.851674 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:00.851674 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:00.851674 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:00.851674 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:00.851674 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:00.851674 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:00.851674 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 01:17:00.851674 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 01:17:00.851674 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 01:17:00.851674 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 01:17:00.851674 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:00.851674 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:00.851674 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:00.851674 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:00.851674 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:00.851674 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:00.852491 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:00.852491 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:00.852491 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:00.852491 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:00.852491 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:00.852491 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:00.852491 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:00.852491 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:00.852491 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:00.852491 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:00.852491 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 01:17:00.852491 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:17:00.852491 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 01:17:00.852491 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:00.854662 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 354/711] 10.222.0.60 () {56 vars in 1124 bytes} [Tue Aug 30 01:17:00 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:00.855723 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 358/712] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 30 01:17:00 2022] GET /identity/v3/services/network => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:00.859774 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9468d91b-3434-409f-a0d2-aeb43431f756 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:00.859892 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e948eb-7236-424b-9675-3c563279f466 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:00.907334 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:00.970937 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9468d91b-3434-409f-a0d2-aeb43431f756 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:00.984439 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e948eb-7236-424b-9675-3c563279f466 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:01.009284 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d0880-29e3-4fa0-bb65-50ad092c62fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:01.009893 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d0880-29e3-4fa0-bb65-50ad092c62fe None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:01.010167 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d0880-29e3-4fa0-bb65-50ad092c62fe None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:01.010435 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d0880-29e3-4fa0-bb65-50ad092c62fe None admin] PATH_INFO: `/v3/services` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:01.011056 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6d0880-29e3-4fa0-bb65-50ad092c62fe None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:01.011356 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6d0880-29e3-4fa0-bb65-50ad092c62fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:01.012755 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6d0880-29e3-4fa0-bb65-50ad092c62fe None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:01.018586 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 359/713] 10.222.0.60 () {56 vars in 1124 bytes} [Tue Aug 30 01:17:00 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:01.019372 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d0880-29e3-4fa0-bb65-50ad092c62fe None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:01.029828 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a801c8f8-1de4-41c5-bc86-5919bbe3983a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:01.030584 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801c8f8-1de4-41c5-bc86-5919bbe3983a None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:01.030866 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801c8f8-1de4-41c5-bc86-5919bbe3983a None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:01.031142 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801c8f8-1de4-41c5-bc86-5919bbe3983a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:01.043649 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:01.115038 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a801c8f8-1de4-41c5-bc86-5919bbe3983a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:01.116724 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a801c8f8-1de4-41c5-bc86-5919bbe3983a None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:01.176971 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d0880-29e3-4fa0-bb65-50ad092c62fe None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:01.181370 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:01.223338 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab040c-3c5d-4668-869e-86b5cac60689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:01.224004 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab040c-3c5d-4668-869e-86b5cac60689 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:01.224281 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab040c-3c5d-4668-869e-86b5cac60689 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:01.224506 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab040c-3c5d-4668-869e-86b5cac60689 None admin] PATH_INFO: `/v3/services` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:01.225375 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab040c-3c5d-4668-869e-86b5cac60689 None admin] RBAC: Adding query filter params (name=network) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:01.225505 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab040c-3c5d-4668-869e-86b5cac60689 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:01.226784 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab040c-3c5d-4668-869e-86b5cac60689 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:01.233591 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 360/714] 10.222.0.60 () {56 vars in 1112 bytes} [Tue Aug 30 01:17:01 2022] GET /identity/v3/services?name=network => generated 124 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:01.233591 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab040c-3c5d-4668-869e-86b5cac60689 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:01.243016 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 355/715] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 30 01:17:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:01.244306 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a801c8f8-1de4-41c5-bc86-5919bbe3983a None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:01.297731 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:01.347606 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab040c-3c5d-4668-869e-86b5cac60689 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:01.369492 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a801c8f8-1de4-41c5-bc86-5919bbe3983a None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:01.384456 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c754b2f4-2c35-4407-b0e7-f26005a62e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:01.385470 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754b2f4-2c35-4407-b0e7-f26005a62e2f None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:01.385962 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754b2f4-2c35-4407-b0e7-f26005a62e2f None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:01.386322 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754b2f4-2c35-4407-b0e7-f26005a62e2f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:01.406009 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641bb971-3478-4356-83c5-ed8b5e77e0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:01.406618 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641bb971-3478-4356-83c5-ed8b5e77e0c8 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:01.406893 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641bb971-3478-4356-83c5-ed8b5e77e0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:01.407158 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641bb971-3478-4356-83c5-ed8b5e77e0c8 None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:01.407894 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641bb971-3478-4356-83c5-ed8b5e77e0c8 None admin] RBAC: Adding query filter params (type=network) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:01.408152 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641bb971-3478-4356-83c5-ed8b5e77e0c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:01.409442 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c754b2f4-2c35-4407-b0e7-f26005a62e2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:17:01.410118 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641bb971-3478-4356-83c5-ed8b5e77e0c8 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:01.416408 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 356/716] 10.222.0.60 () {56 vars in 1112 bytes} [Tue Aug 30 01:17:01 2022] GET /identity/v3/services?type=network => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:01.416712 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-c754b2f4-2c35-4407-b0e7-f26005a62e2f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 01:17:01.416712 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:01.416712 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:01.416712 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:01.416712 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:01.416712 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:01.416712 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:01.416712 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:01.416712 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:01.416712 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:01.416712 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:01.416712 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:01.416712 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:17:01.416712 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:17:01.416712 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:17:01.416712 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:17:01.417632 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:17:01.417632 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:17:01.417632 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:17:01.417632 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:17:01.417632 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:01.417632 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:01.417632 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:01.417632 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:01.417632 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:01.417632 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:01.417632 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:01.417632 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:01.417632 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:01.417632 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:01.417632 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:01.417632 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:01.418500 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:01.418500 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:01.418500 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:01.418500 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:01.418500 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:17:01.418500 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:17:01.418500 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:17:01.418500 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:17:01.418500 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:17:01.418500 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:17:01.418500 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 01:17:01.418500 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:01.419159 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641bb971-3478-4356-83c5-ed8b5e77e0c8 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:01.420851 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 361/717] 10.222.0.60 () {56 vars in 1102 bytes} [Tue Aug 30 01:17:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:01.432752 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c754b2f4-2c35-4407-b0e7-f26005a62e2f None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:01.520992 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:01.591601 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641bb971-3478-4356-83c5-ed8b5e77e0c8 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:01.593426 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:01.638576 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c754b2f4-2c35-4407-b0e7-f26005a62e2f None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:01.646184 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd8593a-f429-4d97-9dfa-7aa49531ec68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:01.647586 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8593a-f429-4d97-9dfa-7aa49531ec68 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:01.648084 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8593a-f429-4d97-9dfa-7aa49531ec68 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:01.648522 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8593a-f429-4d97-9dfa-7aa49531ec68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:01.663058 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd8593a-f429-4d97-9dfa-7aa49531ec68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:01.665699 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd8593a-f429-4d97-9dfa-7aa49531ec68 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:01.678806 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23d24f-3b1b-4a5a-9fd7-0105a62305c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:01.679418 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23d24f-3b1b-4a5a-9fd7-0105a62305c5 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:01.679721 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23d24f-3b1b-4a5a-9fd7-0105a62305c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:01.679987 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23d24f-3b1b-4a5a-9fd7-0105a62305c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:01.680655 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e23d24f-3b1b-4a5a-9fd7-0105a62305c5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:01.680952 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e23d24f-3b1b-4a5a-9fd7-0105a62305c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:01.682320 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e23d24f-3b1b-4a5a-9fd7-0105a62305c5 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:01.686281 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-bfd8593a-f429-4d97-9dfa-7aa49531ec68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:17:01.686281 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:01.686281 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:01.686281 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:01.686281 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:01.686281 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:01.686281 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:01.686281 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:01.686281 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:01.686281 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:01.686281 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:01.686281 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:01.686281 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:17:01.686281 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:17:01.686281 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:17:01.686281 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:17:01.687271 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:01.687271 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:01.687271 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:01.687271 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:01.687271 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:01.687271 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:01.687271 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:01.687271 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:01.687271 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:01.687271 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:01.687271 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:01.687271 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:01.687271 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:01.687271 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:01.687271 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:01.687271 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:01.687271 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:17:01.688244 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:17:01.688244 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:17:01.688244 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:01.691495 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 357/718] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:17:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:01.697245 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 362/719] 10.222.0.60 () {56 vars in 1103 bytes} [Tue Aug 30 01:17:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:17:01.698331 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd8593a-f429-4d97-9dfa-7aa49531ec68 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:01.698473 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23d24f-3b1b-4a5a-9fd7-0105a62305c5 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:01.862343 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:01.877052 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23d24f-3b1b-4a5a-9fd7-0105a62305c5 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:01.933294 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd8593a-f429-4d97-9dfa-7aa49531ec68 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:01.951547 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cababf2-43ec-462e-8cc2-254d826d2380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:01.952103 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cababf2-43ec-462e-8cc2-254d826d2380 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:01.952380 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cababf2-43ec-462e-8cc2-254d826d2380 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:01.952655 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cababf2-43ec-462e-8cc2-254d826d2380 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:01.976856 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cababf2-43ec-462e-8cc2-254d826d2380 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:01.978304 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cababf2-43ec-462e-8cc2-254d826d2380 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:02.004619 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf411f2-2949-406c-8910-82e41d89a98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:02.005281 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf411f2-2949-406c-8910-82e41d89a98b None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:02.005557 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf411f2-2949-406c-8910-82e41d89a98b None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:02.005824 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf411f2-2949-406c-8910-82e41d89a98b None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:02.006514 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf411f2-2949-406c-8910-82e41d89a98b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:02.006817 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf411f2-2949-406c-8910-82e41d89a98b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:02.008230 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf411f2-2949-406c-8910-82e41d89a98b None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:02.011622 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-4cababf2-43ec-462e-8cc2-254d826d2380 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:17:02.011622 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:02.011622 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:02.011622 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:02.011622 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:02.011622 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:02.011622 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:02.011622 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:02.011622 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:02.011622 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:02.011622 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:02.011622 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:02.011622 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:17:02.011622 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:17:02.011622 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:17:02.011622 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:17:02.012535 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:02.012535 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:02.012535 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:02.012535 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:02.012535 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:02.012535 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:02.012535 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:02.012535 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:02.012535 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:02.012535 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:02.012535 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:02.012535 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:02.012535 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:02.012535 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:02.012535 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:02.012535 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:02.012535 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:17:02.013433 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:17:02.013433 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:17:02.013433 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:02.015464 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 363/720] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:17:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:02.019091 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cababf2-43ec-462e-8cc2-254d826d2380 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:02.029650 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 358/721] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:17:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:02.034648 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf411f2-2949-406c-8910-82e41d89a98b None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:02.067897 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:02.132251 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cababf2-43ec-462e-8cc2-254d826d2380 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:02.169907 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960de3e5-3820-43b5-a886-778ce91cedee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:02.170653 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960de3e5-3820-43b5-a886-778ce91cedee None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:02.170934 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960de3e5-3820-43b5-a886-778ce91cedee None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:02.171206 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960de3e5-3820-43b5-a886-778ce91cedee None admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:02.171898 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960de3e5-3820-43b5-a886-778ce91cedee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:02.172197 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960de3e5-3820-43b5-a886-778ce91cedee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:02.173886 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960de3e5-3820-43b5-a886-778ce91cedee None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:02.189324 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 364/722] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:17:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:02.195552 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960de3e5-3820-43b5-a886-778ce91cedee None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:02.199724 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:02.310912 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf411f2-2949-406c-8910-82e41d89a98b None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:02.388537 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5a90c-7da2-45ee-b46f-5c065ae8049f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:02.389170 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5a90c-7da2-45ee-b46f-5c065ae8049f None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:02.389443 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5a90c-7da2-45ee-b46f-5c065ae8049f None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:02.389719 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5a90c-7da2-45ee-b46f-5c065ae8049f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:02.406233 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de5a90c-7da2-45ee-b46f-5c065ae8049f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:02.407719 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de5a90c-7da2-45ee-b46f-5c065ae8049f None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:02.421654 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-5de5a90c-7da2-45ee-b46f-5c065ae8049f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:17:02.421654 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:02.421654 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:02.421654 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:02.421654 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:02.421654 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:02.421654 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:02.421654 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:02.421654 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:02.421654 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:02.421654 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:02.421654 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:02.421654 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 01:17:02.421654 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 01:17:02.421654 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 01:17:02.422567 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 01:17:02.422567 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:02.422567 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:02.422567 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:02.422567 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:02.422567 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:02.422567 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:02.422567 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:02.422567 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:02.422567 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:02.422567 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:02.422567 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:02.422567 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:02.422567 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:02.422567 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:02.422567 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:02.422567 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:02.423556 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 01:17:02.423556 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 01:17:02.423556 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 01:17:02.423556 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 01:17:02.423556 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 01:17:02.423556 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 01:17:02.423556 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:17:02.423556 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:02.423556 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 359/723] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 30 01:17:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 389 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:17:02.430662 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5a90c-7da2-45ee-b46f-5c065ae8049f None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:02.518940 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:02.525099 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960de3e5-3820-43b5-a886-778ce91cedee None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:02.549224 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5a90c-7da2-45ee-b46f-5c065ae8049f None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:02.571063 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd64f826-dd0d-4dae-b9ca-c5d5173bc8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:02.571906 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64f826-dd0d-4dae-b9ca-c5d5173bc8b9 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:02.572185 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64f826-dd0d-4dae-b9ca-c5d5173bc8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:02.572452 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64f826-dd0d-4dae-b9ca-c5d5173bc8b9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:02.582821 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd64f826-dd0d-4dae-b9ca-c5d5173bc8b9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:02.585430 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd64f826-dd0d-4dae-b9ca-c5d5173bc8b9 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:02.595661 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc2f7c3-9247-4045-acea-0c1e4001ae91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:02.596624 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2f7c3-9247-4045-acea-0c1e4001ae91 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:02.597130 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2f7c3-9247-4045-acea-0c1e4001ae91 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:02.597602 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2f7c3-9247-4045-acea-0c1e4001ae91 None admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:02.598516 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc2f7c3-9247-4045-acea-0c1e4001ae91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:02.599039 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc2f7c3-9247-4045-acea-0c1e4001ae91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:02.601600 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc2f7c3-9247-4045-acea-0c1e4001ae91 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:02.608207 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-fd64f826-dd0d-4dae-b9ca-c5d5173bc8b9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 01:17:02.608207 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:02.608207 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:02.608207 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:02.608207 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:02.608207 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:02.608207 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:02.608207 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:02.608207 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:02.608207 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:02.608207 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:02.608207 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:02.608207 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 01:17:02.608207 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 01:17:02.608207 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 01:17:02.608207 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 01:17:02.609198 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:02.609198 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:02.609198 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 01:17:02.609198 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:17:02.609198 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 01:17:02.609198 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:17:02.609198 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:02.609198 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:02.609198 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:02.609198 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:02.609198 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:02.609198 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:02.609198 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:02.609198 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:02.609198 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:02.609198 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:02.609198 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:02.609198 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:02.610186 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:02.610186 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:02.610186 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 01:17:02.610186 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 01:17:02.610186 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 01:17:02.610186 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 01:17:02.610186 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 01:17:02.610186 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 01:17:02.610186 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 01:17:02.610186 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:02.610186 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 365/724] 10.222.0.60 () {56 vars in 1117 bytes} [Tue Aug 30 01:17:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 415 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:17:02.611355 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897b282-9791-4186-b14b-15a2183c40ef None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:02.611355 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897b282-9791-4186-b14b-15a2183c40ef None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:02.611611 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897b282-9791-4186-b14b-15a2183c40ef None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:02.616849 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 366/725] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:17:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:17:02.616849 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4897b282-9791-4186-b14b-15a2183c40ef None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:02.627730 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 360/726] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 30 01:17:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:17:02.629486 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a972da-5f2d-44d1-b0a1-aab8753fca73 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:02.630099 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a972da-5f2d-44d1-b0a1-aab8753fca73 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:02.630601 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a972da-5f2d-44d1-b0a1-aab8753fca73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:02.652621 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-f7a972da-5f2d-44d1-b0a1-aab8753fca73 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:02.654339 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-f7a972da-5f2d-44d1-b0a1-aab8753fca73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:02.691768 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:02.741026 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4897b282-9791-4186-b14b-15a2183c40ef None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:02.751455 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 361/727] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:17:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:17:02.751455 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a972da-5f2d-44d1-b0a1-aab8753fca73 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:02.818872 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:02.820928 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b8136e-65b4-4cd3-a60c-ec83f0e908cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:02.821840 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8136e-65b4-4cd3-a60c-ec83f0e908cc None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:02.822314 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8136e-65b4-4cd3-a60c-ec83f0e908cc None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:02.822764 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8136e-65b4-4cd3-a60c-ec83f0e908cc None admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:02.827520 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b8136e-65b4-4cd3-a60c-ec83f0e908cc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:02.828058 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b8136e-65b4-4cd3-a60c-ec83f0e908cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:02.829677 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b8136e-65b4-4cd3-a60c-ec83f0e908cc None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:02.864616 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a972da-5f2d-44d1-b0a1-aab8753fca73 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:02.867953 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 367/728] 10.222.0.60 () {56 vars in 1149 bytes} [Tue Aug 30 01:17:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:02.873007 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b8136e-65b4-4cd3-a60c-ec83f0e908cc None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:02.904747 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a28ca-418a-4d0d-9939-f6118cf09716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:02.905644 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a28ca-418a-4d0d-9939-f6118cf09716 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:02.905934 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a28ca-418a-4d0d-9939-f6118cf09716 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:02.906203 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a28ca-418a-4d0d-9939-f6118cf09716 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:02.907002 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6a28ca-418a-4d0d-9939-f6118cf09716 None admin] RBAC: Adding query filter params (role.id=f6bc03b6972e420eb338ee7fd1443974, scope.project.id=b050b2dad22a4a06875072e44c8c9824, user.id=8889145228a24fb6bd539a11925e62f2) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:02.907803 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6a28ca-418a-4d0d-9939-f6118cf09716 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:02.909441 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6a28ca-418a-4d0d-9939-f6118cf09716 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:02.916029 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 362/729] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 30 01:17:02 2022] GET /identity/v3/role_assignments?user.id=8889145228a24fb6bd539a11925e62f2&scope.project.id=b050b2dad22a4a06875072e44c8c9824&role.id=f6bc03b6972e420eb338ee7fd1443974 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:03.061836 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b8136e-65b4-4cd3-a60c-ec83f0e908cc None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:03.084277 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:03.102436 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27651b8-bfdc-4ffc-81ed-1522c233cacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:03.103050 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27651b8-bfdc-4ffc-81ed-1522c233cacf None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:03.103327 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27651b8-bfdc-4ffc-81ed-1522c233cacf None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:03.103624 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27651b8-bfdc-4ffc-81ed-1522c233cacf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:03.148956 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a28ca-418a-4d0d-9939-f6118cf09716 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:03.222016 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27651b8-bfdc-4ffc-81ed-1522c233cacf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:03.223535 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27651b8-bfdc-4ffc-81ed-1522c233cacf None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:03.277274 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a28ca-418a-4d0d-9939-f6118cf09716 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:03.306449 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:03.314701 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64879fe3-8da3-4cc1-bc99-3245a3a5dda4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:03.315493 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64879fe3-8da3-4cc1-bc99-3245a3a5dda4 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:03.315851 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64879fe3-8da3-4cc1-bc99-3245a3a5dda4 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:03.316191 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64879fe3-8da3-4cc1-bc99-3245a3a5dda4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:03.326984 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64879fe3-8da3-4cc1-bc99-3245a3a5dda4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:17:03.332591 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-64879fe3-8da3-4cc1-bc99-3245a3a5dda4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:17:03.332591 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:03.332591 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:03.332591 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:03.332591 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:03.332591 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:03.332591 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:03.332591 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:03.332591 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:03.332591 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:03.332591 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:03.332591 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:03.332591 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:17:03.332591 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:17:03.332591 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:17:03.332591 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:17:03.333532 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:17:03.333532 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:17:03.333532 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:17:03.333532 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:17:03.333532 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:03.333532 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:03.333532 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:03.333532 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:03.333532 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:03.333532 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:03.333532 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:03.333532 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:03.333532 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:03.333532 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:03.333532 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:03.333532 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:03.334437 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:03.334437 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:03.334437 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:03.334437 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:03.334437 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:17:03.334437 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:17:03.334437 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:17:03.334437 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:17:03.334437 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:17:03.334437 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:17:03.334437 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:17:03.334437 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:03.334437 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 363/730] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 30 01:17:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:03.335478 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a5003-a7ef-4e54-86ce-1fc89701cef2 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:03.339456 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a5003-a7ef-4e54-86ce-1fc89701cef2 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:03.339456 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a5003-a7ef-4e54-86ce-1fc89701cef2 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:03.342202 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 364/731] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:17:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:17:03.343399 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144292fb-e4a1-4385-a1f9-ee1f20a338a3 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:03.343711 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144292fb-e4a1-4385-a1f9-ee1f20a338a3 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:03.343985 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144292fb-e4a1-4385-a1f9-ee1f20a338a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:03.354105 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 368/732] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 30 01:17:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 01:17:03.354965 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27651b8-bfdc-4ffc-81ed-1522c233cacf None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:03.367960 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-144292fb-e4a1-4385-a1f9-ee1f20a338a3 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:03.369168 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-144292fb-e4a1-4385-a1f9-ee1f20a338a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:03.380411 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:03.442804 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 365/733] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:17:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:17:03.443581 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144292fb-e4a1-4385-a1f9-ee1f20a338a3 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:03.495159 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27651b8-bfdc-4ffc-81ed-1522c233cacf None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:03.548330 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144292fb-e4a1-4385-a1f9-ee1f20a338a3 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:03.557028 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4460737-3158-4a54-9d47-993bab7714d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:03.557644 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4460737-3158-4a54-9d47-993bab7714d8 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:03.557926 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4460737-3158-4a54-9d47-993bab7714d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:03.558194 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4460737-3158-4a54-9d47-993bab7714d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:03.558974 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4460737-3158-4a54-9d47-993bab7714d8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:03.559280 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4460737-3158-4a54-9d47-993bab7714d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:03.560769 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4460737-3158-4a54-9d47-993bab7714d8 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:03.570154 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:03.575522 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 369/734] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 30 01:17:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:03.584840 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4460737-3158-4a54-9d47-993bab7714d8 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:03.609828 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb123a6-f941-4de7-b520-516c833f249d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:03.610486 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb123a6-f941-4de7-b520-516c833f249d None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:03.610761 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb123a6-f941-4de7-b520-516c833f249d None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:03.611029 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb123a6-f941-4de7-b520-516c833f249d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:03.629815 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb123a6-f941-4de7-b520-516c833f249d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:03.631638 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb123a6-f941-4de7-b520-516c833f249d None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:03.654164 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-aeb123a6-f941-4de7-b520-516c833f249d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:17:03.654164 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:03.654164 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:03.654164 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:03.654164 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:03.654164 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:03.654164 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:03.654164 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:03.654164 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:03.654164 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:03.654164 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:03.654164 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:03.654164 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:17:03.654164 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:17:03.654164 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:17:03.654164 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:17:03.656470 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:03.656470 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:03.656470 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:03.656470 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:03.656470 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:03.656470 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:03.656470 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:03.656470 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:03.656470 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:03.656470 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:03.656470 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:03.656470 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:03.656470 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:03.656470 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:03.656470 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:03.656470 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:03.656470 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:17:03.659176 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:17:03.659176 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:17:03.659176 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:03.659176 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 366/735] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:17:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:03.663468 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb123a6-f941-4de7-b520-516c833f249d None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:03.684055 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:03.706199 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4460737-3158-4a54-9d47-993bab7714d8 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:03.743128 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e75c9f-49b9-4c2c-8767-ff14a77f08b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:03.743807 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e75c9f-49b9-4c2c-8767-ff14a77f08b8 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:03.744087 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e75c9f-49b9-4c2c-8767-ff14a77f08b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:03.744361 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e75c9f-49b9-4c2c-8767-ff14a77f08b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:03.756103 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e75c9f-49b9-4c2c-8767-ff14a77f08b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:03.757652 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e75c9f-49b9-4c2c-8767-ff14a77f08b8 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:03.770445 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb123a6-f941-4de7-b520-516c833f249d None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:03.774418 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-a5e75c9f-49b9-4c2c-8767-ff14a77f08b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:17:03.774418 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:03.774418 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:03.774418 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:03.774418 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:03.774418 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:03.774418 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:03.774418 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:03.774418 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:03.774418 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:03.774418 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:03.774418 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:03.774418 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:17:03.774418 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:17:03.774418 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:17:03.774418 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:17:03.776591 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:03.776591 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:03.776591 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:03.776591 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:03.776591 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:03.776591 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:03.776591 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:03.776591 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:03.776591 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:03.776591 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:03.776591 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:03.776591 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:03.776591 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:03.776591 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:03.776591 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:03.776591 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:03.776591 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:17:03.778729 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:17:03.778729 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:17:03.778729 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:03.778729 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 370/736] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:17:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:17:03.778729 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb1d08-c8a6-4693-ac35-363683930496 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:03.778729 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb1d08-c8a6-4693-ac35-363683930496 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:03.778729 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb1d08-c8a6-4693-ac35-363683930496 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:03.779399 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 371/737] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:17:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:17:03.784602 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d6cad-5182-4e77-8709-60422c0f725b None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:03.784901 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d6cad-5182-4e77-8709-60422c0f725b None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:03.785367 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d6cad-5182-4e77-8709-60422c0f725b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:03.804632 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-0b3d6cad-5182-4e77-8709-60422c0f725b None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:03.806069 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-0b3d6cad-5182-4e77-8709-60422c0f725b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:03.812758 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d3cfda-bedf-41a6-9fce-d3bc368acf8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:03.813361 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d3cfda-bedf-41a6-9fce-d3bc368acf8e None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:03.813671 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d3cfda-bedf-41a6-9fce-d3bc368acf8e None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:03.813935 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d3cfda-bedf-41a6-9fce-d3bc368acf8e None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:03.814572 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d3cfda-bedf-41a6-9fce-d3bc368acf8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:03.815604 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d3cfda-bedf-41a6-9fce-d3bc368acf8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:03.817033 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d3cfda-bedf-41a6-9fce-d3bc368acf8e None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:03.830163 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 367/738] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:17:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:17:03.831697 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d3cfda-bedf-41a6-9fce-d3bc368acf8e None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:03.862735 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:03.887697 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 372/739] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:17:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 01:17:03.888913 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d6cad-5182-4e77-8709-60422c0f725b None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:03.959627 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:03.965816 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d3cfda-bedf-41a6-9fce-d3bc368acf8e None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:04.000514 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d6cad-5182-4e77-8709-60422c0f725b None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:04.013260 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a419669-1eda-4b1f-8c60-fb7e8295173a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:04.014151 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a419669-1eda-4b1f-8c60-fb7e8295173a None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:04.014437 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a419669-1eda-4b1f-8c60-fb7e8295173a None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:04.014711 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a419669-1eda-4b1f-8c60-fb7e8295173a None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:04.015361 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a419669-1eda-4b1f-8c60-fb7e8295173a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:04.015694 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a419669-1eda-4b1f-8c60-fb7e8295173a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:04.017906 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a419669-1eda-4b1f-8c60-fb7e8295173a None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:04.038371 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 368/740] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:17:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:04.038371 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a419669-1eda-4b1f-8c60-fb7e8295173a None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:04.044317 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe369d67-2302-449c-abf2-e07d03333627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:04.045352 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe369d67-2302-449c-abf2-e07d03333627 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:04.045834 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe369d67-2302-449c-abf2-e07d03333627 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:04.046316 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe369d67-2302-449c-abf2-e07d03333627 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:04.055313 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe369d67-2302-449c-abf2-e07d03333627 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:04.057247 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe369d67-2302-449c-abf2-e07d03333627 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:04.070997 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-fe369d67-2302-449c-abf2-e07d03333627 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:17:04.070997 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:04.070997 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:04.070997 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:04.070997 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:04.070997 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:04.070997 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:04.070997 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:04.070997 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:04.070997 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:04.070997 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:04.070997 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:04.070997 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 01:17:04.070997 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 01:17:04.070997 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 01:17:04.072140 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 01:17:04.072140 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:04.072140 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:04.072140 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:04.072140 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:04.072140 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:04.072140 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:04.072140 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:04.072140 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:04.072140 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:04.072140 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:04.072140 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:04.072140 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:04.072140 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:04.072140 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:04.072140 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:04.072140 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:04.073049 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 01:17:04.073049 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 01:17:04.073049 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 01:17:04.073049 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 01:17:04.073049 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 01:17:04.073049 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 01:17:04.073049 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:17:04.073049 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:04.075295 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 373/741] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 30 01:17:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:04.076433 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe369d67-2302-449c-abf2-e07d03333627 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:04.158030 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:04.169224 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a419669-1eda-4b1f-8c60-fb7e8295173a None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:04.194846 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe369d67-2302-449c-abf2-e07d03333627 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:04.206456 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc80ece2-3b13-4c98-9478-f02ff3f0b49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:04.207234 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc80ece2-3b13-4c98-9478-f02ff3f0b49b None admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:04.207783 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc80ece2-3b13-4c98-9478-f02ff3f0b49b None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:04.208195 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc80ece2-3b13-4c98-9478-f02ff3f0b49b None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:04.209132 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc80ece2-3b13-4c98-9478-f02ff3f0b49b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:04.210764 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc80ece2-3b13-4c98-9478-f02ff3f0b49b None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:04.218485 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:04.227965 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 369/742] 10.222.0.60 () {60 vars in 1141 bytes} [Tue Aug 30 01:17:04 2022] POST /identity/v3/services => generated 251 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:17:04.228987 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc80ece2-3b13-4c98-9478-f02ff3f0b49b None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:04.260448 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7db5ca8-6b3d-451c-a3b1-7f575f4f1a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:04.261518 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db5ca8-6b3d-451c-a3b1-7f575f4f1a50 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:04.262051 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db5ca8-6b3d-451c-a3b1-7f575f4f1a50 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:04.262509 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db5ca8-6b3d-451c-a3b1-7f575f4f1a50 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:04.272879 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7db5ca8-6b3d-451c-a3b1-7f575f4f1a50 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:04.276440 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7db5ca8-6b3d-451c-a3b1-7f575f4f1a50 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:04.293547 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-b7db5ca8-6b3d-451c-a3b1-7f575f4f1a50 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 01:17:04.293547 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:04.293547 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:04.293547 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:04.293547 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:04.293547 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:04.293547 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:04.293547 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:04.293547 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:04.293547 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:04.293547 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:04.293547 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:04.293547 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 01:17:04.293547 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 01:17:04.293547 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 01:17:04.293547 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 01:17:04.295413 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:04.295413 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:04.295413 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 01:17:04.295413 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:17:04.295413 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 01:17:04.295413 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:17:04.295413 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:04.295413 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:04.295413 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:04.295413 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:04.295413 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:04.295413 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:04.295413 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:04.295413 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:04.295413 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:04.295413 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:04.295413 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:04.295413 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:04.297419 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:04.297419 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:04.297419 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 01:17:04.297419 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 01:17:04.297419 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 01:17:04.297419 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 01:17:04.297419 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 01:17:04.297419 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 01:17:04.297419 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 01:17:04.297419 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:04.307061 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 374/743] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 30 01:17:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:04.309405 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7db5ca8-6b3d-451c-a3b1-7f575f4f1a50 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:04.352689 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc80ece2-3b13-4c98-9478-f02ff3f0b49b None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:04.392111 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c208b2-2cf6-4fc7-9eac-09d5dade89b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:04.392942 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c208b2-2cf6-4fc7-9eac-09d5dade89b0 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:04.393330 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c208b2-2cf6-4fc7-9eac-09d5dade89b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:04.393706 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c208b2-2cf6-4fc7-9eac-09d5dade89b0 None admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:04.394462 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c208b2-2cf6-4fc7-9eac-09d5dade89b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:04.394837 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c208b2-2cf6-4fc7-9eac-09d5dade89b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:04.396390 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c208b2-2cf6-4fc7-9eac-09d5dade89b0 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:04.411356 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 370/744] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 30 01:17:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:04.412326 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c208b2-2cf6-4fc7-9eac-09d5dade89b0 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:04.429441 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:04.435111 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7db5ca8-6b3d-451c-a3b1-7f575f4f1a50 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:04.476688 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d7af9-51a7-45ba-bfee-365ac8d71367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:04.477625 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d7af9-51a7-45ba-bfee-365ac8d71367 None admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:04.477911 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d7af9-51a7-45ba-bfee-365ac8d71367 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:04.478184 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d7af9-51a7-45ba-bfee-365ac8d71367 None admin] PATH_INFO: `/v3/services` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:04.478847 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424d7af9-51a7-45ba-bfee-365ac8d71367 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:04.480991 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424d7af9-51a7-45ba-bfee-365ac8d71367 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:04.511493 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 375/745] 10.222.0.60 () {60 vars in 1141 bytes} [Tue Aug 30 01:17:04 2022] POST /identity/v3/services => generated 240 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:17:04.511493 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d7af9-51a7-45ba-bfee-365ac8d71367 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:04.566413 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c208b2-2cf6-4fc7-9eac-09d5dade89b0 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:04.571808 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:04.662714 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a271d2-2a2d-454c-8faf-1373a075b627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:04.663243 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a271d2-2a2d-454c-8faf-1373a075b627 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:04.663556 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a271d2-2a2d-454c-8faf-1373a075b627 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:04.665060 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a271d2-2a2d-454c-8faf-1373a075b627 None admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:04.665821 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a271d2-2a2d-454c-8faf-1373a075b627 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:04.666129 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a271d2-2a2d-454c-8faf-1373a075b627 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:04.667666 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a271d2-2a2d-454c-8faf-1373a075b627 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:04.707101 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 371/746] 10.222.0.60 () {56 vars in 1135 bytes} [Tue Aug 30 01:17:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:04.710027 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d7af9-51a7-45ba-bfee-365ac8d71367 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:04.713411 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a271d2-2a2d-454c-8faf-1373a075b627 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:04.762557 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e8c7b-d086-4d0a-9c19-c62aed071b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:04.763265 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e8c7b-d086-4d0a-9c19-c62aed071b7e None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:04.763635 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e8c7b-d086-4d0a-9c19-c62aed071b7e None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:04.764021 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e8c7b-d086-4d0a-9c19-c62aed071b7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:04.764839 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9e8c7b-d086-4d0a-9c19-c62aed071b7e None admin] RBAC: Adding query filter params (role.id=01439ffbf0dd41caadd0cc40b3176062, scope.project.id=b050b2dad22a4a06875072e44c8c9824, user.id=edc11f8a9c5843939ec230e63ca7fa3b) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:04.765215 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9e8c7b-d086-4d0a-9c19-c62aed071b7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:04.767832 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9e8c7b-d086-4d0a-9c19-c62aed071b7e None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:04.777422 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 376/747] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 30 01:17:04 2022] GET /identity/v3/role_assignments?user.id=edc11f8a9c5843939ec230e63ca7fa3b&scope.project.id=b050b2dad22a4a06875072e44c8c9824&role.id=01439ffbf0dd41caadd0cc40b3176062 => generated 259 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:04.804633 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:04.850499 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a271d2-2a2d-454c-8faf-1373a075b627 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:04.892883 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9b162c-21a0-4fdf-afb3-eca0d142f55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:04.893771 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b162c-21a0-4fdf-afb3-eca0d142f55c None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:04.894198 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b162c-21a0-4fdf-afb3-eca0d142f55c None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:04.894648 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b162c-21a0-4fdf-afb3-eca0d142f55c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:04.934372 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73975d5f-591e-4b6e-ba3a-9a092a3a397b None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:04.934549 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73975d5f-591e-4b6e-ba3a-9a092a3a397b None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:04.934824 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73975d5f-591e-4b6e-ba3a-9a092a3a397b None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:04.936180 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 377/748] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:17:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:17:04.958458 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f08e3-8f99-41e5-9b34-d768160c92be None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:04.958794 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f08e3-8f99-41e5-9b34-d768160c92be None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:04.959013 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f08e3-8f99-41e5-9b34-d768160c92be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:04.993272 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-cc0f08e3-8f99-41e5-9b34-d768160c92be None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:04.994488 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-cc0f08e3-8f99-41e5-9b34-d768160c92be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:05.000144 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9b162c-21a0-4fdf-afb3-eca0d142f55c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:05.001597 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9b162c-21a0-4fdf-afb3-eca0d142f55c None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:05.095344 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:05.146222 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 372/749] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 30 01:17:04 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 01:17:05.147729 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9b162c-21a0-4fdf-afb3-eca0d142f55c None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:05.203252 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 378/750] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:17:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:17:05.257586 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9b162c-21a0-4fdf-afb3-eca0d142f55c None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:05.297046 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788279e4-72f9-49e7-82b1-778a7b52f144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:05.297685 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788279e4-72f9-49e7-82b1-778a7b52f144 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:05.297965 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788279e4-72f9-49e7-82b1-778a7b52f144 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:05.298238 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788279e4-72f9-49e7-82b1-778a7b52f144 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:05.315872 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788279e4-72f9-49e7-82b1-778a7b52f144 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:05.317792 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788279e4-72f9-49e7-82b1-778a7b52f144 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:05.334521 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-788279e4-72f9-49e7-82b1-778a7b52f144 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:17:05.334521 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:05.334521 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:05.334521 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:05.334521 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:05.334521 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:05.334521 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:05.334521 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:05.334521 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:05.334521 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:05.334521 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:05.334521 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:05.334521 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:17:05.334521 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:17:05.334521 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:17:05.334521 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:17:05.335571 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:05.335571 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:05.335571 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:05.335571 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:05.335571 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:05.335571 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:05.335571 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:05.335571 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:05.335571 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:05.335571 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:05.335571 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:05.335571 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:05.335571 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:05.335571 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:05.335571 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:05.335571 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:05.335571 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:17:05.336480 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:17:05.336480 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:17:05.336480 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:05.344002 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 373/751] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:17:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:05.349651 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f08e3-8f99-41e5-9b34-d768160c92be None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:05.391768 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:05.486096 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f08e3-8f99-41e5-9b34-d768160c92be None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:05.510090 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788279e4-72f9-49e7-82b1-778a7b52f144 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:05.530150 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:05.542043 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d44887-d18f-44c5-b1af-cfeb2fa76cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:05.542575 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d44887-d18f-44c5-b1af-cfeb2fa76cf6 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:05.542853 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d44887-d18f-44c5-b1af-cfeb2fa76cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:05.543123 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d44887-d18f-44c5-b1af-cfeb2fa76cf6 None admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:05.543809 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d44887-d18f-44c5-b1af-cfeb2fa76cf6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:05.544112 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d44887-d18f-44c5-b1af-cfeb2fa76cf6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:05.545611 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d44887-d18f-44c5-b1af-cfeb2fa76cf6 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:05.567480 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 379/752] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:17:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:05.572834 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d44887-d18f-44c5-b1af-cfeb2fa76cf6 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:05.644602 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788279e4-72f9-49e7-82b1-778a7b52f144 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:05.680044 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203e7a6-0d5b-4664-90ee-8f5706a3ca38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:05.680818 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203e7a6-0d5b-4664-90ee-8f5706a3ca38 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:05.681297 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203e7a6-0d5b-4664-90ee-8f5706a3ca38 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:05.681666 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203e7a6-0d5b-4664-90ee-8f5706a3ca38 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:05.692886 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0203e7a6-0d5b-4664-90ee-8f5706a3ca38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:17:05.698632 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-0203e7a6-0d5b-4664-90ee-8f5706a3ca38 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:17:05.698632 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:05.698632 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:05.698632 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:05.698632 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:05.698632 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:05.698632 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:05.698632 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:05.698632 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:05.698632 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:05.698632 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:05.698632 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:05.698632 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:17:05.698632 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:17:05.698632 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:17:05.698632 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:17:05.699834 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:17:05.699834 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:17:05.699834 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:17:05.699834 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:17:05.699834 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:05.699834 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:05.699834 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:05.699834 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:05.699834 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:05.699834 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:05.699834 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:05.699834 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:05.699834 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:05.699834 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:05.699834 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:05.699834 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:05.700884 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:05.700884 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:05.700884 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:05.700884 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:05.700884 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:17:05.700884 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:17:05.700884 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:17:05.700884 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:17:05.700884 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:17:05.700884 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:17:05.700884 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:17:05.700884 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:05.707453 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 374/753] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 30 01:17:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:17:05.709431 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203e7a6-0d5b-4664-90ee-8f5706a3ca38 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:05.735270 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:05.749279 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d44887-d18f-44c5-b1af-cfeb2fa76cf6 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:05.807779 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:05.827642 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203e7a6-0d5b-4664-90ee-8f5706a3ca38 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:05.851417 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea31ea-9c49-48a9-a916-ad00e285f712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:05.852076 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea31ea-9c49-48a9-a916-ad00e285f712 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:05.852350 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea31ea-9c49-48a9-a916-ad00e285f712 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:05.852616 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea31ea-9c49-48a9-a916-ad00e285f712 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:05.864213 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82514aa2-3049-4499-ab81-65e06da2b07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:05.864913 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82514aa2-3049-4499-ab81-65e06da2b07e None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:05.865260 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82514aa2-3049-4499-ab81-65e06da2b07e None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:05.865718 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82514aa2-3049-4499-ab81-65e06da2b07e None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:05.866478 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82514aa2-3049-4499-ab81-65e06da2b07e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:05.866785 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82514aa2-3049-4499-ab81-65e06da2b07e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:05.868275 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82514aa2-3049-4499-ab81-65e06da2b07e None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:05.876233 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea31ea-9c49-48a9-a916-ad00e285f712 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:05.877845 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 375/754] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 30 01:17:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:05.878335 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea31ea-9c49-48a9-a916-ad00e285f712 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:05.883551 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82514aa2-3049-4499-ab81-65e06da2b07e None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:05.904623 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-d8ea31ea-9c49-48a9-a916-ad00e285f712 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:17:05.904623 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:05.904623 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:05.904623 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:05.904623 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:05.904623 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:05.904623 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:05.904623 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:05.904623 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:05.904623 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:05.904623 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:05.904623 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:05.904623 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 01:17:05.904623 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 01:17:05.904623 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 01:17:05.905601 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 01:17:05.905601 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:05.905601 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:05.905601 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:05.905601 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:05.905601 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:05.905601 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:05.905601 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:05.905601 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:05.905601 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:05.905601 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:05.905601 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:05.905601 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:05.905601 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:05.905601 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:05.905601 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:05.905601 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:05.906564 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 01:17:05.906564 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 01:17:05.906564 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 01:17:05.906564 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 01:17:05.906564 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 01:17:05.906564 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 01:17:05.906564 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:17:05.906564 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:05.906564 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 380/755] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 30 01:17:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:17:05.911532 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea31ea-9c49-48a9-a916-ad00e285f712 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:05.993025 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82514aa2-3049-4499-ab81-65e06da2b07e None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:06.039258 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213f8315-eb0f-4e25-bb5e-31d8bd657d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:06.039849 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f8315-eb0f-4e25-bb5e-31d8bd657d7c None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:06.040127 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f8315-eb0f-4e25-bb5e-31d8bd657d7c None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:06.040396 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f8315-eb0f-4e25-bb5e-31d8bd657d7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:06.065841 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213f8315-eb0f-4e25-bb5e-31d8bd657d7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:06.067315 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213f8315-eb0f-4e25-bb5e-31d8bd657d7c None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:06.071774 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:06.095171 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-213f8315-eb0f-4e25-bb5e-31d8bd657d7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:17:06.095171 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:06.095171 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:06.095171 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:06.095171 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:06.095171 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:06.095171 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:06.095171 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:06.095171 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:06.095171 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:06.095171 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:06.095171 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:06.095171 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:17:06.095171 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:17:06.095171 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:17:06.095171 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:17:06.098080 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:06.098080 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:06.098080 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:06.098080 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:06.098080 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:06.098080 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:06.098080 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:06.098080 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:06.098080 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:06.098080 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:06.098080 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:06.098080 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:06.098080 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:06.098080 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:06.098080 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:06.098080 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:06.098080 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:17:06.100828 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:17:06.100828 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:17:06.100828 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:06.100828 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 376/756] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:17:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:06.107516 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213f8315-eb0f-4e25-bb5e-31d8bd657d7c None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:06.157819 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea31ea-9c49-48a9-a916-ad00e285f712 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:06.202428 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee8c60-e332-40bd-9640-61738f72e054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:06.203426 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee8c60-e332-40bd-9640-61738f72e054 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:06.204970 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee8c60-e332-40bd-9640-61738f72e054 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:06.206173 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee8c60-e332-40bd-9640-61738f72e054 None admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:06.208971 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ee8c60-e332-40bd-9640-61738f72e054 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:06.210182 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ee8c60-e332-40bd-9640-61738f72e054 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:06.213116 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ee8c60-e332-40bd-9640-61738f72e054 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:06.234434 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 381/757] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 30 01:17:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:06.248719 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee8c60-e332-40bd-9640-61738f72e054 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:06.269611 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213f8315-eb0f-4e25-bb5e-31d8bd657d7c None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:06.288770 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:06.324267 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e42bf-427a-40bd-a82f-3b0cbdae8436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:06.324774 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e42bf-427a-40bd-a82f-3b0cbdae8436 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:06.325044 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e42bf-427a-40bd-a82f-3b0cbdae8436 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:06.325318 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e42bf-427a-40bd-a82f-3b0cbdae8436 None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:06.325958 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958e42bf-427a-40bd-a82f-3b0cbdae8436 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:06.326257 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958e42bf-427a-40bd-a82f-3b0cbdae8436 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:06.334279 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958e42bf-427a-40bd-a82f-3b0cbdae8436 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:06.350587 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 377/758] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:17:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:06.355991 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e42bf-427a-40bd-a82f-3b0cbdae8436 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:06.435847 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:06.450278 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee8c60-e332-40bd-9640-61738f72e054 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:06.502844 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e42bf-427a-40bd-a82f-3b0cbdae8436 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:06.519271 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173713e1-7c99-486b-b0f2-15ea440d6359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:06.520322 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173713e1-7c99-486b-b0f2-15ea440d6359 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:06.522757 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173713e1-7c99-486b-b0f2-15ea440d6359 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:06.523218 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173713e1-7c99-486b-b0f2-15ea440d6359 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:06.524234 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173713e1-7c99-486b-b0f2-15ea440d6359 None admin] RBAC: Adding query filter params (role.id=f6bc03b6972e420eb338ee7fd1443974, scope.project.id=b050b2dad22a4a06875072e44c8c9824, user.id=1e7de1f31ef84d529bf2c53ce0f7e38b) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:06.524721 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173713e1-7c99-486b-b0f2-15ea440d6359 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:06.526606 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173713e1-7c99-486b-b0f2-15ea440d6359 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:06.537374 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 382/759] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 30 01:17:06 2022] GET /identity/v3/role_assignments?user.id=1e7de1f31ef84d529bf2c53ce0f7e38b&scope.project.id=b050b2dad22a4a06875072e44c8c9824&role.id=f6bc03b6972e420eb338ee7fd1443974 => generated 259 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:17:06.565719 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6d028-9669-43ef-a98a-ae06ca599873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:06.567084 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6d028-9669-43ef-a98a-ae06ca599873 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:06.567586 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6d028-9669-43ef-a98a-ae06ca599873 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:06.568040 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6d028-9669-43ef-a98a-ae06ca599873 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:06.581698 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f6d028-9669-43ef-a98a-ae06ca599873 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:06.583512 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f6d028-9669-43ef-a98a-ae06ca599873 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:06.614299 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-f1f6d028-9669-43ef-a98a-ae06ca599873 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 01:17:06.614299 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:06.614299 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:06.614299 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:06.614299 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:06.614299 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:06.614299 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:06.614299 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:06.614299 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:06.614299 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:06.614299 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:06.614299 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:06.614299 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 01:17:06.614299 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 01:17:06.614299 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 01:17:06.614299 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 01:17:06.615331 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:06.615331 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:06.615331 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 01:17:06.615331 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:17:06.615331 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 01:17:06.615331 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:17:06.615331 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:06.615331 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:06.615331 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:06.615331 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:06.615331 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:06.615331 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:06.615331 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:06.615331 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:06.615331 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:06.615331 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:06.615331 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:06.615331 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:06.616850 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:06.616850 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:06.616850 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 01:17:06.616850 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 01:17:06.616850 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 01:17:06.616850 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 01:17:06.616850 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 01:17:06.616850 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 01:17:06.616850 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 01:17:06.616850 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:06.616850 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 378/760] 10.222.0.60 () {56 vars in 1093 bytes} [Tue Aug 30 01:17:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:17:06.621075 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b1232-da37-4449-813d-ad7d4e898106 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:06.621590 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b1232-da37-4449-813d-ad7d4e898106 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:06.621590 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b1232-da37-4449-813d-ad7d4e898106 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:06.623225 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 383/761] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:17:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:17:06.623513 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6d028-9669-43ef-a98a-ae06ca599873 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:06.631057 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4c34c-a18b-48f4-a1b8-1110aa3c05ce None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:06.631382 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4c34c-a18b-48f4-a1b8-1110aa3c05ce None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:06.634080 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4c34c-a18b-48f4-a1b8-1110aa3c05ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:06.676624 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-48a4c34c-a18b-48f4-a1b8-1110aa3c05ce None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:06.677856 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-48a4c34c-a18b-48f4-a1b8-1110aa3c05ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:06.773915 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6d028-9669-43ef-a98a-ae06ca599873 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:06.795337 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:06.833492 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 384/762] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:17:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:17:06.835871 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3aae57-59d3-4088-9f82-51599e732ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:06.836484 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3aae57-59d3-4088-9f82-51599e732ebe None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:06.836764 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3aae57-59d3-4088-9f82-51599e732ebe None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:06.837034 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3aae57-59d3-4088-9f82-51599e732ebe None admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:06.837771 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3aae57-59d3-4088-9f82-51599e732ebe None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:06.838070 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3aae57-59d3-4088-9f82-51599e732ebe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:06.839535 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3aae57-59d3-4088-9f82-51599e732ebe None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:06.859276 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 379/763] 10.222.0.60 () {56 vars in 1133 bytes} [Tue Aug 30 01:17:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:17:06.865099 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a4c34c-a18b-48f4-a1b8-1110aa3c05ce None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:06.879810 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:06.995242 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a4c34c-a18b-48f4-a1b8-1110aa3c05ce None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:07.037727 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003186e-326a-47f6-9b61-03fea0b03dfb None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:07.038063 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003186e-326a-47f6-9b61-03fea0b03dfb None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:07.038276 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003186e-326a-47f6-9b61-03fea0b03dfb None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:07.039772 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 380/764] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:17:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:17:07.040949 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5decedc-ec2d-4357-89bf-2c419c0c8275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:07.041548 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5decedc-ec2d-4357-89bf-2c419c0c8275 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:07.041878 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5decedc-ec2d-4357-89bf-2c419c0c8275 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:07.042152 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5decedc-ec2d-4357-89bf-2c419c0c8275 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:07.045994 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491473f4-c958-4f92-bb0c-ad5e64b1a243 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:07.046500 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491473f4-c958-4f92-bb0c-ad5e64b1a243 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:07.046976 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491473f4-c958-4f92-bb0c-ad5e64b1a243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:07.054537 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5decedc-ec2d-4357-89bf-2c419c0c8275 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:07.057251 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5decedc-ec2d-4357-89bf-2c419c0c8275 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:07.079002 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-a5decedc-ec2d-4357-89bf-2c419c0c8275 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:17:07.079002 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:07.079002 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:07.079002 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:07.079002 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:07.079002 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:07.079002 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:07.079002 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:07.079002 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:07.079002 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:07.079002 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:07.079002 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:07.079002 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:17:07.079002 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:17:07.079002 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:17:07.079002 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:17:07.080473 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:07.080473 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:07.080473 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:07.080473 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:07.080473 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:07.080473 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:07.080473 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:07.080473 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:07.080473 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:07.080473 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:07.080473 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:07.080473 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:07.080473 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:07.080473 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:07.080473 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:07.080473 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:07.080473 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:17:07.081390 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:17:07.081390 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:17:07.081390 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:07.081390 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 385/765] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:17:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:07.082337 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-491473f4-c958-4f92-bb0c-ad5e64b1a243 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:07.086065 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5decedc-ec2d-4357-89bf-2c419c0c8275 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:07.086837 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-491473f4-c958-4f92-bb0c-ad5e64b1a243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:07.161272 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:07.191262 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 381/766] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:17:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 01:17:07.192204 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491473f4-c958-4f92-bb0c-ad5e64b1a243 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:07.216073 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5decedc-ec2d-4357-89bf-2c419c0c8275 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:07.261298 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7565a9-5ab0-411e-ad29-524805734832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:07.262458 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7565a9-5ab0-411e-ad29-524805734832 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:07.263179 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7565a9-5ab0-411e-ad29-524805734832 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:07.263664 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7565a9-5ab0-411e-ad29-524805734832 None admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:07.265099 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7565a9-5ab0-411e-ad29-524805734832 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:07.265675 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7565a9-5ab0-411e-ad29-524805734832 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:07.268403 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7565a9-5ab0-411e-ad29-524805734832 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:07.285502 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 386/767] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:17:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:07.287118 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec154299-238d-4592-8cfb-919522127915 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:07.287611 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec154299-238d-4592-8cfb-919522127915 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:07.288086 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec154299-238d-4592-8cfb-919522127915 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:07.289813 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 387/768] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:17:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:17:07.290761 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec154299-238d-4592-8cfb-919522127915 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:07.319447 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:07.324513 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491473f4-c958-4f92-bb0c-ad5e64b1a243 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:07.373132 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863a88b-3aa4-4a25-8c03-662897ccc5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:07.374017 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863a88b-3aa4-4a25-8c03-662897ccc5bb None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:07.374452 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863a88b-3aa4-4a25-8c03-662897ccc5bb None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:07.374875 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863a88b-3aa4-4a25-8c03-662897ccc5bb None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:07.375642 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6863a88b-3aa4-4a25-8c03-662897ccc5bb None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:07.377216 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6863a88b-3aa4-4a25-8c03-662897ccc5bb None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:07.388156 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-6863a88b-3aa4-4a25-8c03-662897ccc5bb None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 01:17:07.388156 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:07.388156 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 01:17:07.388156 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 01:17:07.388156 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 01:17:07.388156 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 01:17:07.388156 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 01:17:07.388156 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:17:07.388156 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 01:17:07.388156 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:07.388156 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 01:17:07.388156 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:07.388156 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:07.388156 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:07.388156 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:07.388156 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:07.388156 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:07.389369 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:07.389369 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:07.389369 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:07.389369 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:07.389369 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:07.389369 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:07.389369 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 01:17:07.389369 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 01:17:07.389369 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 01:17:07.389369 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 01:17:07.389369 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:07.389369 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:07.389369 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:07.389369 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:07.389369 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:07.389369 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:07.390430 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:07.390430 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:07.390430 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:07.390430 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:07.390430 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:07.390430 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:07.390430 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:07.390430 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:07.390430 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:07.390430 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:07.390430 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 01:17:07.390430 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:17:07.390430 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 01:17:07.390430 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:07.393413 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 382/769] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Aug 30 01:17:07 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:07.394840 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b0d74-d05b-4bcf-9881-320eece2e72f None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:07.395310 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b0d74-d05b-4bcf-9881-320eece2e72f None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:07.395796 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b0d74-d05b-4bcf-9881-320eece2e72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:07.415055 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-b25b0d74-d05b-4bcf-9881-320eece2e72f None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:07.416642 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-b25b0d74-d05b-4bcf-9881-320eece2e72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:07.424100 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec154299-238d-4592-8cfb-919522127915 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:07.451381 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:07.472217 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df189c-285d-4edc-a8d8-f10803fa5103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:07.473915 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df189c-285d-4edc-a8d8-f10803fa5103 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:07.474194 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df189c-285d-4edc-a8d8-f10803fa5103 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:07.474470 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df189c-285d-4edc-a8d8-f10803fa5103 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:07.481488 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58df189c-285d-4edc-a8d8-f10803fa5103 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:07.483189 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58df189c-285d-4edc-a8d8-f10803fa5103 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:07.494351 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 383/770] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:17:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:17:07.495326 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b0d74-d05b-4bcf-9881-320eece2e72f None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:07.495588 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-58df189c-285d-4edc-a8d8-f10803fa5103 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:17:07.495588 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:07.495588 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:07.495588 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:07.495588 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:07.495588 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:07.495588 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:07.495588 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:07.495588 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:07.495588 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:07.495588 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:07.495588 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:07.495588 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 01:17:07.495588 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 01:17:07.495588 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 01:17:07.496511 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 01:17:07.496511 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:07.496511 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:07.496511 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:07.496511 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:07.496511 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:07.496511 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:07.496511 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:07.496511 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:07.496511 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:07.496511 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:07.496511 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:07.496511 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:07.496511 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:07.496511 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:07.496511 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:07.496511 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:07.497398 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 01:17:07.497398 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 01:17:07.497398 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 01:17:07.497398 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 01:17:07.497398 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 01:17:07.497398 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 01:17:07.497398 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:17:07.497398 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:07.503948 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 388/771] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 30 01:17:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:07.504942 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df189c-285d-4edc-a8d8-f10803fa5103 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:07.624524 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df189c-285d-4edc-a8d8-f10803fa5103 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:07.636821 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:07.647284 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b0d74-d05b-4bcf-9881-320eece2e72f None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:07.662135 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff91ad-cacc-4fd5-93a2-9b8754fce577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:07.663068 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff91ad-cacc-4fd5-93a2-9b8754fce577 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:07.663565 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff91ad-cacc-4fd5-93a2-9b8754fce577 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:07.664010 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff91ad-cacc-4fd5-93a2-9b8754fce577 None admin] PATH_INFO: `/v3/services/network` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:07.664755 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ff91ad-cacc-4fd5-93a2-9b8754fce577 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:07.666321 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ff91ad-cacc-4fd5-93a2-9b8754fce577 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:07.675628 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-f2ff91ad-cacc-4fd5-93a2-9b8754fce577 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 01:17:07.675628 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:07.675628 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 01:17:07.675628 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 01:17:07.675628 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 01:17:07.675628 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 01:17:07.675628 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 01:17:07.675628 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:17:07.675628 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 01:17:07.675628 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:07.675628 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 01:17:07.675628 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:07.675628 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:07.675628 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:07.675628 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:07.675628 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:07.675628 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:07.676630 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:07.676630 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:07.676630 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:07.676630 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:07.676630 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:07.676630 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:07.676630 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 01:17:07.676630 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 01:17:07.676630 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 01:17:07.676630 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 01:17:07.676630 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:07.676630 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:07.676630 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:07.676630 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:07.676630 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:07.676630 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:07.677741 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:07.677741 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:07.677741 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:07.677741 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:07.677741 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:07.677741 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:07.677741 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:07.677741 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:07.677741 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:07.677741 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:07.677741 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 01:17:07.677741 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:17:07.677741 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 01:17:07.677741 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:07.680511 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 389/772] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 30 01:17:07 2022] GET /identity/v3/services/network => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:07.681533 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff91ad-cacc-4fd5-93a2-9b8754fce577 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:07.687224 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97947fb5-0bf0-4320-89d9-ca6b64ee67b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:07.687952 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97947fb5-0bf0-4320-89d9-ca6b64ee67b3 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:07.688302 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97947fb5-0bf0-4320-89d9-ca6b64ee67b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:07.688660 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97947fb5-0bf0-4320-89d9-ca6b64ee67b3 None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:07.689372 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97947fb5-0bf0-4320-89d9-ca6b64ee67b3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:07.690279 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97947fb5-0bf0-4320-89d9-ca6b64ee67b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:07.691761 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97947fb5-0bf0-4320-89d9-ca6b64ee67b3 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:07.697198 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 384/773] 10.222.0.60 () {56 vars in 1124 bytes} [Tue Aug 30 01:17:07 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:07.698539 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97947fb5-0bf0-4320-89d9-ca6b64ee67b3 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:07.733142 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:07.790877 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff91ad-cacc-4fd5-93a2-9b8754fce577 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:07.814390 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97947fb5-0bf0-4320-89d9-ca6b64ee67b3 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:07.826186 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b4e040-b535-4647-a9db-b33d20342878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:07.826784 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4e040-b535-4647-a9db-b33d20342878 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:07.827056 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4e040-b535-4647-a9db-b33d20342878 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:07.827321 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4e040-b535-4647-a9db-b33d20342878 None admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:07.828031 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b4e040-b535-4647-a9db-b33d20342878 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:07.828326 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b4e040-b535-4647-a9db-b33d20342878 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:07.829730 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b4e040-b535-4647-a9db-b33d20342878 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:07.841853 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 390/774] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 30 01:17:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:07.847260 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b4e040-b535-4647-a9db-b33d20342878 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:07.852523 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47311b2f-5d7d-4dbd-bd6e-5bbe3e744523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:07.853182 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47311b2f-5d7d-4dbd-bd6e-5bbe3e744523 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:07.853466 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47311b2f-5d7d-4dbd-bd6e-5bbe3e744523 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:07.853790 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47311b2f-5d7d-4dbd-bd6e-5bbe3e744523 None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:07.854423 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47311b2f-5d7d-4dbd-bd6e-5bbe3e744523 None admin] RBAC: Adding query filter params (name=network) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:07.854725 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47311b2f-5d7d-4dbd-bd6e-5bbe3e744523 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:07.856305 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47311b2f-5d7d-4dbd-bd6e-5bbe3e744523 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:07.861459 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 385/775] 10.222.0.60 () {56 vars in 1112 bytes} [Tue Aug 30 01:17:07 2022] GET /identity/v3/services?name=network => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:07.862301 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47311b2f-5d7d-4dbd-bd6e-5bbe3e744523 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:07.887461 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:07.951701 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b4e040-b535-4647-a9db-b33d20342878 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:07.955235 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:07.973120 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47311b2f-5d7d-4dbd-bd6e-5bbe3e744523 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:07.989690 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376d183-9e90-4220-9cee-a2328de16f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:07.990554 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376d183-9e90-4220-9cee-a2328de16f69 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:07.991000 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376d183-9e90-4220-9cee-a2328de16f69 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:07.991275 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376d183-9e90-4220-9cee-a2328de16f69 None admin] PATH_INFO: `/v3/services` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:07.991959 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a376d183-9e90-4220-9cee-a2328de16f69 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:07.992265 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a376d183-9e90-4220-9cee-a2328de16f69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:07.993644 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a376d183-9e90-4220-9cee-a2328de16f69 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:08.003860 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 391/776] 10.222.0.60 () {56 vars in 1124 bytes} [Tue Aug 30 01:17:07 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:08.003860 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376d183-9e90-4220-9cee-a2328de16f69 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:08.017411 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d8c59e-bb9a-4e07-9474-528cda844751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:08.018110 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d8c59e-bb9a-4e07-9474-528cda844751 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:08.018312 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d8c59e-bb9a-4e07-9474-528cda844751 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:08.018569 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d8c59e-bb9a-4e07-9474-528cda844751 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:08.029345 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d8c59e-bb9a-4e07-9474-528cda844751 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:17:08.034129 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-f3d8c59e-bb9a-4e07-9474-528cda844751 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 01:17:08.034129 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:08.034129 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:08.034129 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:08.034129 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:08.034129 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:08.034129 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:08.034129 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:08.034129 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:08.034129 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:08.034129 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:08.034129 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:08.034129 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:17:08.034129 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:17:08.034129 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:17:08.034129 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:17:08.035049 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:17:08.035049 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:17:08.035049 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:17:08.035049 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:17:08.035049 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:08.035049 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:08.035049 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:08.035049 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:08.035049 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:08.035049 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:08.035049 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:08.035049 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:08.035049 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:08.035049 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:08.035049 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:08.035049 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:08.035906 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:08.035906 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:08.035906 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:08.035906 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:08.035906 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:17:08.035906 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:17:08.035906 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:17:08.035906 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:17:08.035906 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:17:08.035906 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:17:08.035906 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 01:17:08.035906 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:08.035906 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 386/777] 10.222.0.60 () {56 vars in 1102 bytes} [Tue Aug 30 01:17:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:08.036618 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d8c59e-bb9a-4e07-9474-528cda844751 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:08.113302 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376d183-9e90-4220-9cee-a2328de16f69 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:08.118552 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:08.141827 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d8c59e-bb9a-4e07-9474-528cda844751 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:08.149434 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02fd21b-0de5-4e5d-8e96-4f680d1d80cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:08.150066 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02fd21b-0de5-4e5d-8e96-4f680d1d80cf None admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:08.150339 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02fd21b-0de5-4e5d-8e96-4f680d1d80cf None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:08.150608 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02fd21b-0de5-4e5d-8e96-4f680d1d80cf None admin] PATH_INFO: `/v3/projects/b050b2dad22a4a06875072e44c8c9824/users/8889145228a24fb6bd539a11925e62f2/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:08.152514 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02fd21b-0de5-4e5d-8e96-4f680d1d80cf None admin] RBAC: Authorizing `identity:create_grant(project_id=b050b2dad22a4a06875072e44c8c9824, user_id=8889145228a24fb6bd539a11925e62f2, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:08.153958 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02fd21b-0de5-4e5d-8e96-4f680d1d80cf None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:08.167733 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 392/778] 10.222.0.60 () {58 vars in 1439 bytes} [Tue Aug 30 01:17:07 2022] PUT /identity/v3/projects/b050b2dad22a4a06875072e44c8c9824/users/8889145228a24fb6bd539a11925e62f2/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:17:08.168607 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02fd21b-0de5-4e5d-8e96-4f680d1d80cf None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:08.195188 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b807152-4117-45c8-8b10-eb4dad1ade21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:08.195920 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b807152-4117-45c8-8b10-eb4dad1ade21 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:08.196195 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b807152-4117-45c8-8b10-eb4dad1ade21 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:08.196463 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b807152-4117-45c8-8b10-eb4dad1ade21 None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:08.197311 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b807152-4117-45c8-8b10-eb4dad1ade21 None admin] RBAC: Adding query filter params (type=network) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:08.197614 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b807152-4117-45c8-8b10-eb4dad1ade21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:08.199129 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b807152-4117-45c8-8b10-eb4dad1ade21 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:08.210500 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 387/779] 10.222.0.60 () {56 vars in 1112 bytes} [Tue Aug 30 01:17:08 2022] GET /identity/v3/services?type=network => generated 350 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:08.211667 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b807152-4117-45c8-8b10-eb4dad1ade21 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:08.212526 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:08.320228 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02fd21b-0de5-4e5d-8e96-4f680d1d80cf None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:08.350867 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b807152-4117-45c8-8b10-eb4dad1ade21 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:08.380478 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b8039-c681-4e37-8d76-d2c9c8d7b400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:08.381388 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b8039-c681-4e37-8d76-d2c9c8d7b400 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:08.382048 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b8039-c681-4e37-8d76-d2c9c8d7b400 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:08.382420 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b8039-c681-4e37-8d76-d2c9c8d7b400 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:08.383762 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077b8039-c681-4e37-8d76-d2c9c8d7b400 None admin] RBAC: Adding query filter params (interface=public, service_id=54b7353f165246b2ba404890126eb54c, region_id=RegionOne) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:08.384169 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077b8039-c681-4e37-8d76-d2c9c8d7b400 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:08.386112 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077b8039-c681-4e37-8d76-d2c9c8d7b400 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:08.392782 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e81ff4-ea15-469b-a3f2-76c2d18a58ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:08.393621 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e81ff4-ea15-469b-a3f2-76c2d18a58ae None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:08.394083 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e81ff4-ea15-469b-a3f2-76c2d18a58ae None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:08.394581 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e81ff4-ea15-469b-a3f2-76c2d18a58ae None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:08.395474 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e81ff4-ea15-469b-a3f2-76c2d18a58ae None admin] RBAC: Adding query filter params (name=service) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:08.395987 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e81ff4-ea15-469b-a3f2-76c2d18a58ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:08.396163 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 393/780] 10.222.0.60 () {56 vars in 1251 bytes} [Tue Aug 30 01:17:08 2022] GET /identity/v3/endpoints?service_id=54b7353f165246b2ba404890126eb54c&interface=public®ion_id=RegionOne => generated 194 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:08.396967 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b8039-c681-4e37-8d76-d2c9c8d7b400 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:08.402257 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e81ff4-ea15-469b-a3f2-76c2d18a58ae None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:08.412756 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 388/781] 10.222.0.60 () {56 vars in 1103 bytes} [Tue Aug 30 01:17:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:08.413878 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e81ff4-ea15-469b-a3f2-76c2d18a58ae None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:08.423783 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:08.513400 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:08.523650 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b8039-c681-4e37-8d76-d2c9c8d7b400 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:08.542313 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e81ff4-ea15-469b-a3f2-76c2d18a58ae None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:08.562330 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c7e19-85d2-414a-943e-3fa95f4bccc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:08.563306 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c7e19-85d2-414a-943e-3fa95f4bccc1 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:08.563856 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c7e19-85d2-414a-943e-3fa95f4bccc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:08.564368 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c7e19-85d2-414a-943e-3fa95f4bccc1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:08.565313 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9c7e19-85d2-414a-943e-3fa95f4bccc1 None admin] RBAC: Adding query filter params (interface=public, service_id=b45a37e86bc3493d98fb14f029591bfa, region_id=RegionOne) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:08.565816 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9c7e19-85d2-414a-943e-3fa95f4bccc1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:08.567392 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9c7e19-85d2-414a-943e-3fa95f4bccc1 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:08.573276 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 394/782] 10.222.0.60 () {56 vars in 1251 bytes} [Tue Aug 30 01:17:08 2022] GET /identity/v3/endpoints?service_id=b45a37e86bc3493d98fb14f029591bfa&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:08.574416 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c7e19-85d2-414a-943e-3fa95f4bccc1 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:08.594870 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd43c5c-68a6-44fb-a887-63dd4964f35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:08.595569 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd43c5c-68a6-44fb-a887-63dd4964f35d None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:08.596347 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd43c5c-68a6-44fb-a887-63dd4964f35d None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:08.599344 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd43c5c-68a6-44fb-a887-63dd4964f35d None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:08.600004 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd43c5c-68a6-44fb-a887-63dd4964f35d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:08.601399 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd43c5c-68a6-44fb-a887-63dd4964f35d None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:08.611658 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 389/783] 10.222.0.60 () {56 vars in 1087 bytes} [Tue Aug 30 01:17:08 2022] GET /identity/v3/services => generated 772 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:08.611658 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd43c5c-68a6-44fb-a887-63dd4964f35d None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:08.714709 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:08.718486 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c7e19-85d2-414a-943e-3fa95f4bccc1 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:08.763847 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd43c5c-68a6-44fb-a887-63dd4964f35d None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:08.765643 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf74b0c-6578-472f-a3f7-8041b587f63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:08.767119 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf74b0c-6578-472f-a3f7-8041b587f63f None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:08.767410 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf74b0c-6578-472f-a3f7-8041b587f63f None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:08.767738 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf74b0c-6578-472f-a3f7-8041b587f63f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:08.780346 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf74b0c-6578-472f-a3f7-8041b587f63f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:08.782070 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf74b0c-6578-472f-a3f7-8041b587f63f None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:08.802641 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-cdf74b0c-6578-472f-a3f7-8041b587f63f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:17:08.802641 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:08.802641 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:08.802641 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:08.802641 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:08.802641 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:08.802641 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:08.802641 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:08.802641 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:08.802641 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:08.802641 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:08.802641 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:08.802641 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:17:08.802641 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:17:08.802641 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:17:08.802641 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:17:08.803696 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:08.803696 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:08.803696 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:08.803696 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:08.803696 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:08.803696 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:08.803696 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:08.803696 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:08.803696 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:08.803696 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:08.803696 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:08.803696 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:08.803696 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:08.803696 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:08.803696 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:08.803696 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:08.803696 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:17:08.804600 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:17:08.804600 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:17:08.804600 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:08.804600 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 395/784] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:17:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:08.805303 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5dd8b9-fe00-4cbc-a69e-1dc06ad52140 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:08.805303 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5dd8b9-fe00-4cbc-a69e-1dc06ad52140 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:08.805461 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5dd8b9-fe00-4cbc-a69e-1dc06ad52140 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:08.806372 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ad120-4288-42b7-a8ee-b7a03f8a3aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:08.806372 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ad120-4288-42b7-a8ee-b7a03f8a3aa3 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:08.806553 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ad120-4288-42b7-a8ee-b7a03f8a3aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:08.809082 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ad120-4288-42b7-a8ee-b7a03f8a3aa3 None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:08.809225 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 396/785] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:17:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:17:08.809333 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7ad120-4288-42b7-a8ee-b7a03f8a3aa3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:08.809581 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7ad120-4288-42b7-a8ee-b7a03f8a3aa3 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:08.810289 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5dd8b9-fe00-4cbc-a69e-1dc06ad52140 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:08.817171 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 390/786] 10.222.0.60 () {56 vars in 1087 bytes} [Tue Aug 30 01:17:08 2022] GET /identity/v3/services => generated 772 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:08.818401 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483a361-29a6-40c8-8d05-947d07287316 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:08.818684 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483a361-29a6-40c8-8d05-947d07287316 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:08.818962 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483a361-29a6-40c8-8d05-947d07287316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:08.832159 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:08.865339 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-9483a361-29a6-40c8-8d05-947d07287316 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:08.866584 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-9483a361-29a6-40c8-8d05-947d07287316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:08.966095 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5dd8b9-fe00-4cbc-a69e-1dc06ad52140 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:09.009608 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 391/787] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:17:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:17:09.016989 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead59621-29a0-4420-b49b-8effff117b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:09.017679 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead59621-29a0-4420-b49b-8effff117b8e None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:09.017962 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead59621-29a0-4420-b49b-8effff117b8e None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:09.018232 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead59621-29a0-4420-b49b-8effff117b8e None admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:09.018876 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead59621-29a0-4420-b49b-8effff117b8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:09.019173 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead59621-29a0-4420-b49b-8effff117b8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:09.020581 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead59621-29a0-4420-b49b-8effff117b8e None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:09.033211 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 397/788] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:17:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:09.038952 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9483a361-29a6-40c8-8d05-947d07287316 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:09.115913 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:09.154974 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9483a361-29a6-40c8-8d05-947d07287316 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:09.199208 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74506ca-76e9-45c2-8a28-875256b7afb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:09.200308 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74506ca-76e9-45c2-8a28-875256b7afb0 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:09.200798 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74506ca-76e9-45c2-8a28-875256b7afb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:09.201294 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74506ca-76e9-45c2-8a28-875256b7afb0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:09.215161 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74506ca-76e9-45c2-8a28-875256b7afb0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:09.217301 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74506ca-76e9-45c2-8a28-875256b7afb0 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:09.233322 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-e74506ca-76e9-45c2-8a28-875256b7afb0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 01:17:09.233322 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:09.233322 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:09.233322 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:09.233322 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:09.233322 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:09.233322 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:09.233322 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:09.233322 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:09.233322 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:09.233322 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:09.233322 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:09.233322 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 01:17:09.233322 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 01:17:09.233322 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 01:17:09.233322 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 01:17:09.234440 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:09.234440 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:09.234440 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 01:17:09.234440 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:17:09.234440 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 01:17:09.234440 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:17:09.234440 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:09.234440 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:09.234440 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:09.234440 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:09.234440 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:09.234440 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:09.234440 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:09.234440 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:09.234440 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:09.234440 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:09.234440 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:09.234440 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:09.235390 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:09.235390 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:09.235390 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 01:17:09.235390 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 01:17:09.235390 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 01:17:09.235390 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 01:17:09.235390 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 01:17:09.235390 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 01:17:09.235390 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 01:17:09.235390 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:09.238026 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 392/789] 10.222.0.60 () {56 vars in 1117 bytes} [Tue Aug 30 01:17:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:09.243603 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead59621-29a0-4420-b49b-8effff117b8e None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:09.354124 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:09.387284 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74506ca-76e9-45c2-8a28-875256b7afb0 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:09.398365 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead59621-29a0-4420-b49b-8effff117b8e None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:09.441550 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdabd0f8-4d45-444f-9b3b-67e98b0104dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:09.442405 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdabd0f8-4d45-444f-9b3b-67e98b0104dc None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:09.442848 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdabd0f8-4d45-444f-9b3b-67e98b0104dc None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:09.443283 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdabd0f8-4d45-444f-9b3b-67e98b0104dc None admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:09.444178 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdabd0f8-4d45-444f-9b3b-67e98b0104dc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:09.444904 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdabd0f8-4d45-444f-9b3b-67e98b0104dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:09.446478 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdabd0f8-4d45-444f-9b3b-67e98b0104dc None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:09.475738 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 398/790] 10.222.0.60 () {56 vars in 1149 bytes} [Tue Aug 30 01:17:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:17:09.483060 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdabd0f8-4d45-444f-9b3b-67e98b0104dc None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:09.582148 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74506ca-76e9-45c2-8a28-875256b7afb0 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:09.630911 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:09.646375 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81662b-445c-4f1e-8e28-7e6f9b9a01dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:09.647931 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81662b-445c-4f1e-8e28-7e6f9b9a01dd None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:09.648922 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81662b-445c-4f1e-8e28-7e6f9b9a01dd None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:09.649448 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81662b-445c-4f1e-8e28-7e6f9b9a01dd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:09.664018 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdabd0f8-4d45-444f-9b3b-67e98b0104dc None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:09.669039 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f81662b-445c-4f1e-8e28-7e6f9b9a01dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:17:09.674664 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-4f81662b-445c-4f1e-8e28-7e6f9b9a01dd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:17:09.674664 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:09.674664 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:09.674664 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:09.674664 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:09.674664 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:09.674664 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:09.674664 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:09.674664 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:09.674664 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:09.674664 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:09.674664 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:09.674664 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:17:09.674664 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:17:09.674664 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:17:09.674664 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:17:09.675878 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:17:09.675878 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:17:09.675878 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:17:09.675878 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:17:09.675878 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:09.675878 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:09.675878 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:09.675878 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:09.675878 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:09.675878 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:09.675878 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:09.675878 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:09.675878 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:09.675878 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:09.675878 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:09.675878 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:09.676918 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:09.676918 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:09.676918 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:09.676918 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:09.676918 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:17:09.676918 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:17:09.676918 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:17:09.676918 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:17:09.676918 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:17:09.676918 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:17:09.676918 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:17:09.676918 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:09.683321 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 393/791] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 30 01:17:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:09.693360 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81662b-445c-4f1e-8e28-7e6f9b9a01dd None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:09.703911 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:09.718806 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad0a73e-e952-4ca2-8931-7d87cd46d0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:09.720098 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0a73e-e952-4ca2-8931-7d87cd46d0a3 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:09.720582 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0a73e-e952-4ca2-8931-7d87cd46d0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:09.721652 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0a73e-e952-4ca2-8931-7d87cd46d0a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:09.741618 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad0a73e-e952-4ca2-8931-7d87cd46d0a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:09.744545 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad0a73e-e952-4ca2-8931-7d87cd46d0a3 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:09.776522 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-cad0a73e-e952-4ca2-8931-7d87cd46d0a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:17:09.776522 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:09.776522 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:09.776522 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:09.776522 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:09.776522 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:09.776522 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:09.776522 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:09.776522 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:09.776522 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:09.776522 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:09.776522 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:09.776522 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:17:09.776522 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:17:09.776522 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:17:09.776522 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:17:09.777764 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:09.777764 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:09.777764 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:09.777764 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:09.777764 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:09.777764 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:09.777764 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:09.777764 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:09.777764 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:09.777764 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:09.777764 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:09.777764 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:09.777764 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:09.777764 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:09.777764 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:09.777764 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:09.777764 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:17:09.778859 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:17:09.778859 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:17:09.778859 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:09.780565 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 399/792] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:17:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:17:09.786202 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad0a73e-e952-4ca2-8931-7d87cd46d0a3 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:09.888515 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81662b-445c-4f1e-8e28-7e6f9b9a01dd None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:09.948828 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad0a73e-e952-4ca2-8931-7d87cd46d0a3 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:09.953541 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7647e72-0af5-4ab4-9858-5daeb02f77be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:09.954156 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7647e72-0af5-4ab4-9858-5daeb02f77be None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:09.954430 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7647e72-0af5-4ab4-9858-5daeb02f77be None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:09.954697 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7647e72-0af5-4ab4-9858-5daeb02f77be None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:09.955399 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7647e72-0af5-4ab4-9858-5daeb02f77be None admin] RBAC: Adding query filter params (name=admin) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:09.955747 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7647e72-0af5-4ab4-9858-5daeb02f77be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:09.957097 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7647e72-0af5-4ab4-9858-5daeb02f77be None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:09.973451 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 394/793] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 30 01:17:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:09.979030 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7647e72-0af5-4ab4-9858-5daeb02f77be None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:10.017170 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c14e84-390e-4cb2-86d0-64fe61229483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:10.017790 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c14e84-390e-4cb2-86d0-64fe61229483 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:10.018067 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c14e84-390e-4cb2-86d0-64fe61229483 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:10.018340 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c14e84-390e-4cb2-86d0-64fe61229483 None admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:10.018978 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c14e84-390e-4cb2-86d0-64fe61229483 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:10.019275 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c14e84-390e-4cb2-86d0-64fe61229483 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:10.020669 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c14e84-390e-4cb2-86d0-64fe61229483 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:10.046712 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 400/794] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:17:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:10.055350 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c14e84-390e-4cb2-86d0-64fe61229483 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:10.069355 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:10.116378 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:10.163963 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7647e72-0af5-4ab4-9858-5daeb02f77be None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:10.218559 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c14e84-390e-4cb2-86d0-64fe61229483 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:10.220480 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7575d812-61aa-4e33-916b-09ed31cdd74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:10.221863 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7575d812-61aa-4e33-916b-09ed31cdd74c None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:10.222164 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7575d812-61aa-4e33-916b-09ed31cdd74c None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:10.222434 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7575d812-61aa-4e33-916b-09ed31cdd74c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:10.234029 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7575d812-61aa-4e33-916b-09ed31cdd74c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:10.235691 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7575d812-61aa-4e33-916b-09ed31cdd74c None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:10.251185 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-7575d812-61aa-4e33-916b-09ed31cdd74c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:17:10.251185 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:10.251185 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:10.251185 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:10.251185 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:10.251185 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:10.251185 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:10.251185 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:10.251185 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:10.251185 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:10.251185 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:10.251185 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:10.251185 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:17:10.251185 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:17:10.251185 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:17:10.251185 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:17:10.252462 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:10.252462 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:10.252462 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:10.252462 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:10.252462 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:10.252462 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:10.252462 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:10.252462 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:10.252462 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:10.252462 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:10.252462 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:10.252462 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:10.252462 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:10.252462 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:10.252462 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:10.252462 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:10.252462 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:17:10.253558 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:17:10.253558 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:17:10.253558 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:10.254240 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 395/795] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:17:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:17:10.255478 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4806fbe-89cf-47d0-b364-b358c32f059b None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:10.255954 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4806fbe-89cf-47d0-b364-b358c32f059b None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:10.256293 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4806fbe-89cf-47d0-b364-b358c32f059b None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:10.259172 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b315b-763f-4a87-a654-6f9ba159eaaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:10.260032 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b315b-763f-4a87-a654-6f9ba159eaaf None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:10.260449 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b315b-763f-4a87-a654-6f9ba159eaaf None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:10.260912 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b315b-763f-4a87-a654-6f9ba159eaaf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:10.261690 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 396/796] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:17:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:17:10.262545 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4806fbe-89cf-47d0-b364-b358c32f059b None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:10.270631 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15b315b-763f-4a87-a654-6f9ba159eaaf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:10.272357 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15b315b-763f-4a87-a654-6f9ba159eaaf None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:10.289141 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-b15b315b-763f-4a87-a654-6f9ba159eaaf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:17:10.289141 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:10.289141 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:10.289141 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:10.289141 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:10.289141 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:10.289141 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:10.289141 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:10.289141 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:10.289141 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:10.289141 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:10.289141 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:10.289141 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 01:17:10.289141 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 01:17:10.289141 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 01:17:10.290314 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 01:17:10.290314 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:10.290314 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:10.290314 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:10.290314 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:10.290314 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:10.290314 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:10.290314 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:10.290314 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:10.290314 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:10.290314 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:10.290314 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:10.290314 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:10.290314 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:10.290314 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:10.290314 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:10.290314 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:10.291509 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 01:17:10.291509 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 01:17:10.291509 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 01:17:10.291509 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 01:17:10.291509 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 01:17:10.291509 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 01:17:10.291509 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:17:10.291509 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:10.294012 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 401/797] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 30 01:17:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:10.299251 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37193f58-41fe-42fa-80e2-2bad78f093f6 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:10.299251 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37193f58-41fe-42fa-80e2-2bad78f093f6 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:10.299251 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37193f58-41fe-42fa-80e2-2bad78f093f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:10.320707 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-37193f58-41fe-42fa-80e2-2bad78f093f6 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:10.321997 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-37193f58-41fe-42fa-80e2-2bad78f093f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:10.393996 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:10.399382 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4806fbe-89cf-47d0-b364-b358c32f059b None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:10.403149 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 402/798] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:17:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:17:10.404683 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37193f58-41fe-42fa-80e2-2bad78f093f6 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:10.432972 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:10.438953 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d493b7ac-337f-46c0-8f01-dfe829c273b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:10.439960 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493b7ac-337f-46c0-8f01-dfe829c273b6 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:10.440439 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493b7ac-337f-46c0-8f01-dfe829c273b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:10.440895 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493b7ac-337f-46c0-8f01-dfe829c273b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:10.441676 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d493b7ac-337f-46c0-8f01-dfe829c273b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:10.442129 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d493b7ac-337f-46c0-8f01-dfe829c273b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:10.443848 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d493b7ac-337f-46c0-8f01-dfe829c273b6 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:10.459793 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 397/799] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:17:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:10.467477 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d493b7ac-337f-46c0-8f01-dfe829c273b6 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:10.514781 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37193f58-41fe-42fa-80e2-2bad78f093f6 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:10.551382 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a5080-3cfa-4bbf-a201-70aaaba1a310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:10.552353 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a5080-3cfa-4bbf-a201-70aaaba1a310 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:10.552853 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a5080-3cfa-4bbf-a201-70aaaba1a310 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:10.553341 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a5080-3cfa-4bbf-a201-70aaaba1a310 None admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:10.554249 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784a5080-3cfa-4bbf-a201-70aaaba1a310 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:10.554769 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784a5080-3cfa-4bbf-a201-70aaaba1a310 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:10.556426 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784a5080-3cfa-4bbf-a201-70aaaba1a310 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:10.569747 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 403/800] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 30 01:17:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:10.576581 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a5080-3cfa-4bbf-a201-70aaaba1a310 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:10.697599 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d493b7ac-337f-46c0-8f01-dfe829c273b6 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:10.707829 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:10.722736 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a5080-3cfa-4bbf-a201-70aaaba1a310 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:10.751700 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf9804-1682-4acf-aad5-c0e8a72bcdb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:10.753000 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf9804-1682-4acf-aad5-c0e8a72bcdb7 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:10.753113 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf9804-1682-4acf-aad5-c0e8a72bcdb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:10.753384 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf9804-1682-4acf-aad5-c0e8a72bcdb7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:10.761140 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a469e64d-885a-4f3b-8281-166dff04a1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:10.761331 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cf9804-1682-4acf-aad5-c0e8a72bcdb7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:10.762224 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a469e64d-885a-4f3b-8281-166dff04a1c5 None admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:10.762608 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cf9804-1682-4acf-aad5-c0e8a72bcdb7 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:10.762984 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a469e64d-885a-4f3b-8281-166dff04a1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:10.763504 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a469e64d-885a-4f3b-8281-166dff04a1c5 None admin] PATH_INFO: `/v3/projects/b050b2dad22a4a06875072e44c8c9824/users/edc11f8a9c5843939ec230e63ca7fa3b/roles/01439ffbf0dd41caadd0cc40b3176062` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:10.775476 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-60cf9804-1682-4acf-aad5-c0e8a72bcdb7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 01:17:10.775476 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:10.775476 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:10.775476 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:10.775476 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:10.775476 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:10.775476 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:10.775476 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:10.775476 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:10.775476 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:10.775476 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:10.775476 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:10.775476 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 01:17:10.775476 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 01:17:10.775476 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 01:17:10.775476 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 01:17:10.776475 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:10.776475 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:10.776475 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 01:17:10.776475 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:17:10.776475 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 01:17:10.776475 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:17:10.776475 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:10.776475 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:10.776475 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:10.776475 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:10.776475 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:10.776475 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:10.776475 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:10.776475 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:10.776475 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:10.776475 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:10.776475 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:10.776475 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:10.778034 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:10.778034 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:10.778034 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 01:17:10.778034 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 01:17:10.778034 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 01:17:10.778034 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 01:17:10.778034 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 01:17:10.778034 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 01:17:10.778034 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 01:17:10.778034 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:10.778034 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 398/801] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 30 01:17:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:10.778034 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf9804-1682-4acf-aad5-c0e8a72bcdb7 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:10.783464 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a469e64d-885a-4f3b-8281-166dff04a1c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=b050b2dad22a4a06875072e44c8c9824, user_id=edc11f8a9c5843939ec230e63ca7fa3b, role_id=01439ffbf0dd41caadd0cc40b3176062)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:10.785206 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a469e64d-885a-4f3b-8281-166dff04a1c5 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:10.799954 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:10.801121 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 404/802] 10.222.0.60 () {58 vars in 1439 bytes} [Tue Aug 30 01:17:10 2022] PUT /identity/v3/projects/b050b2dad22a4a06875072e44c8c9824/users/edc11f8a9c5843939ec230e63ca7fa3b/roles/01439ffbf0dd41caadd0cc40b3176062 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:17:10.802502 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a469e64d-885a-4f3b-8281-166dff04a1c5 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:10.935186 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf9804-1682-4acf-aad5-c0e8a72bcdb7 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:10.935757 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a469e64d-885a-4f3b-8281-166dff04a1c5 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:10.984354 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c4058-fd69-442a-baa9-f216bcffad16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:10.984569 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d5de69-52dd-4110-aebb-96669bf67cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:10.984992 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c4058-fd69-442a-baa9-f216bcffad16 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:10.985267 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c4058-fd69-442a-baa9-f216bcffad16 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:10.985385 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5de69-52dd-4110-aebb-96669bf67cc9 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:10.985542 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c4058-fd69-442a-baa9-f216bcffad16 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:10.985853 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5de69-52dd-4110-aebb-96669bf67cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:10.986301 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5de69-52dd-4110-aebb-96669bf67cc9 None admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:10.988273 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d5de69-52dd-4110-aebb-96669bf67cc9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:10.988807 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d5de69-52dd-4110-aebb-96669bf67cc9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:10.990649 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d5de69-52dd-4110-aebb-96669bf67cc9 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:10.999249 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9c4058-fd69-442a-baa9-f216bcffad16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:17:11.000208 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:11.005617 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-ce9c4058-fd69-442a-baa9-f216bcffad16 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:17:11.005617 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:11.005617 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:11.005617 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:11.005617 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:11.005617 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:11.005617 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:11.005617 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:11.005617 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:11.005617 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:11.005617 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:11.005617 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:11.005617 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:17:11.005617 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:17:11.005617 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:17:11.005617 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:17:11.006885 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:17:11.006885 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:17:11.006885 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:17:11.006885 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:17:11.006885 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:11.006885 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:11.006885 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:11.006885 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:11.006885 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:11.006885 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:11.006885 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:11.006885 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:11.006885 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:11.006885 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:11.006885 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:11.006885 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:11.007788 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:11.007788 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:11.007788 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:11.007788 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:11.007788 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:17:11.007788 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:17:11.007788 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:17:11.007788 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:17:11.007788 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:17:11.007788 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:17:11.007788 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:17:11.007788 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:11.008922 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 399/803] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 30 01:17:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:11.011465 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b136373-a2fd-4689-914e-bdc319951a4e None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:11.011465 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b136373-a2fd-4689-914e-bdc319951a4e None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:11.011465 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b136373-a2fd-4689-914e-bdc319951a4e None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:11.012292 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 400/804] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:17:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:17:11.017527 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 405/805] 10.222.0.60 () {56 vars in 1135 bytes} [Tue Aug 30 01:17:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:11.024488 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d5de69-52dd-4110-aebb-96669bf67cc9 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:11.024648 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b136373-a2fd-4689-914e-bdc319951a4e None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:11.125484 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:11.133427 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d5de69-52dd-4110-aebb-96669bf67cc9 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:11.151384 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b136373-a2fd-4689-914e-bdc319951a4e None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:11.169755 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c2d4a-279e-4a65-bcb1-d8c201217de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:11.170523 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c2d4a-279e-4a65-bcb1-d8c201217de9 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:11.170952 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c2d4a-279e-4a65-bcb1-d8c201217de9 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:11.171320 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c2d4a-279e-4a65-bcb1-d8c201217de9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:11.182848 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81c2d4a-279e-4a65-bcb1-d8c201217de9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:11.184588 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81c2d4a-279e-4a65-bcb1-d8c201217de9 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:11.190250 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5702023a-525b-411e-a3f5-3353747a74a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:11.191055 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5702023a-525b-411e-a3f5-3353747a74a5 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:11.191573 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5702023a-525b-411e-a3f5-3353747a74a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:11.192014 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5702023a-525b-411e-a3f5-3353747a74a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:11.192832 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5702023a-525b-411e-a3f5-3353747a74a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:11.193280 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5702023a-525b-411e-a3f5-3353747a74a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:11.194797 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5702023a-525b-411e-a3f5-3353747a74a5 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:11.204730 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 401/806] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 30 01:17:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:11.206198 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc52eae-ccff-49e6-93eb-20b2c8a6500c None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:11.206450 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-e81c2d4a-279e-4a65-bcb1-d8c201217de9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:17:11.206450 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:11.206450 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:11.206450 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:11.206450 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:11.206450 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:11.206450 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:11.206450 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:11.206450 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:11.206450 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:11.206450 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:11.206450 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:11.206450 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:17:11.206450 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:17:11.206450 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:17:11.206450 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:17:11.207563 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:11.207563 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:11.207563 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:11.207563 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:11.207563 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:11.207563 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:11.207563 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:11.207563 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:11.207563 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:11.207563 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:11.207563 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:11.207563 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:11.207563 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:11.207563 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:11.207563 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:11.207563 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:11.207563 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:17:11.208667 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:17:11.208667 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:17:11.208667 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:11.209235 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc52eae-ccff-49e6-93eb-20b2c8a6500c None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:11.209723 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc52eae-ccff-49e6-93eb-20b2c8a6500c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:11.214888 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 406/807] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:17:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:11.214888 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c2d4a-279e-4a65-bcb1-d8c201217de9 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:11.233101 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-8bc52eae-ccff-49e6-93eb-20b2c8a6500c None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:11.234522 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-8bc52eae-ccff-49e6-93eb-20b2c8a6500c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:11.268219 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:11.311674 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 402/808] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:17:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:17:11.312705 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc52eae-ccff-49e6-93eb-20b2c8a6500c None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:11.328316 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c2d4a-279e-4a65-bcb1-d8c201217de9 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:11.365040 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e001c5d-e058-49e7-92d2-5d0669d75f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:11.366022 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e001c5d-e058-49e7-92d2-5d0669d75f9b None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:11.366529 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e001c5d-e058-49e7-92d2-5d0669d75f9b None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:11.367007 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e001c5d-e058-49e7-92d2-5d0669d75f9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:11.378274 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e001c5d-e058-49e7-92d2-5d0669d75f9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:11.380044 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e001c5d-e058-49e7-92d2-5d0669d75f9b None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:11.395014 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-4e001c5d-e058-49e7-92d2-5d0669d75f9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:17:11.395014 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:11.395014 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:11.395014 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:11.395014 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:11.395014 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:11.395014 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:11.395014 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:11.395014 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:11.395014 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:11.395014 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:11.395014 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:11.395014 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:17:11.395014 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:17:11.395014 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:17:11.395014 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:17:11.396130 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:11.396130 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:11.396130 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:11.396130 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:11.396130 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:11.396130 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:11.396130 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:11.396130 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:11.396130 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:11.396130 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:11.396130 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:11.396130 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:11.396130 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:11.396130 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:11.396130 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:11.396130 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:11.396130 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:17:11.397025 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:17:11.397025 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:17:11.397025 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:11.399099 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 407/809] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:17:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:11.400689 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e43d7-97ad-4fc5-941c-877308b35f7d None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:11.401177 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e43d7-97ad-4fc5-941c-877308b35f7d None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:11.401679 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e43d7-97ad-4fc5-941c-877308b35f7d None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:11.403672 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 408/810] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:17:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:17:11.404625 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e43d7-97ad-4fc5-941c-877308b35f7d None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:11.429052 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:11.463941 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc52eae-ccff-49e6-93eb-20b2c8a6500c None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:11.507122 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25eba95-d54a-4ab8-b0ea-d49ecbb4b272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:11.508310 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25eba95-d54a-4ab8-b0ea-d49ecbb4b272 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:11.508739 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25eba95-d54a-4ab8-b0ea-d49ecbb4b272 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:11.509145 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25eba95-d54a-4ab8-b0ea-d49ecbb4b272 None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:11.509915 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25eba95-d54a-4ab8-b0ea-d49ecbb4b272 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:11.510315 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25eba95-d54a-4ab8-b0ea-d49ecbb4b272 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:11.512449 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25eba95-d54a-4ab8-b0ea-d49ecbb4b272 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:11.523941 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:11.529709 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 403/811] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:17:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:11.530363 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e43d7-97ad-4fc5-941c-877308b35f7d None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:11.531241 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301176e4-bf8f-4c68-b6a8-40f362222da6 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:11.531639 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301176e4-bf8f-4c68-b6a8-40f362222da6 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:11.532006 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301176e4-bf8f-4c68-b6a8-40f362222da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:11.555199 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-301176e4-bf8f-4c68-b6a8-40f362222da6 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:11.556645 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-301176e4-bf8f-4c68-b6a8-40f362222da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:11.576433 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63808766-7043-4cef-9e40-c8d19f87be2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:11.577571 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63808766-7043-4cef-9e40-c8d19f87be2d None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:11.577948 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63808766-7043-4cef-9e40-c8d19f87be2d None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:11.578311 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63808766-7043-4cef-9e40-c8d19f87be2d None admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:11.579319 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63808766-7043-4cef-9e40-c8d19f87be2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:11.579747 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63808766-7043-4cef-9e40-c8d19f87be2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:11.581382 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63808766-7043-4cef-9e40-c8d19f87be2d None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:11.607580 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 409/812] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:17:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:11.607580 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63808766-7043-4cef-9e40-c8d19f87be2d None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:11.650975 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 404/813] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:17:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:17:11.650975 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301176e4-bf8f-4c68-b6a8-40f362222da6 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:11.712685 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:11.740574 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63808766-7043-4cef-9e40-c8d19f87be2d None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:11.770905 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301176e4-bf8f-4c68-b6a8-40f362222da6 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:11.777386 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e66d945-22c4-4928-8432-61468db5d350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:11.778094 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66d945-22c4-4928-8432-61468db5d350 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:11.778456 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66d945-22c4-4928-8432-61468db5d350 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:11.778797 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66d945-22c4-4928-8432-61468db5d350 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:11.786492 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e66d945-22c4-4928-8432-61468db5d350 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:11.788305 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e66d945-22c4-4928-8432-61468db5d350 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:11.799891 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-1e66d945-22c4-4928-8432-61468db5d350 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:17:11.799891 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:11.799891 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:11.799891 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:11.799891 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:11.799891 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:11.799891 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:11.799891 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:11.799891 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:11.799891 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:11.799891 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:11.799891 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:11.799891 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 01:17:11.799891 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 01:17:11.799891 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 01:17:11.800820 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 01:17:11.800820 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:11.800820 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:11.800820 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:11.800820 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:11.800820 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:11.800820 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:11.800820 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:11.800820 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:11.800820 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:11.800820 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:11.800820 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:11.800820 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:11.800820 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:11.800820 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:11.800820 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:11.800820 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:11.801723 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 01:17:11.801723 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 01:17:11.801723 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 01:17:11.801723 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 01:17:11.801723 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 01:17:11.801723 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 01:17:11.801723 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:17:11.801723 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:11.806485 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 410/814] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 30 01:17:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:11.807680 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e66d945-22c4-4928-8432-61468db5d350 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:11.817025 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfe7ddf-b5e9-4ca3-8119-4e296c903921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:11.818309 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfe7ddf-b5e9-4ca3-8119-4e296c903921 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:11.818775 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfe7ddf-b5e9-4ca3-8119-4e296c903921 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:11.819230 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfe7ddf-b5e9-4ca3-8119-4e296c903921 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:11.820420 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfe7ddf-b5e9-4ca3-8119-4e296c903921 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:11.822589 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfe7ddf-b5e9-4ca3-8119-4e296c903921 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:11.831997 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:11.835028 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-cbfe7ddf-b5e9-4ca3-8119-4e296c903921 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 01:17:11.835028 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:11.835028 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 01:17:11.835028 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 01:17:11.835028 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 01:17:11.835028 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 01:17:11.835028 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 01:17:11.835028 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:17:11.835028 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 01:17:11.835028 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:11.835028 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 01:17:11.835028 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:11.835028 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:11.835028 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:11.835028 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:11.835028 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:11.835028 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:11.836180 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:11.836180 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:11.836180 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:11.836180 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:11.836180 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:11.836180 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:11.836180 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 01:17:11.836180 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 01:17:11.836180 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 01:17:11.836180 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 01:17:11.836180 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:11.836180 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:11.836180 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:11.836180 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:11.836180 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:11.836180 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:11.837034 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:11.837034 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:11.837034 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:11.837034 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:11.837034 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:11.837034 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:11.837034 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:11.837034 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:11.837034 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:11.837034 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:11.837034 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 01:17:11.837034 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:17:11.837034 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 01:17:11.837034 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:11.845358 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 405/815] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Aug 30 01:17:11 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:11.845358 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfe7ddf-b5e9-4ca3-8119-4e296c903921 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:11.925234 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e66d945-22c4-4928-8432-61468db5d350 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:11.953224 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfe7ddf-b5e9-4ca3-8119-4e296c903921 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:11.960589 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e555811-9b60-4627-af53-de3ff1985e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:11.961290 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e555811-9b60-4627-af53-de3ff1985e34 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:11.961632 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e555811-9b60-4627-af53-de3ff1985e34 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:11.961969 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e555811-9b60-4627-af53-de3ff1985e34 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:11.970226 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e555811-9b60-4627-af53-de3ff1985e34 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:11.972249 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e555811-9b60-4627-af53-de3ff1985e34 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:11.981372 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:11.984875 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-7e555811-9b60-4627-af53-de3ff1985e34 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 01:17:11.984875 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:11.984875 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:11.984875 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:11.984875 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:11.984875 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:11.984875 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:11.984875 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:11.984875 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:11.984875 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:11.984875 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:11.984875 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:11.984875 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 01:17:11.984875 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 01:17:11.984875 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 01:17:11.984875 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 01:17:11.985928 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:11.985928 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:11.985928 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 01:17:11.985928 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:17:11.985928 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 01:17:11.985928 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:17:11.985928 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:11.985928 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:11.985928 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:11.985928 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:11.985928 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:11.985928 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:11.985928 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:11.985928 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:11.985928 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:11.985928 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:11.985928 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:11.985928 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:11.986875 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:11.986875 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:11.986875 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 01:17:11.986875 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 01:17:11.986875 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 01:17:11.986875 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 01:17:11.986875 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 01:17:11.986875 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 01:17:11.986875 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 01:17:11.986875 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:11.986875 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 411/816] 10.222.0.60 () {56 vars in 1093 bytes} [Tue Aug 30 01:17:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:11.987607 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e555811-9b60-4627-af53-de3ff1985e34 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:11.999151 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aea262-1cb2-4e68-9675-d546a312f538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:11.999792 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aea262-1cb2-4e68-9675-d546a312f538 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:12.000072 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aea262-1cb2-4e68-9675-d546a312f538 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:12.000349 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aea262-1cb2-4e68-9675-d546a312f538 None admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:12.001045 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aea262-1cb2-4e68-9675-d546a312f538 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:12.001348 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aea262-1cb2-4e68-9675-d546a312f538 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:12.002817 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aea262-1cb2-4e68-9675-d546a312f538 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:12.021197 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 406/817] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 30 01:17:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:12.021197 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aea262-1cb2-4e68-9675-d546a312f538 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:12.093890 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:12.116579 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e555811-9b60-4627-af53-de3ff1985e34 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:12.130957 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aea262-1cb2-4e68-9675-d546a312f538 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:12.153277 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7937dff5-78ef-4dfa-ab73-8ca8f94d3421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:12.153888 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937dff5-78ef-4dfa-ab73-8ca8f94d3421 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:12.154174 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937dff5-78ef-4dfa-ab73-8ca8f94d3421 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:12.154434 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937dff5-78ef-4dfa-ab73-8ca8f94d3421 None admin] PATH_INFO: `/v3/services` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:12.155062 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7937dff5-78ef-4dfa-ab73-8ca8f94d3421 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:12.155367 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7937dff5-78ef-4dfa-ab73-8ca8f94d3421 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:12.156763 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7937dff5-78ef-4dfa-ab73-8ca8f94d3421 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:12.161333 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 412/818] 10.222.0.60 () {56 vars in 1124 bytes} [Tue Aug 30 01:17:11 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:12.162107 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7937dff5-78ef-4dfa-ab73-8ca8f94d3421 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:12.176965 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41178519-1e24-4c26-9645-8aad1f091e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:12.178071 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41178519-1e24-4c26-9645-8aad1f091e60 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:12.178541 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41178519-1e24-4c26-9645-8aad1f091e60 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:12.179038 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41178519-1e24-4c26-9645-8aad1f091e60 None admin] PATH_INFO: `/v3/services/network` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:12.180093 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41178519-1e24-4c26-9645-8aad1f091e60 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:12.181921 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41178519-1e24-4c26-9645-8aad1f091e60 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:12.192949 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-41178519-1e24-4c26-9645-8aad1f091e60 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 01:17:12.192949 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:12.192949 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 01:17:12.192949 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 01:17:12.192949 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 01:17:12.192949 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 01:17:12.192949 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 01:17:12.192949 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:17:12.192949 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 01:17:12.192949 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:12.192949 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 01:17:12.192949 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:12.192949 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:12.192949 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:12.192949 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:12.192949 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:12.192949 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:12.193997 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:12.193997 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:12.193997 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:12.193997 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:12.193997 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:12.193997 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:12.193997 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 01:17:12.193997 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 01:17:12.193997 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 01:17:12.193997 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 01:17:12.193997 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:12.193997 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:12.193997 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:12.193997 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:12.193997 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:12.193997 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:12.195206 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:12.195206 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:12.195206 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:12.195206 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:12.195206 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:12.195206 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:12.195206 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:12.195206 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:12.195206 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:12.195206 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:12.195206 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 01:17:12.195206 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:17:12.195206 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 01:17:12.195206 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:12.197783 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 407/819] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 30 01:17:12 2022] GET /identity/v3/services/network => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:12.198709 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41178519-1e24-4c26-9645-8aad1f091e60 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:12.254213 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:12.278156 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7937dff5-78ef-4dfa-ab73-8ca8f94d3421 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:12.311876 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41178519-1e24-4c26-9645-8aad1f091e60 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:12.312065 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff4fa7b-e8df-4420-8d90-4f8427be006c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:12.312586 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4fa7b-e8df-4420-8d90-4f8427be006c None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:12.312866 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4fa7b-e8df-4420-8d90-4f8427be006c None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:12.313140 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4fa7b-e8df-4420-8d90-4f8427be006c None admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:12.313867 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff4fa7b-e8df-4420-8d90-4f8427be006c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:12.314175 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff4fa7b-e8df-4420-8d90-4f8427be006c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:12.316266 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff4fa7b-e8df-4420-8d90-4f8427be006c None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:12.335188 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 413/820] 10.222.0.60 () {56 vars in 1133 bytes} [Tue Aug 30 01:17:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:12.336351 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff4fa7b-e8df-4420-8d90-4f8427be006c None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:12.339094 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:12.355571 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a0ae1-c2f0-458f-88f6-208f41eac5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:12.356173 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a0ae1-c2f0-458f-88f6-208f41eac5f2 None admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:12.356448 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a0ae1-c2f0-458f-88f6-208f41eac5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:12.356731 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a0ae1-c2f0-458f-88f6-208f41eac5f2 None admin] PATH_INFO: `/v3/projects/b050b2dad22a4a06875072e44c8c9824/users/1e7de1f31ef84d529bf2c53ce0f7e38b/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:12.358642 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5a0ae1-c2f0-458f-88f6-208f41eac5f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=b050b2dad22a4a06875072e44c8c9824, user_id=1e7de1f31ef84d529bf2c53ce0f7e38b, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:12.360188 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5a0ae1-c2f0-458f-88f6-208f41eac5f2 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:12.372961 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 408/821] 10.222.0.60 () {58 vars in 1439 bytes} [Tue Aug 30 01:17:12 2022] PUT /identity/v3/projects/b050b2dad22a4a06875072e44c8c9824/users/1e7de1f31ef84d529bf2c53ce0f7e38b/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:17:12.373972 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a0ae1-c2f0-458f-88f6-208f41eac5f2 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:12.478911 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff4fa7b-e8df-4420-8d90-4f8427be006c None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:12.495858 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a0ae1-c2f0-458f-88f6-208f41eac5f2 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:12.507956 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:12.531934 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc7108-c4ab-40bc-94c3-b7fbfa6800dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:12.532559 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc7108-c4ab-40bc-94c3-b7fbfa6800dc None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:12.532836 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc7108-c4ab-40bc-94c3-b7fbfa6800dc None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:12.533106 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc7108-c4ab-40bc-94c3-b7fbfa6800dc None admin] PATH_INFO: `/v3/services` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:12.533786 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc7108-c4ab-40bc-94c3-b7fbfa6800dc None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:12.534087 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc7108-c4ab-40bc-94c3-b7fbfa6800dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:12.535477 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc7108-c4ab-40bc-94c3-b7fbfa6800dc None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:12.543512 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 414/822] 10.222.0.60 () {56 vars in 1124 bytes} [Tue Aug 30 01:17:12 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:12.544707 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc7108-c4ab-40bc-94c3-b7fbfa6800dc None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:12.549666 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea05931-406f-4607-be79-aaaed4df0c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:12.550280 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea05931-406f-4607-be79-aaaed4df0c40 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:12.550558 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea05931-406f-4607-be79-aaaed4df0c40 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:12.550824 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea05931-406f-4607-be79-aaaed4df0c40 None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:12.551972 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea05931-406f-4607-be79-aaaed4df0c40 None admin] RBAC: Adding query filter params (name=network) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:12.551972 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea05931-406f-4607-be79-aaaed4df0c40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:12.553364 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea05931-406f-4607-be79-aaaed4df0c40 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:12.566007 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 409/823] 10.222.0.60 () {56 vars in 1112 bytes} [Tue Aug 30 01:17:12 2022] GET /identity/v3/services?name=network => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:12.566898 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea05931-406f-4607-be79-aaaed4df0c40 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:12.634579 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:12.679917 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc7108-c4ab-40bc-94c3-b7fbfa6800dc None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:12.691595 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea05931-406f-4607-be79-aaaed4df0c40 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:12.715822 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb9fb41-fd40-4183-acd9-46b3d084bb28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:12.716466 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9fb41-fd40-4183-acd9-46b3d084bb28 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:12.716743 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9fb41-fd40-4183-acd9-46b3d084bb28 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:12.717066 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9fb41-fd40-4183-acd9-46b3d084bb28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:12.740851 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e0b41-f40a-478f-a750-8c9b1b37bf72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:12.741445 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e0b41-f40a-478f-a750-8c9b1b37bf72 None admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:12.741723 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e0b41-f40a-478f-a750-8c9b1b37bf72 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:12.742149 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e0b41-f40a-478f-a750-8c9b1b37bf72 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:12.742826 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3e0b41-f40a-478f-a750-8c9b1b37bf72 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:12.744579 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3e0b41-f40a-478f-a750-8c9b1b37bf72 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:12.774441 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 410/824] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:17:12 2022] POST /identity/v3/endpoints => generated 346 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:17:12.775368 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e0b41-f40a-478f-a750-8c9b1b37bf72 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:12.811901 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:12.833939 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb9fb41-fd40-4183-acd9-46b3d084bb28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:12.835672 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb9fb41-fd40-4183-acd9-46b3d084bb28 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:12.914875 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e0b41-f40a-478f-a750-8c9b1b37bf72 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:12.962959 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c263f-9f2c-4356-a703-f2b96a70ceb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:12.963676 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c263f-9f2c-4356-a703-f2b96a70ceb1 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:12.963878 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c263f-9f2c-4356-a703-f2b96a70ceb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:12.964146 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c263f-9f2c-4356-a703-f2b96a70ceb1 None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:12.964789 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50c263f-9f2c-4356-a703-f2b96a70ceb1 None admin] RBAC: Adding query filter params (type=network) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:12.965088 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50c263f-9f2c-4356-a703-f2b96a70ceb1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:12.967711 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50c263f-9f2c-4356-a703-f2b96a70ceb1 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:12.973425 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:12.979482 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 411/825] 10.222.0.60 () {56 vars in 1112 bytes} [Tue Aug 30 01:17:12 2022] GET /identity/v3/services?type=network => generated 350 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:12.979482 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2e396-a7ac-4355-a25b-faa0896136ab None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:12.979482 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2e396-a7ac-4355-a25b-faa0896136ab None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:12.979482 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2e396-a7ac-4355-a25b-faa0896136ab None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:12.979482 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 412/826] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:17:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:17:12.983834 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c2e396-a7ac-4355-a25b-faa0896136ab None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:12.989969 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 415/827] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 30 01:17:12 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 01:17:12.991573 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d0a77-d9da-4fc3-a415-617304c3a152 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:12.992079 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d0a77-d9da-4fc3-a415-617304c3a152 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:12.992617 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d0a77-d9da-4fc3-a415-617304c3a152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:13.012944 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-a54d0a77-d9da-4fc3-a415-617304c3a152 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:13.014493 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-a54d0a77-d9da-4fc3-a415-617304c3a152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:13.091998 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 416/828] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:17:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:17:13.093247 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d0a77-d9da-4fc3-a415-617304c3a152 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:13.117086 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:13.144110 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c2e396-a7ac-4355-a25b-faa0896136ab None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:13.214265 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae169f-c0eb-4960-984a-d06ee99ef2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:13.214890 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae169f-c0eb-4960-984a-d06ee99ef2b7 None admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:13.216619 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae169f-c0eb-4960-984a-d06ee99ef2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:13.217175 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae169f-c0eb-4960-984a-d06ee99ef2b7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:13.218158 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ae169f-c0eb-4960-984a-d06ee99ef2b7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:13.219771 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ae169f-c0eb-4960-984a-d06ee99ef2b7 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:13.248475 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:13.255154 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d0a77-d9da-4fc3-a415-617304c3a152 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:13.268109 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 413/829] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:17:12 2022] POST /identity/v3/endpoints => generated 337 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:17:13.310373 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524ae48a-0586-433b-9eb4-6be549ff4692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:13.311409 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ae48a-0586-433b-9eb4-6be549ff4692 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:13.312002 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ae48a-0586-433b-9eb4-6be549ff4692 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:13.312555 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ae48a-0586-433b-9eb4-6be549ff4692 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:13.325869 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524ae48a-0586-433b-9eb4-6be549ff4692 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:13.327898 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524ae48a-0586-433b-9eb4-6be549ff4692 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:13.345452 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-524ae48a-0586-433b-9eb4-6be549ff4692 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:17:13.345452 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:13.345452 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:13.345452 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:13.345452 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:13.345452 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:13.345452 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:13.345452 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:13.345452 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:13.345452 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:13.345452 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:13.345452 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:13.345452 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:17:13.345452 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:17:13.345452 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:17:13.345452 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:17:13.346635 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:13.346635 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:13.346635 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:13.346635 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:13.346635 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:13.346635 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:13.346635 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:13.346635 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:13.346635 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:13.346635 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:13.346635 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:13.346635 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:13.346635 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:13.346635 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:13.346635 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:13.346635 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:13.346635 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:17:13.347553 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:17:13.347553 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:17:13.347553 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:13.349913 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 417/830] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:17:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:13.355516 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae169f-c0eb-4960-984a-d06ee99ef2b7 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:13.419949 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524ae48a-0586-433b-9eb4-6be549ff4692 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:13.539314 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae169f-c0eb-4960-984a-d06ee99ef2b7 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:13.546899 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524ae48a-0586-433b-9eb4-6be549ff4692 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:13.587010 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f032b75-8df3-47d2-8c6b-8fbfd2f7c614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:13.588151 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f032b75-8df3-47d2-8c6b-8fbfd2f7c614 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:13.588636 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f032b75-8df3-47d2-8c6b-8fbfd2f7c614 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:13.589107 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f032b75-8df3-47d2-8c6b-8fbfd2f7c614 None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:13.589810 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ccf7f2-abc4-4422-8576-4c30ea66f483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:13.590495 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f032b75-8df3-47d2-8c6b-8fbfd2f7c614 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:13.591101 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ccf7f2-abc4-4422-8576-4c30ea66f483 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:13.591335 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f032b75-8df3-47d2-8c6b-8fbfd2f7c614 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:13.591454 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ccf7f2-abc4-4422-8576-4c30ea66f483 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:13.591660 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ccf7f2-abc4-4422-8576-4c30ea66f483 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:13.593252 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f032b75-8df3-47d2-8c6b-8fbfd2f7c614 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:13.605760 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ccf7f2-abc4-4422-8576-4c30ea66f483 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:17:13.612895 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-50ccf7f2-abc4-4422-8576-4c30ea66f483 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 01:17:13.612895 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:13.612895 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:13.612895 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:13.612895 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:13.612895 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:13.612895 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:13.612895 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:13.612895 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:13.612895 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:13.612895 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:13.612895 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:13.612895 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:17:13.612895 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:17:13.612895 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:17:13.612895 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:17:13.614143 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:17:13.614143 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:17:13.614143 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:17:13.614143 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:17:13.614143 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:13.614143 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:13.614143 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:13.614143 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:13.614143 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:13.614143 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:13.614143 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:13.614143 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:13.614143 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:13.614143 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:13.614143 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:13.614143 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:13.615038 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:13.615038 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:13.615038 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:13.615038 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:13.615038 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:17:13.615038 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:17:13.615038 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:17:13.615038 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:17:13.615038 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:17:13.615038 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:17:13.615038 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 01:17:13.615038 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:13.617932 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 414/831] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:17:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:13.619467 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 418/832] 10.222.0.60 () {56 vars in 1102 bytes} [Tue Aug 30 01:17:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:17:13.622833 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f032b75-8df3-47d2-8c6b-8fbfd2f7c614 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:13.624307 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ccf7f2-abc4-4422-8576-4c30ea66f483 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:13.631693 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:13.632183 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:13.757751 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f032b75-8df3-47d2-8c6b-8fbfd2f7c614 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:13.760866 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ccf7f2-abc4-4422-8576-4c30ea66f483 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:13.796457 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a04deb3-3095-476c-8716-006b730f3e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:13.797010 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04deb3-3095-476c-8716-006b730f3e49 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:13.797290 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04deb3-3095-476c-8716-006b730f3e49 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:13.797563 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04deb3-3095-476c-8716-006b730f3e49 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:13.804935 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a04deb3-3095-476c-8716-006b730f3e49 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:13.805726 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae5600-4a99-44a3-b50d-cce739d3ee50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:13.806456 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a04deb3-3095-476c-8716-006b730f3e49 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:13.807445 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae5600-4a99-44a3-b50d-cce739d3ee50 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:13.808683 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae5600-4a99-44a3-b50d-cce739d3ee50 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:13.808683 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae5600-4a99-44a3-b50d-cce739d3ee50 None admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:13.809470 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ae5600-4a99-44a3-b50d-cce739d3ee50 None admin] RBAC: Adding query filter params (name=service) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:13.810366 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ae5600-4a99-44a3-b50d-cce739d3ee50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:13.811982 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ae5600-4a99-44a3-b50d-cce739d3ee50 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:13.820185 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-3a04deb3-3095-476c-8716-006b730f3e49 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:17:13.820185 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:13.820185 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:13.820185 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:13.820185 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:13.820185 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:13.820185 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:13.820185 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:13.820185 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:13.820185 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:13.820185 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:13.820185 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:13.820185 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 01:17:13.820185 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 01:17:13.820185 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 01:17:13.821254 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 01:17:13.821254 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:13.821254 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:13.821254 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:13.821254 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:13.821254 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:13.821254 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:13.821254 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:13.821254 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:13.821254 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:13.821254 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:13.821254 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:13.821254 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:13.821254 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:13.821254 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:13.821254 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:13.821254 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:13.822367 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 01:17:13.822367 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 01:17:13.822367 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 01:17:13.822367 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 01:17:13.822367 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 01:17:13.822367 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 01:17:13.822367 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:17:13.822367 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:13.828681 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 415/834] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 30 01:17:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:17:13.828816 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 419/834] 10.222.0.60 () {56 vars in 1103 bytes} [Tue Aug 30 01:17:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:13.830499 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae5600-4a99-44a3-b50d-cce739d3ee50 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:13.831473 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a04deb3-3095-476c-8716-006b730f3e49 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:13.909591 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:13.917598 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:13.949865 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae5600-4a99-44a3-b50d-cce739d3ee50 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:13.959775 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a04deb3-3095-476c-8716-006b730f3e49 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:13.988438 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c44b158-4845-4935-bb82-1f917c0767e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:13.989053 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44b158-4845-4935-bb82-1f917c0767e2 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:13.989335 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44b158-4845-4935-bb82-1f917c0767e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:13.989671 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44b158-4845-4935-bb82-1f917c0767e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:13.997138 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6044e908-3907-413d-b31d-944c74f7ab1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:13.998351 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6044e908-3907-413d-b31d-944c74f7ab1f None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:13.998833 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6044e908-3907-413d-b31d-944c74f7ab1f None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:13.999329 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6044e908-3907-413d-b31d-944c74f7ab1f None admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:14.000273 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6044e908-3907-413d-b31d-944c74f7ab1f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:14.000777 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6044e908-3907-413d-b31d-944c74f7ab1f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:14.001341 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c44b158-4845-4935-bb82-1f917c0767e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:14.002677 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6044e908-3907-413d-b31d-944c74f7ab1f None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:14.002860 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c44b158-4845-4935-bb82-1f917c0767e2 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:14.016274 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 416/835] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 30 01:17:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:14.022745 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-2c44b158-4845-4935-bb82-1f917c0767e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:17:14.022745 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:14.022745 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:14.022745 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:14.022745 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:14.022745 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:14.022745 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:14.022745 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:14.022745 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:14.022745 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:14.022745 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:14.022745 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:14.022745 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:17:14.022745 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:17:14.022745 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:17:14.022745 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:17:14.023757 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:14.023757 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:14.023757 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:14.023757 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:14.023757 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:14.023757 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:14.023757 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:14.023757 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:14.023757 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:14.023757 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:14.023757 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:14.023757 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:14.023757 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:14.023757 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:14.023757 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:14.023757 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:14.023757 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:17:14.024663 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:17:14.024663 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:17:14.024663 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:14.024832 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6044e908-3907-413d-b31d-944c74f7ab1f None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:14.026285 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 420/836] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:17:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:14.027768 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c44b158-4845-4935-bb82-1f917c0767e2 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:14.139579 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c44b158-4845-4935-bb82-1f917c0767e2 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:14.140470 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6044e908-3907-413d-b31d-944c74f7ab1f None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:14.159418 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:14.174241 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:14.180429 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cf0067-67b8-4dd8-b3f6-3db4d802696f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:14.181454 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf0067-67b8-4dd8-b3f6-3db4d802696f None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:14.181978 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf0067-67b8-4dd8-b3f6-3db4d802696f None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:14.182440 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf0067-67b8-4dd8-b3f6-3db4d802696f None admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:14.183373 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cf0067-67b8-4dd8-b3f6-3db4d802696f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:14.183909 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cf0067-67b8-4dd8-b3f6-3db4d802696f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:14.185661 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cf0067-67b8-4dd8-b3f6-3db4d802696f None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:14.186466 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea105a4-323c-4e4c-8f9c-73a0725c1274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:14.187112 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea105a4-323c-4e4c-8f9c-73a0725c1274 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:14.187395 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea105a4-323c-4e4c-8f9c-73a0725c1274 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:14.187691 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea105a4-323c-4e4c-8f9c-73a0725c1274 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:14.188428 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea105a4-323c-4e4c-8f9c-73a0725c1274 None admin] RBAC: Adding query filter params (role.id=f6bc03b6972e420eb338ee7fd1443974, scope.project.id=b050b2dad22a4a06875072e44c8c9824, user.id=8889145228a24fb6bd539a11925e62f2) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:14.188721 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea105a4-323c-4e4c-8f9c-73a0725c1274 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:14.190166 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea105a4-323c-4e4c-8f9c-73a0725c1274 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:14.201554 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 417/837] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 30 01:17:14 2022] GET /identity/v3/role_assignments?user.id=8889145228a24fb6bd539a11925e62f2&scope.project.id=b050b2dad22a4a06875072e44c8c9824&role.id=f6bc03b6972e420eb338ee7fd1443974 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:14.208091 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 421/838] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:17:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:17:14.224301 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea105a4-323c-4e4c-8f9c-73a0725c1274 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:14.339303 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea105a4-323c-4e4c-8f9c-73a0725c1274 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:14.381283 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62506d92-4023-4281-90a7-308b531e739d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:14.381911 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62506d92-4023-4281-90a7-308b531e739d None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:14.382186 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62506d92-4023-4281-90a7-308b531e739d None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:14.382448 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62506d92-4023-4281-90a7-308b531e739d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:14.391488 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62506d92-4023-4281-90a7-308b531e739d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:14.393457 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62506d92-4023-4281-90a7-308b531e739d None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:14.405471 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-62506d92-4023-4281-90a7-308b531e739d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 01:17:14.405471 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:14.405471 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:14.405471 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:14.405471 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:14.405471 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:14.405471 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:14.405471 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:14.405471 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:14.405471 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:14.405471 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:14.405471 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:14.405471 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 01:17:14.405471 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 01:17:14.405471 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 01:17:14.405471 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 01:17:14.406459 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:14.406459 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:14.406459 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 01:17:14.406459 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:17:14.406459 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 01:17:14.406459 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:17:14.406459 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:14.406459 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:14.406459 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:14.406459 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:14.406459 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:14.406459 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:14.406459 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:14.406459 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:14.406459 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:14.406459 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:14.406459 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:14.406459 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:14.408022 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:14.408022 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:14.408022 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 01:17:14.408022 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 01:17:14.408022 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 01:17:14.408022 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 01:17:14.408022 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 01:17:14.408022 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 01:17:14.408022 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 01:17:14.408022 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:14.408022 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 418/839] 10.222.0.60 () {56 vars in 1117 bytes} [Tue Aug 30 01:17:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:14.412449 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cf0067-67b8-4dd8-b3f6-3db4d802696f None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:14.468907 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3d3bc-e363-4377-af9f-80645efe791a None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:14.469238 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3d3bc-e363-4377-af9f-80645efe791a None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:14.469484 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3d3bc-e363-4377-af9f-80645efe791a None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:14.471607 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 419/840] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:17:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:17:14.476429 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1bf256-c73f-436d-b804-1875b50c2e01 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:14.476963 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1bf256-c73f-436d-b804-1875b50c2e01 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:14.477440 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1bf256-c73f-436d-b804-1875b50c2e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:14.496266 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-4e1bf256-c73f-436d-b804-1875b50c2e01 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:14.497782 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-4e1bf256-c73f-436d-b804-1875b50c2e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:14.519826 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cf0067-67b8-4dd8-b3f6-3db4d802696f None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:14.547610 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:14.556116 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a55467-de3e-4109-a0e3-53af46846315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:14.556731 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a55467-de3e-4109-a0e3-53af46846315 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:14.557004 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a55467-de3e-4109-a0e3-53af46846315 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:14.557270 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a55467-de3e-4109-a0e3-53af46846315 None admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:14.558031 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a55467-de3e-4109-a0e3-53af46846315 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:14.558287 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a55467-de3e-4109-a0e3-53af46846315 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:14.559726 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a55467-de3e-4109-a0e3-53af46846315 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:14.576629 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 420/841] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:17:14 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 01:17:14.579492 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 422/842] 10.222.0.60 () {56 vars in 1149 bytes} [Tue Aug 30 01:17:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:14.585187 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1bf256-c73f-436d-b804-1875b50c2e01 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:14.697747 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1bf256-c73f-436d-b804-1875b50c2e01 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:14.734202 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39146028-d869-4abc-88d2-1735182a301f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:14.734816 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39146028-d869-4abc-88d2-1735182a301f None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:14.735092 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39146028-d869-4abc-88d2-1735182a301f None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:14.735360 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39146028-d869-4abc-88d2-1735182a301f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:14.786043 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:14.809278 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39146028-d869-4abc-88d2-1735182a301f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:14.811148 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39146028-d869-4abc-88d2-1735182a301f None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:14.867604 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a55467-de3e-4109-a0e3-53af46846315 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:14.914164 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:14.916512 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 421/843] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 30 01:17:14 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 01:17:14.922160 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39146028-d869-4abc-88d2-1735182a301f None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:15.006656 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:15.011730 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a55467-de3e-4109-a0e3-53af46846315 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:15.031044 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39146028-d869-4abc-88d2-1735182a301f None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:15.056603 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48edbc3a-af39-4174-b92f-c13c7de513ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:15.057169 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48edbc3a-af39-4174-b92f-c13c7de513ae None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:15.057449 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48edbc3a-af39-4174-b92f-c13c7de513ae None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:15.057712 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48edbc3a-af39-4174-b92f-c13c7de513ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:15.068136 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83294f1e-901d-4135-9f17-a1907f9ad864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:15.068706 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48edbc3a-af39-4174-b92f-c13c7de513ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:17:15.068827 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83294f1e-901d-4135-9f17-a1907f9ad864 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:15.069028 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83294f1e-901d-4135-9f17-a1907f9ad864 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:15.069297 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83294f1e-901d-4135-9f17-a1907f9ad864 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:15.073534 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-48edbc3a-af39-4174-b92f-c13c7de513ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:17:15.073534 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:15.073534 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:15.073534 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:15.073534 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:15.073534 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:15.073534 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:15.073534 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:15.073534 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:15.073534 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:15.073534 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:15.073534 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:15.073534 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:17:15.073534 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:17:15.073534 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:17:15.073534 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:17:15.074515 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:17:15.074515 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:17:15.074515 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:17:15.074515 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:17:15.074515 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:15.074515 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:15.074515 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:15.074515 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:15.074515 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:15.074515 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:15.074515 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:15.074515 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:15.074515 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:15.074515 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:15.074515 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:15.074515 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:15.075380 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:15.075380 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:15.075380 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:15.075380 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:15.075380 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:17:15.075380 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:17:15.075380 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:17:15.075380 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:17:15.075380 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:17:15.075380 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:17:15.075380 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:17:15.075380 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:15.075380 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 423/844] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 30 01:17:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:15.076769 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574fc72-9629-4703-ba24-9a0cc38e0ed0 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:15.076769 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574fc72-9629-4703-ba24-9a0cc38e0ed0 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:15.076769 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574fc72-9629-4703-ba24-9a0cc38e0ed0 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:15.078518 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 424/845] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:17:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:17:15.080771 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a574fc72-9629-4703-ba24-9a0cc38e0ed0 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:15.085383 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83294f1e-901d-4135-9f17-a1907f9ad864 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:15.086859 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83294f1e-901d-4135-9f17-a1907f9ad864 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:15.103178 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-83294f1e-901d-4135-9f17-a1907f9ad864 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:17:15.103178 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:15.103178 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:15.103178 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:15.103178 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:15.103178 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:15.103178 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:15.103178 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:15.103178 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:15.103178 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:15.103178 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:15.103178 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:15.103178 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:17:15.103178 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:17:15.103178 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:17:15.103178 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:17:15.104196 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:15.104196 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:15.104196 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:15.104196 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:15.104196 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:15.104196 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:15.104196 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:15.104196 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:15.104196 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:15.104196 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:15.104196 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:15.104196 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:15.104196 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:15.104196 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:15.104196 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:15.104196 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:15.104196 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:17:15.105122 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:17:15.105122 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:17:15.105122 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:15.105122 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 422/846] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:17:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:17:15.105802 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560801c-0dd8-4a45-8b51-c5bcee8a69a8 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:15.106360 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560801c-0dd8-4a45-8b51-c5bcee8a69a8 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:15.106360 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560801c-0dd8-4a45-8b51-c5bcee8a69a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:15.124016 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-3560801c-0dd8-4a45-8b51-c5bcee8a69a8 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:15.125210 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-3560801c-0dd8-4a45-8b51-c5bcee8a69a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:15.187601 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:15.196539 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a574fc72-9629-4703-ba24-9a0cc38e0ed0 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:15.199948 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 423/847] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:17:15 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:17:15.201016 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560801c-0dd8-4a45-8b51-c5bcee8a69a8 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:15.239974 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2995ff6d-b9b4-4015-9241-dbc4ce9dbd87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:15.240586 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995ff6d-b9b4-4015-9241-dbc4ce9dbd87 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:15.240866 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995ff6d-b9b4-4015-9241-dbc4ce9dbd87 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:15.241197 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995ff6d-b9b4-4015-9241-dbc4ce9dbd87 None admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:15.242043 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2995ff6d-b9b4-4015-9241-dbc4ce9dbd87 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:15.242154 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2995ff6d-b9b4-4015-9241-dbc4ce9dbd87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:15.243549 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2995ff6d-b9b4-4015-9241-dbc4ce9dbd87 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:15.257131 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 425/848] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 30 01:17:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:17:15.257859 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2995ff6d-b9b4-4015-9241-dbc4ce9dbd87 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:15.274210 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:15.319136 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560801c-0dd8-4a45-8b51-c5bcee8a69a8 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:15.360644 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010ebb6-9933-49ac-9e86-6e233a1b35d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:15.362328 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010ebb6-9933-49ac-9e86-6e233a1b35d9 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:15.362810 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010ebb6-9933-49ac-9e86-6e233a1b35d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:15.363298 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010ebb6-9933-49ac-9e86-6e233a1b35d9 None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:15.364163 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010ebb6-9933-49ac-9e86-6e233a1b35d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:15.364792 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010ebb6-9933-49ac-9e86-6e233a1b35d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:15.366432 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010ebb6-9933-49ac-9e86-6e233a1b35d9 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:15.377011 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2995ff6d-b9b4-4015-9241-dbc4ce9dbd87 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:15.384067 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 424/849] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:17:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:15.385212 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010ebb6-9933-49ac-9e86-6e233a1b35d9 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:15.419027 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a1613-cce5-4fb9-8aa9-27246516bf53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:15.419716 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a1613-cce5-4fb9-8aa9-27246516bf53 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:15.419998 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a1613-cce5-4fb9-8aa9-27246516bf53 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:15.420267 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a1613-cce5-4fb9-8aa9-27246516bf53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:15.434487 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25a1613-cce5-4fb9-8aa9-27246516bf53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:15.435988 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25a1613-cce5-4fb9-8aa9-27246516bf53 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:15.451343 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-b25a1613-cce5-4fb9-8aa9-27246516bf53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:17:15.451343 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:15.451343 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:15.451343 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:15.451343 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:15.451343 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:15.451343 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:15.451343 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:15.451343 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:15.451343 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:15.451343 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:15.451343 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:15.451343 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:17:15.451343 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:17:15.451343 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:17:15.451343 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:17:15.452346 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:15.452346 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:15.452346 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:15.452346 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:15.452346 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:15.452346 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:15.452346 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:15.452346 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:15.452346 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:15.452346 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:15.452346 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:15.452346 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:15.452346 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:15.452346 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:15.452346 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:15.452346 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:15.452346 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:17:15.453366 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:17:15.453366 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:17:15.453366 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:15.453366 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 426/850] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:17:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:15.459192 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a1613-cce5-4fb9-8aa9-27246516bf53 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:15.476166 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:15.506859 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010ebb6-9933-49ac-9e86-6e233a1b35d9 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:15.528190 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:15.545824 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cfa3d5-fa5c-471f-b4df-25867ae8c54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:15.546467 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cfa3d5-fa5c-471f-b4df-25867ae8c54a None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:15.546750 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cfa3d5-fa5c-471f-b4df-25867ae8c54a None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:15.547023 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cfa3d5-fa5c-471f-b4df-25867ae8c54a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:15.554117 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cfa3d5-fa5c-471f-b4df-25867ae8c54a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:15.555621 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cfa3d5-fa5c-471f-b4df-25867ae8c54a None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:15.567197 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-b2cfa3d5-fa5c-471f-b4df-25867ae8c54a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:17:15.567197 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:15.567197 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:15.567197 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:15.567197 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:15.567197 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:15.567197 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:15.567197 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:15.567197 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:15.567197 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:15.567197 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:15.567197 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:15.567197 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 01:17:15.567197 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 01:17:15.567197 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 01:17:15.568280 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 01:17:15.568280 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:15.568280 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:15.568280 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:15.568280 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:15.568280 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:15.568280 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:15.568280 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:15.568280 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:15.568280 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:15.568280 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:15.568280 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:15.568280 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:15.568280 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:15.568280 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:15.568280 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:15.568280 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:15.569266 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 01:17:15.569266 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 01:17:15.569266 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 01:17:15.569266 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 01:17:15.569266 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 01:17:15.569266 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 01:17:15.569266 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:17:15.569266 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:15.569266 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 425/851] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 30 01:17:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:15.569815 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cfa3d5-fa5c-471f-b4df-25867ae8c54a None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:15.579216 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a1613-cce5-4fb9-8aa9-27246516bf53 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:15.619653 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c711652-0e1c-471a-985b-da00985cad44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:15.620270 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c711652-0e1c-471a-985b-da00985cad44 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:15.620531 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c711652-0e1c-471a-985b-da00985cad44 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:15.620802 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c711652-0e1c-471a-985b-da00985cad44 None admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:15.621615 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c711652-0e1c-471a-985b-da00985cad44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:15.621739 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c711652-0e1c-471a-985b-da00985cad44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:15.623085 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c711652-0e1c-471a-985b-da00985cad44 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:15.635163 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 427/852] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:17:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:15.635920 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c711652-0e1c-471a-985b-da00985cad44 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:15.692205 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cfa3d5-fa5c-471f-b4df-25867ae8c54a None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:15.716352 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:15.731012 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb76f5e-b2b4-477f-87d2-4bdbaf73eddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:15.731675 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb76f5e-b2b4-477f-87d2-4bdbaf73eddb None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:15.731959 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb76f5e-b2b4-477f-87d2-4bdbaf73eddb None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:15.732331 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb76f5e-b2b4-477f-87d2-4bdbaf73eddb None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:15.732814 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb76f5e-b2b4-477f-87d2-4bdbaf73eddb None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:15.734193 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb76f5e-b2b4-477f-87d2-4bdbaf73eddb None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:15.743603 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-0eb76f5e-b2b4-477f-87d2-4bdbaf73eddb None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 01:17:15.743603 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:15.743603 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 01:17:15.743603 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 01:17:15.743603 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 01:17:15.743603 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 01:17:15.743603 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 01:17:15.743603 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:17:15.743603 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 01:17:15.743603 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:15.743603 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 01:17:15.743603 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:15.743603 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:15.743603 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:15.743603 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:15.743603 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:15.743603 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:15.744806 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:15.744806 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:15.744806 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:15.744806 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:15.744806 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:15.744806 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:15.744806 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 01:17:15.744806 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 01:17:15.744806 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 01:17:15.744806 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 01:17:15.744806 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:15.744806 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:15.744806 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:15.744806 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:15.744806 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:15.744806 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:15.745655 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:15.745655 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:15.745655 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:15.745655 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:15.745655 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:15.745655 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:15.745655 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:15.745655 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:15.745655 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:15.745655 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:15.745655 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 01:17:15.745655 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:17:15.745655 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 01:17:15.745655 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:15.745655 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 426/853] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Aug 30 01:17:15 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:15.746493 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb76f5e-b2b4-477f-87d2-4bdbaf73eddb None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:15.758521 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c711652-0e1c-471a-985b-da00985cad44 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:15.798310 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:15.803182 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f785e93-9485-4732-ac8e-31a84c45936d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:15.803817 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f785e93-9485-4732-ac8e-31a84c45936d None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:15.804093 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f785e93-9485-4732-ac8e-31a84c45936d None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:15.804364 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f785e93-9485-4732-ac8e-31a84c45936d None admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:15.805058 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f785e93-9485-4732-ac8e-31a84c45936d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:15.805362 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f785e93-9485-4732-ac8e-31a84c45936d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:15.806829 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f785e93-9485-4732-ac8e-31a84c45936d None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:15.821161 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 428/854] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 30 01:17:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:15.824954 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f785e93-9485-4732-ac8e-31a84c45936d None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:15.861462 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb76f5e-b2b4-477f-87d2-4bdbaf73eddb None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:15.900042 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aca2ffa-48c7-4630-9a35-82909e990c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:15.901011 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca2ffa-48c7-4630-9a35-82909e990c3e None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:15.901504 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca2ffa-48c7-4630-9a35-82909e990c3e None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:15.901838 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca2ffa-48c7-4630-9a35-82909e990c3e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:15.909616 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aca2ffa-48c7-4630-9a35-82909e990c3e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:15.911162 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aca2ffa-48c7-4630-9a35-82909e990c3e None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:15.922669 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-0aca2ffa-48c7-4630-9a35-82909e990c3e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 01:17:15.922669 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:15.922669 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:15.922669 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:15.922669 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:15.922669 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:15.922669 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:15.922669 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:15.922669 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:15.922669 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:15.922669 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:15.922669 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:15.922669 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 01:17:15.922669 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 01:17:15.922669 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 01:17:15.922669 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 01:17:15.923967 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:15.923967 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:15.923967 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 01:17:15.923967 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:17:15.923967 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 01:17:15.923967 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:17:15.923967 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:15.923967 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:15.923967 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:15.923967 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:15.923967 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:15.923967 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:15.923967 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:15.923967 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:15.923967 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:15.923967 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:15.923967 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:15.923967 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:15.924938 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:15.924938 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:15.924938 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 01:17:15.924938 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 01:17:15.924938 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 01:17:15.924938 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 01:17:15.924938 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 01:17:15.924938 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 01:17:15.924938 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 01:17:15.924938 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:15.924938 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 427/855] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 30 01:17:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:15.924938 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aca2ffa-48c7-4630-9a35-82909e990c3e None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:15.937125 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f785e93-9485-4732-ac8e-31a84c45936d None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:15.969822 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:15.976627 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f540ba-fd46-4626-9519-f3b3d242d3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:15.977241 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f540ba-fd46-4626-9519-f3b3d242d3f5 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:15.977520 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f540ba-fd46-4626-9519-f3b3d242d3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:15.977791 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f540ba-fd46-4626-9519-f3b3d242d3f5 None admin] PATH_INFO: `/v3/services` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:15.978420 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f540ba-fd46-4626-9519-f3b3d242d3f5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:15.978718 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f540ba-fd46-4626-9519-f3b3d242d3f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:15.980104 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f540ba-fd46-4626-9519-f3b3d242d3f5 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:15.985126 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 429/856] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Aug 30 01:17:15 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:15.985953 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f540ba-fd46-4626-9519-f3b3d242d3f5 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:16.048840 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aca2ffa-48c7-4630-9a35-82909e990c3e None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:16.052020 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:16.085761 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d871e-add2-410c-b64a-2c69869e6f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:16.086367 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d871e-add2-410c-b64a-2c69869e6f46 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:16.086651 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d871e-add2-410c-b64a-2c69869e6f46 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:16.086925 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d871e-add2-410c-b64a-2c69869e6f46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:16.087872 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9d871e-add2-410c-b64a-2c69869e6f46 None admin] RBAC: Adding query filter params (role.id=01439ffbf0dd41caadd0cc40b3176062, scope.project.id=b050b2dad22a4a06875072e44c8c9824, user.id=edc11f8a9c5843939ec230e63ca7fa3b) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:16.088180 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9d871e-add2-410c-b64a-2c69869e6f46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:16.089606 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9d871e-add2-410c-b64a-2c69869e6f46 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:16.107480 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 428/857] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 30 01:17:15 2022] GET /identity/v3/role_assignments?user.id=edc11f8a9c5843939ec230e63ca7fa3b&scope.project.id=b050b2dad22a4a06875072e44c8c9824&role.id=01439ffbf0dd41caadd0cc40b3176062 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:16.107699 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f540ba-fd46-4626-9519-f3b3d242d3f5 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:16.107795 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d871e-add2-410c-b64a-2c69869e6f46 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:16.153028 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc82cc4-a773-4d32-9b39-0c37e1d92636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:16.153777 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc82cc4-a773-4d32-9b39-0c37e1d92636 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:16.154872 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc82cc4-a773-4d32-9b39-0c37e1d92636 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:16.155230 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc82cc4-a773-4d32-9b39-0c37e1d92636 None admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:16.156100 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc82cc4-a773-4d32-9b39-0c37e1d92636 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:16.156485 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc82cc4-a773-4d32-9b39-0c37e1d92636 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:16.159131 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc82cc4-a773-4d32-9b39-0c37e1d92636 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:16.184138 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 430/858] 10.222.0.60 () {56 vars in 1135 bytes} [Tue Aug 30 01:17:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:16.190353 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc82cc4-a773-4d32-9b39-0c37e1d92636 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:16.229784 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d871e-add2-410c-b64a-2c69869e6f46 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:16.250970 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:16.279919 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a25140-2922-4b5a-ae43-9095e32804ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:16.280534 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a25140-2922-4b5a-ae43-9095e32804ec None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:16.280811 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a25140-2922-4b5a-ae43-9095e32804ec None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:16.281382 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a25140-2922-4b5a-ae43-9095e32804ec None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:16.281714 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a25140-2922-4b5a-ae43-9095e32804ec None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:16.282012 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a25140-2922-4b5a-ae43-9095e32804ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:16.284243 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a25140-2922-4b5a-ae43-9095e32804ec None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:16.296366 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 429/859] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Aug 30 01:17:16 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:16.297846 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd5bf9-1805-4b2a-a375-3c88e7d1f16e None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:16.298447 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd5bf9-1805-4b2a-a375-3c88e7d1f16e None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:16.299497 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd5bf9-1805-4b2a-a375-3c88e7d1f16e None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:16.301677 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 430/860] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:17:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:17:16.307337 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b57555-877b-4ce0-87b8-3d761675f819 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:16.307684 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b57555-877b-4ce0-87b8-3d761675f819 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:16.307958 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b57555-877b-4ce0-87b8-3d761675f819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:16.316385 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc82cc4-a773-4d32-9b39-0c37e1d92636 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:16.390834 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9afd5-7540-43bf-a30f-523917b1416e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:16.391122 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9afd5-7540-43bf-a30f-523917b1416e None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:16.391374 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9afd5-7540-43bf-a30f-523917b1416e None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:16.391567 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9afd5-7540-43bf-a30f-523917b1416e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:16.451804 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-d9b57555-877b-4ce0-87b8-3d761675f819 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:16.454504 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-d9b57555-877b-4ce0-87b8-3d761675f819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:16.481551 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce9afd5-7540-43bf-a30f-523917b1416e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:16.483013 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce9afd5-7540-43bf-a30f-523917b1416e None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:16.486941 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:16.539219 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:16.541968 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 431/861] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:17:16 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 01:17:16.597181 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 431/862] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 30 01:17:16 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 01:17:16.604847 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b57555-877b-4ce0-87b8-3d761675f819 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:16.707997 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b57555-877b-4ce0-87b8-3d761675f819 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:16.744301 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e688a1b1-183c-47f2-8cab-85cf049138fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:16.744944 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688a1b1-183c-47f2-8cab-85cf049138fb None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:16.745485 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688a1b1-183c-47f2-8cab-85cf049138fb None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:16.745759 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688a1b1-183c-47f2-8cab-85cf049138fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:16.756360 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e688a1b1-183c-47f2-8cab-85cf049138fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:16.757832 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e688a1b1-183c-47f2-8cab-85cf049138fb None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:16.773496 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-e688a1b1-183c-47f2-8cab-85cf049138fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:17:16.773496 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:16.773496 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:16.773496 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:16.773496 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:16.773496 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:16.773496 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:16.773496 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:16.773496 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:16.773496 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:16.773496 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:16.773496 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:16.773496 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:17:16.773496 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:17:16.773496 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:17:16.773496 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:17:16.774459 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:16.774459 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:16.774459 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:16.774459 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:16.774459 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:16.774459 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:16.774459 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:16.774459 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:16.774459 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:16.774459 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:16.774459 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:16.774459 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:16.774459 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:16.774459 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:16.774459 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:16.774459 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:16.774459 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:17:16.775339 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:17:16.775339 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:17:16.775339 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:16.779240 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 432/863] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:17:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:16.780712 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9afd5-7540-43bf-a30f-523917b1416e None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:16.836669 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e688a1b1-183c-47f2-8cab-85cf049138fb None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:16.854642 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:16.894607 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9afd5-7540-43bf-a30f-523917b1416e None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:16.934607 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d42636b-a3ad-484a-9a16-0f064fbca183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:16.935223 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42636b-a3ad-484a-9a16-0f064fbca183 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:16.935544 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42636b-a3ad-484a-9a16-0f064fbca183 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:16.935820 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42636b-a3ad-484a-9a16-0f064fbca183 None admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:16.936466 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d42636b-a3ad-484a-9a16-0f064fbca183 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:16.936771 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d42636b-a3ad-484a-9a16-0f064fbca183 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:16.938883 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d42636b-a3ad-484a-9a16-0f064fbca183 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:16.951641 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e688a1b1-183c-47f2-8cab-85cf049138fb None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:16.953608 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 432/864] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:17:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:16.960486 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d42636b-a3ad-484a-9a16-0f064fbca183 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:16.977660 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:16.990205 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d801e3-cb13-4f78-b14e-bfaa9be39aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:16.990845 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d801e3-cb13-4f78-b14e-bfaa9be39aed None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:16.991345 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d801e3-cb13-4f78-b14e-bfaa9be39aed None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:16.991489 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d801e3-cb13-4f78-b14e-bfaa9be39aed None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:16.992018 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d801e3-cb13-4f78-b14e-bfaa9be39aed None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:16.993401 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d801e3-cb13-4f78-b14e-bfaa9be39aed None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:17.003058 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-29d801e3-cb13-4f78-b14e-bfaa9be39aed None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 01:17:17.003058 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:17.003058 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 01:17:17.003058 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 01:17:17.003058 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 01:17:17.003058 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 01:17:17.003058 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 01:17:17.003058 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:17:17.003058 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 01:17:17.003058 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:17.003058 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 01:17:17.003058 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:17.003058 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:17.003058 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:17.003058 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:17.003058 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:17.004049 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:17.004049 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:17.004049 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:17.004049 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:17.004049 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:17.004049 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:17.004049 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:17.004049 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 01:17:17.004049 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 01:17:17.004049 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 01:17:17.004049 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 01:17:17.004049 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:17.004049 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:17.004049 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:17.004049 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:17.004049 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:17.004049 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:17.005248 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:17.005248 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:17.005248 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:17.005248 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:17.005248 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:17.005248 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:17.005248 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:17.005248 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:17.005248 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:17.005248 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:17.005248 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 01:17:17.005248 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:17:17.005248 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 01:17:17.005248 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:17.005248 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 433/865] 10.222.0.60 () {56 vars in 1132 bytes} [Tue Aug 30 01:17:16 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:17.010417 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d801e3-cb13-4f78-b14e-bfaa9be39aed None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:17.076387 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d42636b-a3ad-484a-9a16-0f064fbca183 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:17.096386 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:17.115610 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1178fc24-cf9b-4377-98bc-750fdbc9d0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:17.116443 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178fc24-cf9b-4377-98bc-750fdbc9d0a1 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:17.117013 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178fc24-cf9b-4377-98bc-750fdbc9d0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:17.117428 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178fc24-cf9b-4377-98bc-750fdbc9d0a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:17.120769 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d801e3-cb13-4f78-b14e-bfaa9be39aed None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:17.124816 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1178fc24-cf9b-4377-98bc-750fdbc9d0a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:17.126248 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1178fc24-cf9b-4377-98bc-750fdbc9d0a1 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:17.144229 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-1178fc24-cf9b-4377-98bc-750fdbc9d0a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:17:17.144229 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:17.144229 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:17.144229 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:17.144229 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:17.144229 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:17.144229 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:17.144229 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:17.144229 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:17.144229 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:17.144229 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:17.144229 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:17.144229 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 01:17:17.144229 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 01:17:17.144229 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 01:17:17.145200 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 01:17:17.145200 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:17.145200 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:17.145200 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:17.145200 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:17.145200 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:17.145200 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:17.145200 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:17.145200 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:17.145200 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:17.145200 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:17.145200 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:17.145200 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:17.145200 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:17.145200 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:17.145200 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:17.145200 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:17.146131 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 01:17:17.146131 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 01:17:17.146131 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 01:17:17.146131 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 01:17:17.146131 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 01:17:17.146131 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 01:17:17.146131 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:17:17.146131 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:17.150265 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 433/866] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 30 01:17:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:17.151687 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1178fc24-cf9b-4377-98bc-750fdbc9d0a1 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:17.167010 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0515447-ece6-4234-9259-3d8cc8e10b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:17.168027 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0515447-ece6-4234-9259-3d8cc8e10b15 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:17.168568 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0515447-ece6-4234-9259-3d8cc8e10b15 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:17.168934 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0515447-ece6-4234-9259-3d8cc8e10b15 None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:17.170031 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0515447-ece6-4234-9259-3d8cc8e10b15 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:17.170452 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0515447-ece6-4234-9259-3d8cc8e10b15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:17.172323 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0515447-ece6-4234-9259-3d8cc8e10b15 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:17.178500 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 434/867] 10.222.0.60 () {56 vars in 1126 bytes} [Tue Aug 30 01:17:17 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:17.183684 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0515447-ece6-4234-9259-3d8cc8e10b15 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:17.241950 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:17.280268 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1178fc24-cf9b-4377-98bc-750fdbc9d0a1 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:17.306246 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0515447-ece6-4234-9259-3d8cc8e10b15 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:17.320570 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3774e4db-4b89-4267-ac2a-b3efef9f5f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:17.321191 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774e4db-4b89-4267-ac2a-b3efef9f5f0b None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:17.321470 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774e4db-4b89-4267-ac2a-b3efef9f5f0b None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:17.321736 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774e4db-4b89-4267-ac2a-b3efef9f5f0b None admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:17.322425 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3774e4db-4b89-4267-ac2a-b3efef9f5f0b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:17.322726 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3774e4db-4b89-4267-ac2a-b3efef9f5f0b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:17.324249 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3774e4db-4b89-4267-ac2a-b3efef9f5f0b None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:17.338010 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 434/868] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 30 01:17:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:17.344511 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3774e4db-4b89-4267-ac2a-b3efef9f5f0b None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:17.355001 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e9dcd6-4c98-4cc1-ae79-57256b77a746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:17.355635 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e9dcd6-4c98-4cc1-ae79-57256b77a746 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:17.355912 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e9dcd6-4c98-4cc1-ae79-57256b77a746 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:17.356184 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e9dcd6-4c98-4cc1-ae79-57256b77a746 None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:17.357264 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e9dcd6-4c98-4cc1-ae79-57256b77a746 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:17.357572 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e9dcd6-4c98-4cc1-ae79-57256b77a746 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:17.359417 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e9dcd6-4c98-4cc1-ae79-57256b77a746 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:17.367257 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 435/869] 10.222.0.60 () {56 vars in 1126 bytes} [Tue Aug 30 01:17:17 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:17:17.472624 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3774e4db-4b89-4267-ac2a-b3efef9f5f0b None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:17.506611 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:17.513707 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d4e16d-516c-4c46-afed-09b7a80e7906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:17.514505 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d4e16d-516c-4c46-afed-09b7a80e7906 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:17.514934 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d4e16d-516c-4c46-afed-09b7a80e7906 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:17.515386 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d4e16d-516c-4c46-afed-09b7a80e7906 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:17.516293 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d4e16d-516c-4c46-afed-09b7a80e7906 None admin] RBAC: Adding query filter params (role.id=f6bc03b6972e420eb338ee7fd1443974, scope.project.id=b050b2dad22a4a06875072e44c8c9824, user.id=1e7de1f31ef84d529bf2c53ce0f7e38b) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:17.516749 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d4e16d-516c-4c46-afed-09b7a80e7906 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:17.518425 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d4e16d-516c-4c46-afed-09b7a80e7906 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:17.527897 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 435/870] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 30 01:17:17 2022] GET /identity/v3/role_assignments?user.id=1e7de1f31ef84d529bf2c53ce0f7e38b&scope.project.id=b050b2dad22a4a06875072e44c8c9824&role.id=f6bc03b6972e420eb338ee7fd1443974 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:18.256887 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cadede-4f2b-4bec-9c4f-25fbca3fb530 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:18.257422 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cadede-4f2b-4bec-9c4f-25fbca3fb530 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:18.257705 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cadede-4f2b-4bec-9c4f-25fbca3fb530 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:18.259412 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 436/871] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:17:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:17:18.264668 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536294a-359e-42b4-b383-695f1c4f275b None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:18.265096 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536294a-359e-42b4-b383-695f1c4f275b None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:18.265275 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536294a-359e-42b4-b383-695f1c4f275b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:18.283998 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-2536294a-359e-42b4-b383-695f1c4f275b None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:18.285163 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-2536294a-359e-42b4-b383-695f1c4f275b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:18.292728 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd34cd5-4ab4-49b8-a132-bc195befb5aa None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:18.293011 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd34cd5-4ab4-49b8-a132-bc195befb5aa None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:18.293284 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd34cd5-4ab4-49b8-a132-bc195befb5aa None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:18.294853 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 437/872] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:17:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:17:18.299633 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06688f90-f5ca-4442-aec8-f61f9b2050aa None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:18.299916 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06688f90-f5ca-4442-aec8-f61f9b2050aa None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:18.300191 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06688f90-f5ca-4442-aec8-f61f9b2050aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:18.313525 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:18.319803 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-06688f90-f5ca-4442-aec8-f61f9b2050aa None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:18.321094 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-06688f90-f5ca-4442-aec8-f61f9b2050aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:18.367545 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 436/873] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:17:18 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:17:18.405927 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 438/874] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:17:18 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 01:17:18.636445 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2536294a-359e-42b4-b383-695f1c4f275b None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:18.686069 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06688f90-f5ca-4442-aec8-f61f9b2050aa None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:18.747937 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2536294a-359e-42b4-b383-695f1c4f275b None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:18.781830 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:18.793628 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efea5a0-692a-4da8-9d35-df2a989aad2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:18.794264 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efea5a0-692a-4da8-9d35-df2a989aad2d None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:18.794544 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efea5a0-692a-4da8-9d35-df2a989aad2d None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:18.794834 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efea5a0-692a-4da8-9d35-df2a989aad2d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:18.809600 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efea5a0-692a-4da8-9d35-df2a989aad2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:17:18.816977 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-2efea5a0-692a-4da8-9d35-df2a989aad2d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 01:17:18.816977 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:18.816977 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:18.816977 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:18.816977 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:18.816977 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:18.816977 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:18.816977 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:18.816977 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:18.816977 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:18.816977 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:18.816977 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:18.816977 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:17:18.816977 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:17:18.816977 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:17:18.816977 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:17:18.818104 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:17:18.818104 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:17:18.818104 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:17:18.818104 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:17:18.818104 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:18.818104 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:18.818104 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:18.818104 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:18.818104 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:18.818104 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:18.818104 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:18.818104 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:18.818104 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:18.818104 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:18.818104 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:18.818104 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:18.819418 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:18.819418 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:18.819418 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:18.819418 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:18.819418 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:17:18.819418 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:17:18.819418 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:17:18.819418 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:17:18.819418 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:17:18.819418 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:17:18.819418 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 01:17:18.819418 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:18.819418 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 437/875] 10.222.0.60 () {56 vars in 1120 bytes} [Tue Aug 30 01:17:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:18.822038 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06688f90-f5ca-4442-aec8-f61f9b2050aa None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:18.824001 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efea5a0-692a-4da8-9d35-df2a989aad2d None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:18.874457 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ec2876-2bc8-4785-bade-0deff0d54173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:18.875871 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec2876-2bc8-4785-bade-0deff0d54173 None admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:18.876547 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec2876-2bc8-4785-bade-0deff0d54173 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:18.877010 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec2876-2bc8-4785-bade-0deff0d54173 None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:18.878092 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ec2876-2bc8-4785-bade-0deff0d54173 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:18.880081 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ec2876-2bc8-4785-bade-0deff0d54173 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:18.886427 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:18.904092 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 439/876] 10.222.0.60 () {60 vars in 1141 bytes} [Tue Aug 30 01:17:18 2022] POST /identity/v3/services => generated 251 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:17:18.943236 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efea5a0-692a-4da8-9d35-df2a989aad2d None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:18.994062 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce62b6d-08b0-45bf-882c-48e91b0e472d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:18.994983 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce62b6d-08b0-45bf-882c-48e91b0e472d None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:18.995425 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce62b6d-08b0-45bf-882c-48e91b0e472d None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:18.995927 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce62b6d-08b0-45bf-882c-48e91b0e472d None admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:18.996754 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce62b6d-08b0-45bf-882c-48e91b0e472d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:18.997265 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce62b6d-08b0-45bf-882c-48e91b0e472d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:18.998885 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce62b6d-08b0-45bf-882c-48e91b0e472d None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:19.009553 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 438/877] 10.222.0.60 () {56 vars in 1115 bytes} [Tue Aug 30 01:17:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:17:19.020609 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ec2876-2bc8-4785-bade-0deff0d54173 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:19.132299 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ec2876-2bc8-4785-bade-0deff0d54173 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:19.168340 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e1408f-dd2e-40ee-922d-2b0f3ab5d2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:19.168990 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1408f-dd2e-40ee-922d-2b0f3ab5d2b6 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:19.169268 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1408f-dd2e-40ee-922d-2b0f3ab5d2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:19.169543 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1408f-dd2e-40ee-922d-2b0f3ab5d2b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:19.181675 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e1408f-dd2e-40ee-922d-2b0f3ab5d2b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:19.183146 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e1408f-dd2e-40ee-922d-2b0f3ab5d2b6 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:19.198404 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-b4e1408f-dd2e-40ee-922d-2b0f3ab5d2b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:17:19.198404 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:19.198404 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:19.198404 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:19.198404 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:19.198404 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:19.198404 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:19.198404 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:19.198404 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:19.198404 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:19.198404 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:19.198404 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:19.198404 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:17:19.198404 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:17:19.198404 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:17:19.198404 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:17:19.199357 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:19.199357 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:19.199357 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:19.199357 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:19.199357 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:19.199357 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:19.199357 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:19.199357 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:19.199357 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:19.199357 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:19.199357 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:19.199357 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:19.199357 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:19.199357 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:19.199357 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:19.199357 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:19.199357 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:17:19.200280 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:17:19.200280 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:17:19.200280 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:19.200280 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 440/878] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:17:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:19.207229 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce62b6d-08b0-45bf-882c-48e91b0e472d None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:19.255325 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:19.317858 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce62b6d-08b0-45bf-882c-48e91b0e472d None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:19.354684 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b03b5e-e4b0-4376-8c06-31d99fe47078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:19.355307 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b03b5e-e4b0-4376-8c06-31d99fe47078 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:19.355627 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b03b5e-e4b0-4376-8c06-31d99fe47078 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:19.355903 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b03b5e-e4b0-4376-8c06-31d99fe47078 None admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:19.356553 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b03b5e-e4b0-4376-8c06-31d99fe47078 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:19.356856 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b03b5e-e4b0-4376-8c06-31d99fe47078 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:19.358224 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b03b5e-e4b0-4376-8c06-31d99fe47078 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:19.371362 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 439/879] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:17:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:19.376954 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e1408f-dd2e-40ee-922d-2b0f3ab5d2b6 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:19.435880 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:19.451332 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87691373-08d5-437b-9389-af412d31f64c None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:19.451672 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87691373-08d5-437b-9389-af412d31f64c None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:19.451923 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87691373-08d5-437b-9389-af412d31f64c None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:19.453494 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 440/880] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:17:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:17:19.459259 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b28364-10c2-41fa-957a-cf1a6a3f8060 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:19.459575 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b28364-10c2-41fa-957a-cf1a6a3f8060 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:19.459846 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b28364-10c2-41fa-957a-cf1a6a3f8060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:19.479617 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-d6b28364-10c2-41fa-957a-cf1a6a3f8060 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:19.480797 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-d6b28364-10c2-41fa-957a-cf1a6a3f8060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:19.501369 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e1408f-dd2e-40ee-922d-2b0f3ab5d2b6 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:19.544159 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ababbc21-8e30-4b54-aef7-ccecc4149592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:19.544784 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ababbc21-8e30-4b54-aef7-ccecc4149592 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:19.545058 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ababbc21-8e30-4b54-aef7-ccecc4149592 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:19.545405 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ababbc21-8e30-4b54-aef7-ccecc4149592 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:19.550819 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 441/881] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:17:19 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 01:17:19.551909 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556d4ff-cea7-4024-ab62-e9c9ec80a9f1 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:19.552339 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556d4ff-cea7-4024-ab62-e9c9ec80a9f1 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:19.552726 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556d4ff-cea7-4024-ab62-e9c9ec80a9f1 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:19.554997 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ababbc21-8e30-4b54-aef7-ccecc4149592 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:19.556896 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ababbc21-8e30-4b54-aef7-ccecc4149592 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:19.559643 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 442/882] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:17:19 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:17:19.561069 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdddc3ae-ba7e-4ebe-9408-d213033b8f55 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:19.561187 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdddc3ae-ba7e-4ebe-9408-d213033b8f55 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:19.561428 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdddc3ae-ba7e-4ebe-9408-d213033b8f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:19.573280 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-ababbc21-8e30-4b54-aef7-ccecc4149592 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 01:17:19.573280 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:19.573280 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:19.573280 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:19.573280 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:19.573280 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:19.573280 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:19.573280 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:19.573280 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:19.573280 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:19.573280 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:19.573280 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:19.573280 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 01:17:19.573280 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 01:17:19.573280 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 01:17:19.573280 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 01:17:19.574301 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:19.574301 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:19.574301 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 01:17:19.574301 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:17:19.574301 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 01:17:19.574301 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:17:19.574301 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:19.574301 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:19.574301 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:19.574301 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:19.574301 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:19.574301 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:19.574301 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:19.574301 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:19.574301 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:19.574301 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:19.574301 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:19.574301 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:19.575368 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:19.575368 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:19.575368 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 01:17:19.575368 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 01:17:19.575368 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 01:17:19.575368 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 01:17:19.575368 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 01:17:19.575368 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 01:17:19.575368 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 01:17:19.575368 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:19.576979 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 441/883] 10.222.0.60 () {56 vars in 1117 bytes} [Tue Aug 30 01:17:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:19.582758 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ababbc21-8e30-4b54-aef7-ccecc4149592 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:19.584639 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-fdddc3ae-ba7e-4ebe-9408-d213033b8f55 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:19.585815 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-fdddc3ae-ba7e-4ebe-9408-d213033b8f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:19.627933 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:19.683572 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 443/884] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:17:19 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:17:19.707852 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ababbc21-8e30-4b54-aef7-ccecc4149592 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:19.717411 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:19.744424 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c78e7b-b798-4bab-90de-108b8e0830da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:19.746547 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c78e7b-b798-4bab-90de-108b8e0830da None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:19.747036 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c78e7b-b798-4bab-90de-108b8e0830da None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:19.748035 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c78e7b-b798-4bab-90de-108b8e0830da None admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:19.749106 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c78e7b-b798-4bab-90de-108b8e0830da None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:19.749672 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c78e7b-b798-4bab-90de-108b8e0830da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:19.753214 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c78e7b-b798-4bab-90de-108b8e0830da None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:19.781888 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 442/885] 10.222.0.60 () {56 vars in 1149 bytes} [Tue Aug 30 01:17:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:17:19.787976 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdddc3ae-ba7e-4ebe-9408-d213033b8f55 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:19.842495 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c78e7b-b798-4bab-90de-108b8e0830da None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:19.911291 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdddc3ae-ba7e-4ebe-9408-d213033b8f55 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:19.950180 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714f0d2c-edf8-4484-b73a-ac1e1c81e443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:19.951056 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f0d2c-edf8-4484-b73a-ac1e1c81e443 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:19.951339 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f0d2c-edf8-4484-b73a-ac1e1c81e443 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:19.951643 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f0d2c-edf8-4484-b73a-ac1e1c81e443 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:19.962796 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c78e7b-b798-4bab-90de-108b8e0830da None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:19.988336 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:20.005441 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848efd7-211b-4d9d-b4d4-6d045e3bac9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:20.006057 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848efd7-211b-4d9d-b4d4-6d045e3bac9e None admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:20.006339 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848efd7-211b-4d9d-b4d4-6d045e3bac9e None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:20.006609 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848efd7-211b-4d9d-b4d4-6d045e3bac9e None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:20.007265 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6848efd7-211b-4d9d-b4d4-6d045e3bac9e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:20.008894 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6848efd7-211b-4d9d-b4d4-6d045e3bac9e None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:20.025259 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 443/886] 10.222.0.60 () {60 vars in 1141 bytes} [Tue Aug 30 01:17:19 2022] POST /identity/v3/services => generated 269 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:17:20.028711 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714f0d2c-edf8-4484-b73a-ac1e1c81e443 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:20.028867 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848efd7-211b-4d9d-b4d4-6d045e3bac9e None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:20.029094 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714f0d2c-edf8-4484-b73a-ac1e1c81e443 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:20.063862 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:20.149626 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 444/887] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 30 01:17:19 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 01:17:20.155029 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714f0d2c-edf8-4484-b73a-ac1e1c81e443 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:20.161533 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848efd7-211b-4d9d-b4d4-6d045e3bac9e None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:20.204308 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba04c4a-bb2c-4e6d-af75-bf0fb431b324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:20.205674 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba04c4a-bb2c-4e6d-af75-bf0fb431b324 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:20.205674 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba04c4a-bb2c-4e6d-af75-bf0fb431b324 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:20.205674 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba04c4a-bb2c-4e6d-af75-bf0fb431b324 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:20.206464 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba04c4a-bb2c-4e6d-af75-bf0fb431b324 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:20.207977 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba04c4a-bb2c-4e6d-af75-bf0fb431b324 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:20.217477 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-eba04c4a-bb2c-4e6d-af75-bf0fb431b324 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 01:17:20.217477 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:20.217477 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 01:17:20.217477 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 01:17:20.217477 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 01:17:20.217477 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 01:17:20.217477 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 01:17:20.217477 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:17:20.217477 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 01:17:20.217477 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:20.217477 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 01:17:20.217477 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:20.217477 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:20.217477 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:20.217477 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:20.217477 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:20.217477 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:20.218701 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:20.218701 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:20.218701 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:20.218701 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:20.218701 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:20.218701 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:20.218701 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 01:17:20.218701 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 01:17:20.218701 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 01:17:20.218701 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 01:17:20.218701 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:20.218701 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:20.218701 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:20.218701 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:20.218701 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:20.218701 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:20.219739 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:20.219739 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:20.219739 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:20.219739 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:20.219739 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:20.219739 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:20.219739 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:20.219739 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:20.219739 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:20.219739 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:20.219739 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 01:17:20.219739 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:17:20.219739 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 01:17:20.219739 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:20.219739 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 444/888] 10.222.0.60 () {56 vars in 1126 bytes} [Tue Aug 30 01:17:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:20.225697 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba04c4a-bb2c-4e6d-af75-bf0fb431b324 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:20.245358 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:20.302320 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714f0d2c-edf8-4484-b73a-ac1e1c81e443 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:20.337961 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:20.351855 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd024abe-575e-48ab-b4cf-d7d8d5ecef6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:20.353212 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd024abe-575e-48ab-b4cf-d7d8d5ecef6a None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:20.353585 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd024abe-575e-48ab-b4cf-d7d8d5ecef6a None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:20.353947 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd024abe-575e-48ab-b4cf-d7d8d5ecef6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:20.358244 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba04c4a-bb2c-4e6d-af75-bf0fb431b324 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:20.367550 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd024abe-575e-48ab-b4cf-d7d8d5ecef6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:20.369688 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd024abe-575e-48ab-b4cf-d7d8d5ecef6a None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:20.390790 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-fd024abe-575e-48ab-b4cf-d7d8d5ecef6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:17:20.390790 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:20.390790 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:20.390790 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:20.390790 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:20.390790 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:20.390790 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:20.390790 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:20.390790 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:20.390790 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:20.390790 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:20.390790 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:20.390790 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:17:20.390790 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:17:20.390790 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:17:20.390790 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:17:20.392027 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:20.392027 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:20.392027 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:20.392027 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:20.392027 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:20.392027 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:20.392027 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:20.392027 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:20.392027 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:20.392027 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:20.392027 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:20.392027 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:20.392027 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:20.392027 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:20.392027 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:20.392027 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:20.392027 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:17:20.393022 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:17:20.393022 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:17:20.393022 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:20.398028 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 445/889] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:17:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:20.406716 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd024abe-575e-48ab-b4cf-d7d8d5ecef6a None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:20.417734 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eba6ba8-dcaf-4b37-ad69-8d86f82267e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:20.419204 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba6ba8-dcaf-4b37-ad69-8d86f82267e8 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:20.419731 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba6ba8-dcaf-4b37-ad69-8d86f82267e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:20.420211 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba6ba8-dcaf-4b37-ad69-8d86f82267e8 None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:20.421094 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eba6ba8-dcaf-4b37-ad69-8d86f82267e8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:20.421671 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eba6ba8-dcaf-4b37-ad69-8d86f82267e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:20.423486 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eba6ba8-dcaf-4b37-ad69-8d86f82267e8 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:20.430198 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 445/890] 10.222.0.60 () {56 vars in 1122 bytes} [Tue Aug 30 01:17:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:20.443458 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eba6ba8-dcaf-4b37-ad69-8d86f82267e8 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:20.538609 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd024abe-575e-48ab-b4cf-d7d8d5ecef6a None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:20.557172 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:20.558757 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eba6ba8-dcaf-4b37-ad69-8d86f82267e8 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:20.589441 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f868ac37-2876-4adf-b053-617a5d27510d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:20.590913 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f868ac37-2876-4adf-b053-617a5d27510d None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:20.591945 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f868ac37-2876-4adf-b053-617a5d27510d None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:20.592469 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f868ac37-2876-4adf-b053-617a5d27510d None admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:20.593344 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f868ac37-2876-4adf-b053-617a5d27510d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:20.593854 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f868ac37-2876-4adf-b053-617a5d27510d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:20.596849 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f868ac37-2876-4adf-b053-617a5d27510d None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:20.606252 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68521afa-c191-4bd9-8d8b-b360888fe379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:20.606869 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68521afa-c191-4bd9-8d8b-b360888fe379 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:20.607147 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68521afa-c191-4bd9-8d8b-b360888fe379 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:20.607416 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68521afa-c191-4bd9-8d8b-b360888fe379 None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:20.608085 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68521afa-c191-4bd9-8d8b-b360888fe379 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:20.608388 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68521afa-c191-4bd9-8d8b-b360888fe379 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:20.609776 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68521afa-c191-4bd9-8d8b-b360888fe379 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:20.616021 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 446/891] 10.222.0.60 () {56 vars in 1122 bytes} [Tue Aug 30 01:17:20 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:17:20.621452 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 446/892] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:17:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:20.624643 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68521afa-c191-4bd9-8d8b-b360888fe379 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:20.645067 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:20.744685 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68521afa-c191-4bd9-8d8b-b360888fe379 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:20.781086 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dcc365-5e17-4500-82fb-b0e0e06fbd07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:20.781864 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dcc365-5e17-4500-82fb-b0e0e06fbd07 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:20.782246 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dcc365-5e17-4500-82fb-b0e0e06fbd07 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:20.782616 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dcc365-5e17-4500-82fb-b0e0e06fbd07 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:20.791510 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dcc365-5e17-4500-82fb-b0e0e06fbd07 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:20.793079 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dcc365-5e17-4500-82fb-b0e0e06fbd07 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:20.805541 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-b9dcc365-5e17-4500-82fb-b0e0e06fbd07 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:17:20.805541 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:20.805541 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:20.805541 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:20.805541 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:20.805541 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:20.805541 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:20.805541 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:20.805541 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:20.805541 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:20.805541 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:20.805541 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:20.805541 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 01:17:20.805541 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 01:17:20.805541 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 01:17:20.806675 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 01:17:20.806675 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:20.806675 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:20.806675 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:20.806675 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:20.806675 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:20.806675 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:20.806675 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:20.806675 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:20.806675 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:20.806675 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:20.806675 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:20.806675 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:20.806675 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:20.806675 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:20.806675 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:20.806675 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:20.807965 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 01:17:20.807965 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 01:17:20.807965 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 01:17:20.807965 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 01:17:20.807965 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 01:17:20.807965 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 01:17:20.807965 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:17:20.807965 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:20.811463 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 447/893] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 30 01:17:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:20.815622 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f868ac37-2876-4adf-b053-617a5d27510d None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:20.923860 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f868ac37-2876-4adf-b053-617a5d27510d None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:20.933947 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e3376-d799-4d62-a7c5-15163e612c85 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:20.934233 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e3376-d799-4d62-a7c5-15163e612c85 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:20.934506 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e3376-d799-4d62-a7c5-15163e612c85 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:20.936123 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 448/894] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:17:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:17:20.940943 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6ff77-b9ea-4e2f-b8d3-d113a2c12532 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:20.941222 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6ff77-b9ea-4e2f-b8d3-d113a2c12532 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:20.941492 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6ff77-b9ea-4e2f-b8d3-d113a2c12532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:20.962256 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f5af5c-7191-4381-8597-bdf83b30a2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:20.962473 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-c9b6ff77-b9ea-4e2f-b8d3-d113a2c12532 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:20.963027 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f5af5c-7191-4381-8597-bdf83b30a2da None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:20.963411 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f5af5c-7191-4381-8597-bdf83b30a2da None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:20.963544 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-c9b6ff77-b9ea-4e2f-b8d3-d113a2c12532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:20.963896 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f5af5c-7191-4381-8597-bdf83b30a2da None admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:20.964675 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f5af5c-7191-4381-8597-bdf83b30a2da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:20.965045 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f5af5c-7191-4381-8597-bdf83b30a2da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:20.967327 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f5af5c-7191-4381-8597-bdf83b30a2da None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:20.980469 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 447/895] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 30 01:17:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:20.986129 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f5af5c-7191-4381-8597-bdf83b30a2da None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:21.025010 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:21.049093 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 449/896] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:17:20 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:17:21.097642 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f5af5c-7191-4381-8597-bdf83b30a2da None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:21.135678 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e636b0d0-b388-43e5-a922-59060ba37e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:21.136284 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636b0d0-b388-43e5-a922-59060ba37e52 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:21.136620 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636b0d0-b388-43e5-a922-59060ba37e52 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:21.136894 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636b0d0-b388-43e5-a922-59060ba37e52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:21.137626 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e636b0d0-b388-43e5-a922-59060ba37e52 None admin] RBAC: Adding query filter params (role.id=3cf30b69be074b7bade51cb0dc428655, scope.project.id=b050b2dad22a4a06875072e44c8c9824, user.id=edc11f8a9c5843939ec230e63ca7fa3b) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:21.137930 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e636b0d0-b388-43e5-a922-59060ba37e52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:21.139353 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e636b0d0-b388-43e5-a922-59060ba37e52 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:21.146026 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 448/897] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 30 01:17:20 2022] GET /identity/v3/role_assignments?user.id=edc11f8a9c5843939ec230e63ca7fa3b&scope.project.id=b050b2dad22a4a06875072e44c8c9824&role.id=3cf30b69be074b7bade51cb0dc428655 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:17:21.326092 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b6ff77-b9ea-4e2f-b8d3-d113a2c12532 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:21.329422 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:21.431378 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b6ff77-b9ea-4e2f-b8d3-d113a2c12532 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:21.468607 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732909ec-f2e8-4cac-a543-ca3277caeef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:21.469679 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732909ec-f2e8-4cac-a543-ca3277caeef1 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:21.470214 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732909ec-f2e8-4cac-a543-ca3277caeef1 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:21.470779 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732909ec-f2e8-4cac-a543-ca3277caeef1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:21.471591 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732909ec-f2e8-4cac-a543-ca3277caeef1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:21.473164 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732909ec-f2e8-4cac-a543-ca3277caeef1 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:21.482678 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-732909ec-f2e8-4cac-a543-ca3277caeef1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 01:17:21.482678 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:21.482678 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 01:17:21.482678 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 01:17:21.482678 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 01:17:21.482678 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 01:17:21.482678 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 01:17:21.482678 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:17:21.482678 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 01:17:21.482678 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:21.482678 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 01:17:21.482678 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:21.482678 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:21.482678 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:21.482678 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:21.482678 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:21.482678 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:21.483752 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:21.483752 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:21.483752 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:21.483752 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:21.483752 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:21.483752 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:21.483752 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 01:17:21.483752 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 01:17:21.483752 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 01:17:21.483752 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 01:17:21.483752 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:21.483752 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:21.483752 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:21.483752 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:21.483752 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:21.483752 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:21.484588 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:21.484588 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:21.484588 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:21.484588 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:21.484588 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:21.484588 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:21.484588 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:21.484588 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:21.484588 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:21.484588 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:21.484588 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 01:17:21.484588 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:17:21.484588 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 01:17:21.484588 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:21.488014 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 450/898] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Aug 30 01:17:21 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:21.494024 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e636b0d0-b388-43e5-a922-59060ba37e52 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:21.600344 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:21.604039 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e636b0d0-b388-43e5-a922-59060ba37e52 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:21.640436 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c60f353-2fe1-4cdc-8688-1235714ce104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:21.641046 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60f353-2fe1-4cdc-8688-1235714ce104 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:21.641323 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60f353-2fe1-4cdc-8688-1235714ce104 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:21.641646 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60f353-2fe1-4cdc-8688-1235714ce104 None admin] PATH_INFO: `/v3/services` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:21.642300 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c60f353-2fe1-4cdc-8688-1235714ce104 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:21.642615 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c60f353-2fe1-4cdc-8688-1235714ce104 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:21.644027 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c60f353-2fe1-4cdc-8688-1235714ce104 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:21.649370 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 449/899] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Aug 30 01:17:21 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:21.655056 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732909ec-f2e8-4cac-a543-ca3277caeef1 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:21.724138 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:21.766654 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732909ec-f2e8-4cac-a543-ca3277caeef1 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:21.802021 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2656d9ed-99ec-472e-8219-8d8219625412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:21.802805 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656d9ed-99ec-472e-8219-8d8219625412 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:21.803147 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656d9ed-99ec-472e-8219-8d8219625412 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:21.803449 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656d9ed-99ec-472e-8219-8d8219625412 None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:21.804956 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2656d9ed-99ec-472e-8219-8d8219625412 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:21.804956 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2656d9ed-99ec-472e-8219-8d8219625412 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:21.805823 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2656d9ed-99ec-472e-8219-8d8219625412 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:21.812524 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 451/900] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Aug 30 01:17:21 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:21.819492 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c60f353-2fe1-4cdc-8688-1235714ce104 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:21.921160 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c60f353-2fe1-4cdc-8688-1235714ce104 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:21.956312 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fae576-ffa8-4a37-8dc4-e57f4c31acbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:21.956918 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fae576-ffa8-4a37-8dc4-e57f4c31acbf None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:21.957193 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fae576-ffa8-4a37-8dc4-e57f4c31acbf None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:21.957461 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fae576-ffa8-4a37-8dc4-e57f4c31acbf None admin] PATH_INFO: `/v3/endpoints` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:21.958157 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fae576-ffa8-4a37-8dc4-e57f4c31acbf None admin] RBAC: Adding query filter params (interface=public, service_id=84ab8446f9b948838a8014da501ce4f6, region_id=RegionOne) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:21.958459 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fae576-ffa8-4a37-8dc4-e57f4c31acbf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:21.959862 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fae576-ffa8-4a37-8dc4-e57f4c31acbf None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:21.965137 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 450/901] 10.222.0.60 () {56 vars in 1251 bytes} [Tue Aug 30 01:17:21 2022] GET /identity/v3/endpoints?service_id=84ab8446f9b948838a8014da501ce4f6&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:21.971372 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2656d9ed-99ec-472e-8219-8d8219625412 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:22.077158 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f778ff4-48b1-44ca-a0d4-136d240465f1 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:22.077478 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f778ff4-48b1-44ca-a0d4-136d240465f1 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:22.077691 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f778ff4-48b1-44ca-a0d4-136d240465f1 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:22.080306 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 451/902] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:17:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:17:22.081450 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2656d9ed-99ec-472e-8219-8d8219625412 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:22.084266 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a90910-49c9-414d-a006-35354d3bcf78 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:22.084545 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a90910-49c9-414d-a006-35354d3bcf78 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:22.084824 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a90910-49c9-414d-a006-35354d3bcf78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:22.105667 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-86a90910-49c9-414d-a006-35354d3bcf78 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:22.106867 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-86a90910-49c9-414d-a006-35354d3bcf78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:22.119393 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:22.126815 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c966bd28-0784-4566-860f-da2f5a89b317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:22.127943 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966bd28-0784-4566-860f-da2f5a89b317 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:22.128741 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966bd28-0784-4566-860f-da2f5a89b317 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:22.129225 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966bd28-0784-4566-860f-da2f5a89b317 None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:22.130035 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c966bd28-0784-4566-860f-da2f5a89b317 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:22.132188 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c966bd28-0784-4566-860f-da2f5a89b317 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:22.134413 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:22.141222 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 452/903] 10.222.0.60 () {56 vars in 1087 bytes} [Tue Aug 30 01:17:21 2022] GET /identity/v3/services => generated 1268 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:17:22.195708 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 452/904] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:17:22 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 01:17:22.463666 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c966bd28-0784-4566-860f-da2f5a89b317 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:22.569331 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c966bd28-0784-4566-860f-da2f5a89b317 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:22.609155 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a48e6-19b5-4d2b-8b58-4f5bd7184a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:22.610076 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a48e6-19b5-4d2b-8b58-4f5bd7184a98 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:22.610570 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a48e6-19b5-4d2b-8b58-4f5bd7184a98 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:22.611094 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a48e6-19b5-4d2b-8b58-4f5bd7184a98 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:22.611914 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78a48e6-19b5-4d2b-8b58-4f5bd7184a98 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:22.613497 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78a48e6-19b5-4d2b-8b58-4f5bd7184a98 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:22.622953 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-c78a48e6-19b5-4d2b-8b58-4f5bd7184a98 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 01:17:22.622953 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:22.622953 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 01:17:22.622953 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 01:17:22.622953 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 01:17:22.622953 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 01:17:22.622953 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 01:17:22.622953 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:17:22.622953 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 01:17:22.622953 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:22.622953 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 01:17:22.622953 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:22.622953 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:22.622953 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:22.622953 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:22.622953 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:22.623969 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:22.623969 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:22.623969 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:22.623969 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:22.623969 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:22.623969 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:22.623969 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:22.623969 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 01:17:22.623969 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 01:17:22.623969 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 01:17:22.623969 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 01:17:22.623969 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:22.623969 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:22.623969 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:22.623969 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:22.623969 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:22.623969 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:22.624880 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:22.624880 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:22.624880 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:22.624880 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:22.624880 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:22.624880 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:22.624880 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:22.624880 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:22.624880 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:22.624880 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:22.624880 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 01:17:22.624880 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:17:22.624880 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 01:17:22.624880 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:22.628245 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 453/905] 10.222.0.60 () {56 vars in 1132 bytes} [Tue Aug 30 01:17:22 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:22.636310 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a90910-49c9-414d-a006-35354d3bcf78 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:22.731549 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc475893-1691-4dca-b18f-d7c3ecf92639 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:22.732158 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc475893-1691-4dca-b18f-d7c3ecf92639 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:22.732677 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc475893-1691-4dca-b18f-d7c3ecf92639 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:22.734445 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 454/906] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:17:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:17:22.739545 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af88a79-b9a5-4ec7-8efa-499db39bafb4 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:22.740082 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af88a79-b9a5-4ec7-8efa-499db39bafb4 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:22.740318 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a90910-49c9-414d-a006-35354d3bcf78 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:22.740894 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af88a79-b9a5-4ec7-8efa-499db39bafb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:22.761558 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-1af88a79-b9a5-4ec7-8efa-499db39bafb4 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:22.763662 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-1af88a79-b9a5-4ec7-8efa-499db39bafb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:22.782058 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642758eb-5caa-46c2-99fd-0182ff266c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:22.783378 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642758eb-5caa-46c2-99fd-0182ff266c16 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:22.783945 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642758eb-5caa-46c2-99fd-0182ff266c16 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:22.784442 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642758eb-5caa-46c2-99fd-0182ff266c16 None admin] PATH_INFO: `/v3/services` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:22.785268 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642758eb-5caa-46c2-99fd-0182ff266c16 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:22.785752 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642758eb-5caa-46c2-99fd-0182ff266c16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:22.787558 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642758eb-5caa-46c2-99fd-0182ff266c16 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:22.793207 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 453/907] 10.222.0.60 () {56 vars in 1126 bytes} [Tue Aug 30 01:17:22 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:22.804880 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642758eb-5caa-46c2-99fd-0182ff266c16 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:22.834305 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:22.837111 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:22.853835 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 455/908] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:17:22 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 01:17:22.924559 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642758eb-5caa-46c2-99fd-0182ff266c16 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:22.960549 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b57d40-74f2-4c6d-8e27-04b6c2e57efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:22.961151 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b57d40-74f2-4c6d-8e27-04b6c2e57efd None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:22.961428 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b57d40-74f2-4c6d-8e27-04b6c2e57efd None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:22.961698 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b57d40-74f2-4c6d-8e27-04b6c2e57efd None admin] PATH_INFO: `/v3/services` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:22.962380 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b57d40-74f2-4c6d-8e27-04b6c2e57efd None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:22.962679 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b57d40-74f2-4c6d-8e27-04b6c2e57efd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:22.964116 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b57d40-74f2-4c6d-8e27-04b6c2e57efd None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:22.974566 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 454/909] 10.222.0.60 () {56 vars in 1126 bytes} [Tue Aug 30 01:17:22 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:22.976044 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af88a79-b9a5-4ec7-8efa-499db39bafb4 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:23.084851 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af88a79-b9a5-4ec7-8efa-499db39bafb4 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:23.120548 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58440ab1-47ca-48f3-8065-3291ab066ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:23.121151 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58440ab1-47ca-48f3-8065-3291ab066ac0 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:23.121424 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58440ab1-47ca-48f3-8065-3291ab066ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:23.121690 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58440ab1-47ca-48f3-8065-3291ab066ac0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:23.122385 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58440ab1-47ca-48f3-8065-3291ab066ac0 None admin] RBAC: Adding query filter params (interface=public, service_id=f2617a1e99334da8a2ede918257850eb, region_id=RegionOne) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:23.122684 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58440ab1-47ca-48f3-8065-3291ab066ac0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:23.124082 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58440ab1-47ca-48f3-8065-3291ab066ac0 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:23.132973 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 456/910] 10.222.0.60 () {56 vars in 1251 bytes} [Tue Aug 30 01:17:22 2022] GET /identity/v3/endpoints?service_id=f2617a1e99334da8a2ede918257850eb&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:23.139762 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58440ab1-47ca-48f3-8065-3291ab066ac0 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:23.139894 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b57d40-74f2-4c6d-8e27-04b6c2e57efd None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:23.203413 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:23.232539 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:23.250831 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b57d40-74f2-4c6d-8e27-04b6c2e57efd None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:23.258974 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58440ab1-47ca-48f3-8065-3291ab066ac0 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:23.287253 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48f2d7c-6939-4a0e-9098-894bd70abf02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:23.288215 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f2d7c-6939-4a0e-9098-894bd70abf02 None admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:23.288784 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f2d7c-6939-4a0e-9098-894bd70abf02 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:23.289065 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f2d7c-6939-4a0e-9098-894bd70abf02 None admin] PATH_INFO: `/v3/services` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:23.289723 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48f2d7c-6939-4a0e-9098-894bd70abf02 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:23.291201 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48f2d7c-6939-4a0e-9098-894bd70abf02 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:23.296227 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712bcae6-b48b-446e-b1f1-8e1acdf53b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:23.296863 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712bcae6-b48b-446e-b1f1-8e1acdf53b5b None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:23.297105 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712bcae6-b48b-446e-b1f1-8e1acdf53b5b None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:23.297496 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712bcae6-b48b-446e-b1f1-8e1acdf53b5b None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:23.298231 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712bcae6-b48b-446e-b1f1-8e1acdf53b5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:23.300253 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712bcae6-b48b-446e-b1f1-8e1acdf53b5b None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:23.315757 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 457/911] 10.222.0.60 () {56 vars in 1087 bytes} [Tue Aug 30 01:17:23 2022] GET /identity/v3/services => generated 1497 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:17:23.316113 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 455/912] 10.222.0.60 () {60 vars in 1141 bytes} [Tue Aug 30 01:17:23 2022] POST /identity/v3/services => generated 241 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:17:23.316212 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b5649-d688-4171-bc24-5d495c906a5f None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:23.316212 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b5649-d688-4171-bc24-5d495c906a5f None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:23.316212 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b5649-d688-4171-bc24-5d495c906a5f None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:23.321133 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc75bac-4f0f-480f-b456-838d427a97b6 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:23.321458 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc75bac-4f0f-480f-b456-838d427a97b6 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:23.321757 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc75bac-4f0f-480f-b456-838d427a97b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:23.322941 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 458/913] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:17:23 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:17:23.345024 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-5dc75bac-4f0f-480f-b456-838d427a97b6 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:23.346962 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-5dc75bac-4f0f-480f-b456-838d427a97b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:23.437539 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 456/914] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:17:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:17:23.714363 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b5649-d688-4171-bc24-5d495c906a5f None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:23.830725 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b5649-d688-4171-bc24-5d495c906a5f None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:23.850719 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:23.868930 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33591cab-d3c6-40f8-a4dd-8442578aae1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:23.869485 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33591cab-d3c6-40f8-a4dd-8442578aae1d None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:23.869768 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33591cab-d3c6-40f8-a4dd-8442578aae1d None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:23.870225 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33591cab-d3c6-40f8-a4dd-8442578aae1d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:23.881528 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33591cab-d3c6-40f8-a4dd-8442578aae1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:17:23.886405 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-33591cab-d3c6-40f8-a4dd-8442578aae1d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 01:17:23.886405 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:23.886405 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:23.886405 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:23.886405 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:23.886405 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:23.886405 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:23.886405 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:23.886405 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:23.886405 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:23.886405 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:23.886405 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:23.886405 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:17:23.886405 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:17:23.886405 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:17:23.886405 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:17:23.887352 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:17:23.887352 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:17:23.887352 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:17:23.887352 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:17:23.887352 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:23.887352 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:23.887352 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:23.887352 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:23.887352 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:23.887352 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:23.887352 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:23.887352 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:23.887352 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:23.887352 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:23.887352 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:23.887352 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:23.888378 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:23.888378 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:23.888378 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:23.888378 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:23.888378 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:17:23.888378 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:17:23.888378 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:17:23.888378 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:17:23.888378 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:17:23.888378 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:17:23.888378 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 01:17:23.888378 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:23.888378 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 459/915] 10.222.0.60 () {56 vars in 1120 bytes} [Tue Aug 30 01:17:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:23.895776 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc75bac-4f0f-480f-b456-838d427a97b6 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:23.969033 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:24.000698 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc75bac-4f0f-480f-b456-838d427a97b6 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:24.036337 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b75e8-9e4d-4910-b623-efe3ff7029ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:24.036949 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b75e8-9e4d-4910-b623-efe3ff7029ed None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:24.037229 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b75e8-9e4d-4910-b623-efe3ff7029ed None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:24.037502 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b75e8-9e4d-4910-b623-efe3ff7029ed None admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:24.038171 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841b75e8-9e4d-4910-b623-efe3ff7029ed None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:24.038475 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841b75e8-9e4d-4910-b623-efe3ff7029ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:24.039893 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841b75e8-9e4d-4910-b623-efe3ff7029ed None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:24.048697 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 457/916] 10.222.0.60 () {56 vars in 1115 bytes} [Tue Aug 30 01:17:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:24.054343 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33591cab-d3c6-40f8-a4dd-8442578aae1d None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:24.084963 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21cfc05-942e-4523-b1a5-88b1799d9336 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:24.086247 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21cfc05-942e-4523-b1a5-88b1799d9336 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:24.086524 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21cfc05-942e-4523-b1a5-88b1799d9336 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:24.088184 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 458/917] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:17:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:17:24.093304 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03700e71-e16e-4a49-9a71-bc4fdb4fcda0 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:24.093588 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03700e71-e16e-4a49-9a71-bc4fdb4fcda0 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:24.093866 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03700e71-e16e-4a49-9a71-bc4fdb4fcda0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:24.112117 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-03700e71-e16e-4a49-9a71-bc4fdb4fcda0 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:24.113310 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-03700e71-e16e-4a49-9a71-bc4fdb4fcda0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:24.171971 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33591cab-d3c6-40f8-a4dd-8442578aae1d None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:24.191873 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 459/918] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:17:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 01:17:24.211741 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e516e2-d71e-4626-94a9-85d75231c070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:24.212385 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e516e2-d71e-4626-94a9-85d75231c070 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:24.212678 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e516e2-d71e-4626-94a9-85d75231c070 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:24.213489 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e516e2-d71e-4626-94a9-85d75231c070 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:24.227075 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e516e2-d71e-4626-94a9-85d75231c070 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:24.228676 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e516e2-d71e-4626-94a9-85d75231c070 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:24.244003 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-e5e516e2-d71e-4626-94a9-85d75231c070 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:17:24.244003 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:24.244003 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:24.244003 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:24.244003 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:24.244003 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:24.244003 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:24.244003 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:24.244003 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:24.244003 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:24.244003 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:24.244003 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:24.244003 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:17:24.244003 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:17:24.244003 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:17:24.244003 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:17:24.244988 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:24.244988 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:24.244988 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:24.244988 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:24.244988 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:24.244988 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:24.244988 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:24.244988 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:24.244988 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:24.244988 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:24.244988 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:24.244988 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:24.244988 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:24.244988 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:24.244988 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:24.244988 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:24.244988 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:17:24.246322 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:17:24.246322 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:17:24.246322 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:24.246322 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 460/919] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:17:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:24.252441 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03700e71-e16e-4a49-9a71-bc4fdb4fcda0 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:24.322397 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:24.362609 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03700e71-e16e-4a49-9a71-bc4fdb4fcda0 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:24.399008 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434a301e-c0af-46a5-a4bc-f5252393f524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:24.399657 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a301e-c0af-46a5-a4bc-f5252393f524 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:24.399944 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a301e-c0af-46a5-a4bc-f5252393f524 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:24.400218 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a301e-c0af-46a5-a4bc-f5252393f524 None admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:24.400871 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434a301e-c0af-46a5-a4bc-f5252393f524 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:24.401179 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434a301e-c0af-46a5-a4bc-f5252393f524 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:24.402619 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434a301e-c0af-46a5-a4bc-f5252393f524 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:24.414735 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 460/920] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:17:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:24.420310 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e516e2-d71e-4626-94a9-85d75231c070 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:24.459797 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:24.476419 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434a301e-c0af-46a5-a4bc-f5252393f524 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:24.559547 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e516e2-d71e-4626-94a9-85d75231c070 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:24.609813 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6049df2b-7ae9-45d2-9d65-f0d5759af8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:24.610709 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049df2b-7ae9-45d2-9d65-f0d5759af8ad None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:24.611758 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049df2b-7ae9-45d2-9d65-f0d5759af8ad None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:24.612231 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049df2b-7ae9-45d2-9d65-f0d5759af8ad None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:24.617227 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434a301e-c0af-46a5-a4bc-f5252393f524 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:24.620981 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6049df2b-7ae9-45d2-9d65-f0d5759af8ad None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:24.622653 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6049df2b-7ae9-45d2-9d65-f0d5759af8ad None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:24.638810 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-6049df2b-7ae9-45d2-9d65-f0d5759af8ad None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 01:17:24.638810 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:24.638810 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:24.638810 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:24.638810 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:24.638810 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:24.638810 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:24.638810 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:24.638810 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:24.638810 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:24.638810 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:24.638810 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:24.638810 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 01:17:24.638810 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 01:17:24.638810 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 01:17:24.638810 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 01:17:24.639820 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:24.639820 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:24.639820 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 01:17:24.639820 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:17:24.639820 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 01:17:24.639820 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:17:24.639820 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:24.639820 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:24.639820 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:24.639820 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:24.639820 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:24.639820 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:24.639820 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:24.639820 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:24.639820 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:24.639820 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:24.639820 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:24.639820 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:24.640754 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:24.640754 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:24.640754 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 01:17:24.640754 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 01:17:24.640754 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 01:17:24.640754 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 01:17:24.640754 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 01:17:24.640754 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 01:17:24.640754 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 01:17:24.640754 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:24.640754 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 461/921] 10.222.0.60 () {56 vars in 1117 bytes} [Tue Aug 30 01:17:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:24.646631 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6049df2b-7ae9-45d2-9d65-f0d5759af8ad None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:24.646754 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:24.659756 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87068380-fcb8-4d15-8985-0bb813dacf3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:24.660474 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87068380-fcb8-4d15-8985-0bb813dacf3a None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:24.660817 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87068380-fcb8-4d15-8985-0bb813dacf3a None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:24.661151 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87068380-fcb8-4d15-8985-0bb813dacf3a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:24.661801 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87068380-fcb8-4d15-8985-0bb813dacf3a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:24.663304 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87068380-fcb8-4d15-8985-0bb813dacf3a None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:24.672438 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-87068380-fcb8-4d15-8985-0bb813dacf3a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 01:17:24.672438 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:24.672438 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 01:17:24.672438 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 01:17:24.672438 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 01:17:24.672438 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 01:17:24.672438 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 01:17:24.672438 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:17:24.672438 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 01:17:24.672438 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:24.672438 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 01:17:24.672438 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:24.672438 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:24.672438 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:24.672438 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:24.672438 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:24.672438 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:24.674929 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:24.674929 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:24.674929 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:24.674929 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:24.674929 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:24.674929 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:24.674929 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 01:17:24.674929 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 01:17:24.674929 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 01:17:24.674929 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 01:17:24.674929 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:24.674929 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:24.674929 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:24.674929 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:24.674929 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:24.674929 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:24.676625 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:24.676625 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:24.676625 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:24.676625 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:24.676625 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:24.676625 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:24.676625 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:24.676625 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:24.676625 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:24.676625 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:24.676625 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 01:17:24.676625 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:17:24.676625 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 01:17:24.676625 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:24.683494 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 461/922] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Aug 30 01:17:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:17:24.683494 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87068380-fcb8-4d15-8985-0bb813dacf3a None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:24.752253 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:24.765062 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6049df2b-7ae9-45d2-9d65-f0d5759af8ad None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:24.790520 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87068380-fcb8-4d15-8985-0bb813dacf3a None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:24.805819 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1da091-0778-47b3-aab2-66236d054f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:24.806574 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1da091-0778-47b3-aab2-66236d054f8c None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:24.807036 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1da091-0778-47b3-aab2-66236d054f8c None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:24.807308 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1da091-0778-47b3-aab2-66236d054f8c None admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:24.808559 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1da091-0778-47b3-aab2-66236d054f8c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:24.808872 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1da091-0778-47b3-aab2-66236d054f8c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:24.810606 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1da091-0778-47b3-aab2-66236d054f8c None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:24.838647 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 462/923] 10.222.0.60 () {56 vars in 1149 bytes} [Tue Aug 30 01:17:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:24.839015 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce012d46-7095-4807-bf9d-6bbf7c4bf881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:24.839548 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce012d46-7095-4807-bf9d-6bbf7c4bf881 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:24.839831 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce012d46-7095-4807-bf9d-6bbf7c4bf881 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:24.840103 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce012d46-7095-4807-bf9d-6bbf7c4bf881 None admin] PATH_INFO: `/v3/services` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:24.841004 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce012d46-7095-4807-bf9d-6bbf7c4bf881 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:24.841303 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce012d46-7095-4807-bf9d-6bbf7c4bf881 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:24.841774 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1da091-0778-47b3-aab2-66236d054f8c None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:24.842775 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce012d46-7095-4807-bf9d-6bbf7c4bf881 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:24.853576 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 462/924] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Aug 30 01:17:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:17:24.854444 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce012d46-7095-4807-bf9d-6bbf7c4bf881 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:24.911025 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:24.951532 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1da091-0778-47b3-aab2-66236d054f8c None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:24.962960 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce012d46-7095-4807-bf9d-6bbf7c4bf881 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:24.989198 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69129c41-30b5-45ad-a8a8-eee381d68f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:24.990140 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69129c41-30b5-45ad-a8a8-eee381d68f3a None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:24.990256 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69129c41-30b5-45ad-a8a8-eee381d68f3a None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:24.990571 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69129c41-30b5-45ad-a8a8-eee381d68f3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:25.001451 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69129c41-30b5-45ad-a8a8-eee381d68f3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:25.001743 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a2a15f-019a-4bb9-a32c-61c4a79a8114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:25.002615 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a2a15f-019a-4bb9-a32c-61c4a79a8114 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:25.003095 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a2a15f-019a-4bb9-a32c-61c4a79a8114 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:25.003212 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69129c41-30b5-45ad-a8a8-eee381d68f3a None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:25.003759 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a2a15f-019a-4bb9-a32c-61c4a79a8114 None admin] PATH_INFO: `/v3/services` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:25.004627 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a2a15f-019a-4bb9-a32c-61c4a79a8114 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:25.005108 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a2a15f-019a-4bb9-a32c-61c4a79a8114 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:25.006653 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a2a15f-019a-4bb9-a32c-61c4a79a8114 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:25.012650 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:25.016947 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 463/925] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Aug 30 01:17:24 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:17:25.018039 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a2a15f-019a-4bb9-a32c-61c4a79a8114 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:25.021178 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-69129c41-30b5-45ad-a8a8-eee381d68f3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:17:25.021178 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:25.021178 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:25.021178 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:25.021178 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:25.021178 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:25.021178 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:25.021178 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:25.021178 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:25.021178 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:25.021178 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:25.021178 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:25.021178 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:17:25.021178 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:17:25.021178 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:17:25.021178 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:17:25.022154 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:25.022154 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:25.022154 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:25.022154 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:25.022154 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:25.022154 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:25.022154 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:25.022154 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:25.022154 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:25.022154 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:25.022154 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:25.022154 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:25.022154 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:25.022154 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:25.022154 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:25.022154 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:25.022154 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:17:25.023070 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:17:25.023070 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:17:25.023070 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:25.030129 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 463/926] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:17:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:25.031253 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69129c41-30b5-45ad-a8a8-eee381d68f3a None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:25.130530 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a2a15f-019a-4bb9-a32c-61c4a79a8114 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:25.140518 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69129c41-30b5-45ad-a8a8-eee381d68f3a None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:25.148460 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:25.169858 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd48af-1e61-4584-8cf9-4d1662b21de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:25.170471 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd48af-1e61-4584-8cf9-4d1662b21de0 None admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:25.170751 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd48af-1e61-4584-8cf9-4d1662b21de0 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:25.171055 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd48af-1e61-4584-8cf9-4d1662b21de0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:25.171700 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd48af-1e61-4584-8cf9-4d1662b21de0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:25.173185 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd48af-1e61-4584-8cf9-4d1662b21de0 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:25.179139 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f738a-48b2-47ba-a54b-3a3fee675b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:25.180061 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f738a-48b2-47ba-a54b-3a3fee675b4f None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:25.180574 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f738a-48b2-47ba-a54b-3a3fee675b4f None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:25.181051 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f738a-48b2-47ba-a54b-3a3fee675b4f None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:25.181916 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4f738a-48b2-47ba-a54b-3a3fee675b4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:25.182423 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4f738a-48b2-47ba-a54b-3a3fee675b4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:25.184084 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4f738a-48b2-47ba-a54b-3a3fee675b4f None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:25.202344 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 464/927] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:17:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:25.203669 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f738a-48b2-47ba-a54b-3a3fee675b4f None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:25.204633 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 464/928] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:17:25 2022] POST /identity/v3/endpoints => generated 346 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:17:25.273808 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:25.305071 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4cae4-a74e-4cd6-9f6f-8b1fe4e9e47a None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:25.305427 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4cae4-a74e-4cd6-9f6f-8b1fe4e9e47a None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:25.305617 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4cae4-a74e-4cd6-9f6f-8b1fe4e9e47a None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:25.307226 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 465/929] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:17:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:17:25.312835 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf521d1-fbbe-42cb-a356-b930627112e2 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:25.313123 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf521d1-fbbe-42cb-a356-b930627112e2 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:25.313404 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf521d1-fbbe-42cb-a356-b930627112e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:25.321741 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f738a-48b2-47ba-a54b-3a3fee675b4f None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:25.337846 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-daf521d1-fbbe-42cb-a356-b930627112e2 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:25.339393 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-daf521d1-fbbe-42cb-a356-b930627112e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:25.375989 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86af53a-04de-4162-a7db-83e780234b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:25.376648 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86af53a-04de-4162-a7db-83e780234b87 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:25.376925 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86af53a-04de-4162-a7db-83e780234b87 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:25.377194 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86af53a-04de-4162-a7db-83e780234b87 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:25.384728 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86af53a-04de-4162-a7db-83e780234b87 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:25.386187 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86af53a-04de-4162-a7db-83e780234b87 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:25.401406 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-c86af53a-04de-4162-a7db-83e780234b87 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:17:25.401406 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:25.401406 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:25.401406 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:25.401406 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:25.401406 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:25.401406 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:25.401406 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:25.401406 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:25.401406 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:25.401406 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:25.401406 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:25.401406 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 01:17:25.401406 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 01:17:25.401406 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 01:17:25.402461 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 01:17:25.402461 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:25.402461 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:25.402461 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:25.402461 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:25.402461 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:25.402461 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:25.402461 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:25.402461 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:25.402461 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:25.402461 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:25.402461 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:25.402461 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:25.402461 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:25.402461 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:25.402461 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:25.402461 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:25.403349 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 01:17:25.403349 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 01:17:25.403349 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 01:17:25.403349 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 01:17:25.403349 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 01:17:25.403349 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 01:17:25.403349 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:17:25.403349 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:25.403349 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 465/930] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 30 01:17:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:25.409775 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86af53a-04de-4162-a7db-83e780234b87 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:25.435243 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 466/931] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:17:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 01:17:25.436546 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e015a5-add4-4e6c-82bb-825acbb3294e None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:25.436908 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e015a5-add4-4e6c-82bb-825acbb3294e None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:25.437085 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e015a5-add4-4e6c-82bb-825acbb3294e None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:25.447224 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 467/932] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:17:25 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:17:25.448651 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89251bd4-0be6-42ad-a488-819996801699 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:25.448933 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89251bd4-0be6-42ad-a488-819996801699 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:25.449203 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89251bd4-0be6-42ad-a488-819996801699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:25.469804 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-89251bd4-0be6-42ad-a488-819996801699 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:25.471579 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-89251bd4-0be6-42ad-a488-819996801699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:25.530862 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86af53a-04de-4162-a7db-83e780234b87 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:25.542447 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 468/933] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:17:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:17:25.549938 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:25.570713 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9675ddc-d307-44e1-9c6b-2d0ca303226a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:25.571734 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9675ddc-d307-44e1-9c6b-2d0ca303226a None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:25.572217 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9675ddc-d307-44e1-9c6b-2d0ca303226a None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:25.572712 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9675ddc-d307-44e1-9c6b-2d0ca303226a None admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:25.573669 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9675ddc-d307-44e1-9c6b-2d0ca303226a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:25.574218 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9675ddc-d307-44e1-9c6b-2d0ca303226a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:25.575906 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9675ddc-d307-44e1-9c6b-2d0ca303226a None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:25.590041 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 466/934] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 30 01:17:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:17:25.599464 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89251bd4-0be6-42ad-a488-819996801699 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:25.631985 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:25.717153 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9675ddc-d307-44e1-9c6b-2d0ca303226a None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:25.722555 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89251bd4-0be6-42ad-a488-819996801699 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:25.758951 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864864b4-9714-482b-8f2f-be897aa04bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:25.759642 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864864b4-9714-482b-8f2f-be897aa04bec None admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:25.759921 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864864b4-9714-482b-8f2f-be897aa04bec None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:25.760200 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864864b4-9714-482b-8f2f-be897aa04bec None admin] PATH_INFO: `/v3/projects/b050b2dad22a4a06875072e44c8c9824/users/edc11f8a9c5843939ec230e63ca7fa3b/roles/3cf30b69be074b7bade51cb0dc428655` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:25.762334 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864864b4-9714-482b-8f2f-be897aa04bec None admin] RBAC: Authorizing `identity:create_grant(project_id=b050b2dad22a4a06875072e44c8c9824, user_id=edc11f8a9c5843939ec230e63ca7fa3b, role_id=3cf30b69be074b7bade51cb0dc428655)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:25.763790 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864864b4-9714-482b-8f2f-be897aa04bec None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:25.779115 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 469/935] 10.222.0.60 () {58 vars in 1439 bytes} [Tue Aug 30 01:17:25 2022] PUT /identity/v3/projects/b050b2dad22a4a06875072e44c8c9824/users/edc11f8a9c5843939ec230e63ca7fa3b/roles/3cf30b69be074b7bade51cb0dc428655 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:17:25.847134 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864864b4-9714-482b-8f2f-be897aa04bec None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:25.852575 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9675ddc-d307-44e1-9c6b-2d0ca303226a None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:25.893960 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e4599-4e14-4ebc-9ee7-9aa6cd67cf5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:25.895010 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e4599-4e14-4ebc-9ee7-9aa6cd67cf5e None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:25.895542 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e4599-4e14-4ebc-9ee7-9aa6cd67cf5e None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:25.896781 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e4599-4e14-4ebc-9ee7-9aa6cd67cf5e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:25.897675 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776e4599-4e14-4ebc-9ee7-9aa6cd67cf5e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:25.900389 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776e4599-4e14-4ebc-9ee7-9aa6cd67cf5e None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:25.913544 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-776e4599-4e14-4ebc-9ee7-9aa6cd67cf5e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 01:17:25.913544 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:25.913544 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 01:17:25.913544 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 01:17:25.913544 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 01:17:25.913544 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 01:17:25.913544 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 01:17:25.913544 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:17:25.913544 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 01:17:25.913544 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:25.913544 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 01:17:25.913544 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:25.913544 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:25.913544 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:25.913544 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:25.913544 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:25.914650 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:25.914650 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:25.914650 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:25.914650 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:25.914650 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:25.914650 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:25.914650 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:25.914650 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 01:17:25.914650 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 01:17:25.914650 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 01:17:25.914650 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 01:17:25.914650 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:25.914650 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:25.914650 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:25.914650 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:25.914650 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:25.914650 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:25.915696 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:25.915696 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:25.915696 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:25.915696 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:25.915696 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:25.915696 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:25.915696 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:25.915696 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:25.915696 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:25.915696 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:25.915696 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 01:17:25.915696 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:17:25.915696 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 01:17:25.915696 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:25.917263 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 467/936] 10.222.0.60 () {56 vars in 1132 bytes} [Tue Aug 30 01:17:25 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:17:25.927560 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e4599-4e14-4ebc-9ee7-9aa6cd67cf5e None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:25.967778 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:25.981393 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:25.984535 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864864b4-9714-482b-8f2f-be897aa04bec None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:26.021778 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b25fd-2a50-4b41-9303-011b1b5fb571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:26.022652 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b25fd-2a50-4b41-9303-011b1b5fb571 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:26.023099 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b25fd-2a50-4b41-9303-011b1b5fb571 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:26.023566 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b25fd-2a50-4b41-9303-011b1b5fb571 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:26.024398 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017b25fd-2a50-4b41-9303-011b1b5fb571 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:26.025999 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017b25fd-2a50-4b41-9303-011b1b5fb571 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:26.036053 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-017b25fd-2a50-4b41-9303-011b1b5fb571 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 01:17:26.036053 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:26.036053 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 01:17:26.036053 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 01:17:26.036053 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 01:17:26.036053 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 01:17:26.036053 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 01:17:26.036053 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:17:26.036053 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 01:17:26.036053 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:26.036053 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 01:17:26.036053 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:26.036053 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:26.036053 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:26.036053 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:26.036053 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:26.036053 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:26.037064 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:26.037064 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:26.037064 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:26.037064 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:26.037064 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:26.037064 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:26.037064 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 01:17:26.037064 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 01:17:26.037064 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 01:17:26.037064 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 01:17:26.037064 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:26.037064 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:26.037064 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:26.037064 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:26.037064 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:26.037064 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:26.037909 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:26.037909 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:26.037909 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:26.037909 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:26.037909 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:26.037909 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:26.037909 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:26.037909 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:26.037909 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:26.037909 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:26.037909 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 01:17:26.037909 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:17:26.037909 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 01:17:26.037909 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:26.040486 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 470/937] 10.222.0.60 () {56 vars in 1126 bytes} [Tue Aug 30 01:17:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:17:26.046491 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b25fd-2a50-4b41-9303-011b1b5fb571 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:26.051454 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e4599-4e14-4ebc-9ee7-9aa6cd67cf5e None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:26.096134 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4739d55f-9087-4803-92fe-8c88f2e8642b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:26.096739 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739d55f-9087-4803-92fe-8c88f2e8642b None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:26.097014 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739d55f-9087-4803-92fe-8c88f2e8642b None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:26.097338 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739d55f-9087-4803-92fe-8c88f2e8642b None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:26.098368 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4739d55f-9087-4803-92fe-8c88f2e8642b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:26.098667 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4739d55f-9087-4803-92fe-8c88f2e8642b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:26.102250 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4739d55f-9087-4803-92fe-8c88f2e8642b None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:26.109205 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 468/938] 10.222.0.60 () {56 vars in 1126 bytes} [Tue Aug 30 01:17:25 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:17:26.115982 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4739d55f-9087-4803-92fe-8c88f2e8642b None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:26.166917 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b25fd-2a50-4b41-9303-011b1b5fb571 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:26.209216 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9995b8b9-89dd-45ba-ad90-c291d56f7790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:26.210215 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995b8b9-89dd-45ba-ad90-c291d56f7790 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:26.210721 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995b8b9-89dd-45ba-ad90-c291d56f7790 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:26.211219 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995b8b9-89dd-45ba-ad90-c291d56f7790 None admin] PATH_INFO: `/v3/services` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:26.212081 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9995b8b9-89dd-45ba-ad90-c291d56f7790 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:26.212604 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9995b8b9-89dd-45ba-ad90-c291d56f7790 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:26.214180 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9995b8b9-89dd-45ba-ad90-c291d56f7790 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:26.224409 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 471/939] 10.222.0.60 () {56 vars in 1122 bytes} [Tue Aug 30 01:17:26 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:17:26.225604 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9995b8b9-89dd-45ba-ad90-c291d56f7790 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:26.251472 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4739d55f-9087-4803-92fe-8c88f2e8642b None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:26.252538 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:26.253515 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:26.294353 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235fa71a-4dd4-4a04-866f-b463302c3ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:26.294965 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235fa71a-4dd4-4a04-866f-b463302c3ee1 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:26.295243 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235fa71a-4dd4-4a04-866f-b463302c3ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:26.295559 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235fa71a-4dd4-4a04-866f-b463302c3ee1 None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:26.297620 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235fa71a-4dd4-4a04-866f-b463302c3ee1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:26.297620 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235fa71a-4dd4-4a04-866f-b463302c3ee1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:26.298326 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235fa71a-4dd4-4a04-866f-b463302c3ee1 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:26.310396 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 469/940] 10.222.0.60 () {56 vars in 1126 bytes} [Tue Aug 30 01:17:26 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:26.311243 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235fa71a-4dd4-4a04-866f-b463302c3ee1 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:26.360086 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9995b8b9-89dd-45ba-ad90-c291d56f7790 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:26.408876 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725889b5-d0fe-484b-bde3-e18edbec5e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:26.409490 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725889b5-d0fe-484b-bde3-e18edbec5e04 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:26.409766 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725889b5-d0fe-484b-bde3-e18edbec5e04 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:26.410035 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725889b5-d0fe-484b-bde3-e18edbec5e04 None admin] PATH_INFO: `/v3/services` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:26.410916 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725889b5-d0fe-484b-bde3-e18edbec5e04 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:26.411214 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725889b5-d0fe-484b-bde3-e18edbec5e04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:26.412990 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725889b5-d0fe-484b-bde3-e18edbec5e04 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:26.419218 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 472/941] 10.222.0.60 () {56 vars in 1122 bytes} [Tue Aug 30 01:17:26 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:26.427807 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725889b5-d0fe-484b-bde3-e18edbec5e04 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:26.433694 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235fa71a-4dd4-4a04-866f-b463302c3ee1 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:26.490811 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff483eb0-6344-4e80-bf2d-db1aff01d532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:26.492156 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff483eb0-6344-4e80-bf2d-db1aff01d532 None admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:26.492657 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff483eb0-6344-4e80-bf2d-db1aff01d532 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:26.493624 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff483eb0-6344-4e80-bf2d-db1aff01d532 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:26.494790 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff483eb0-6344-4e80-bf2d-db1aff01d532 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:26.497075 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff483eb0-6344-4e80-bf2d-db1aff01d532 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:26.526001 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 470/942] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:17:26 2022] POST /identity/v3/endpoints => generated 347 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:17:26.542175 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:26.562328 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725889b5-d0fe-484b-bde3-e18edbec5e04 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:26.609171 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc09c6f9-9117-4b57-a6d9-0c4f12d3c4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:26.609844 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09c6f9-9117-4b57-a6d9-0c4f12d3c4fa None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:26.610182 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09c6f9-9117-4b57-a6d9-0c4f12d3c4fa None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:26.610396 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09c6f9-9117-4b57-a6d9-0c4f12d3c4fa None admin] PATH_INFO: `/v3/endpoints` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:26.611177 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc09c6f9-9117-4b57-a6d9-0c4f12d3c4fa None admin] RBAC: Adding query filter params (interface=public, service_id=9e014d8ef0504be28eae582ba32bc0cd, region_id=RegionOne) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:26.611514 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc09c6f9-9117-4b57-a6d9-0c4f12d3c4fa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:26.613071 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc09c6f9-9117-4b57-a6d9-0c4f12d3c4fa None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:26.619412 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 473/943] 10.222.0.60 () {56 vars in 1251 bytes} [Tue Aug 30 01:17:26 2022] GET /identity/v3/endpoints?service_id=9e014d8ef0504be28eae582ba32bc0cd&interface=public®ion_id=RegionOne => generated 194 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:26.625163 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff483eb0-6344-4e80-bf2d-db1aff01d532 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:26.658148 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:26.742041 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff483eb0-6344-4e80-bf2d-db1aff01d532 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:26.778038 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150fe669-6d12-4b77-9092-9e981c0a16a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:26.778974 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150fe669-6d12-4b77-9092-9e981c0a16a4 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:26.779487 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150fe669-6d12-4b77-9092-9e981c0a16a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:26.779941 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150fe669-6d12-4b77-9092-9e981c0a16a4 None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:26.780741 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150fe669-6d12-4b77-9092-9e981c0a16a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:26.782292 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150fe669-6d12-4b77-9092-9e981c0a16a4 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:26.789247 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 471/944] 10.222.0.60 () {56 vars in 1087 bytes} [Tue Aug 30 01:17:26 2022] GET /identity/v3/services => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:17:27.260062 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea3fd05-f9e1-4c6a-894d-5546f744ad83 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:27.260575 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea3fd05-f9e1-4c6a-894d-5546f744ad83 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:27.260575 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea3fd05-f9e1-4c6a-894d-5546f744ad83 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:27.262193 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 474/945] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:17:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:17:27.267340 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c6e4d-3a93-4faf-8dca-929afc9e50fc None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:27.267778 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c6e4d-3a93-4faf-8dca-929afc9e50fc None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:27.267960 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c6e4d-3a93-4faf-8dca-929afc9e50fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:27.286933 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-e32c6e4d-3a93-4faf-8dca-929afc9e50fc None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:27.288191 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-e32c6e4d-3a93-4faf-8dca-929afc9e50fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:27.359566 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 472/946] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:17:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:17:27.628639 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea3fd05-f9e1-4c6a-894d-5546f744ad83 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:27.744411 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea3fd05-f9e1-4c6a-894d-5546f744ad83 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:27.779983 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7657b47-c39c-4376-b6a4-9400fd254469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:27.780596 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7657b47-c39c-4376-b6a4-9400fd254469 None admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:27.780876 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7657b47-c39c-4376-b6a4-9400fd254469 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:27.781149 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7657b47-c39c-4376-b6a4-9400fd254469 None admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:27.781814 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7657b47-c39c-4376-b6a4-9400fd254469 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:27.783853 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7657b47-c39c-4376-b6a4-9400fd254469 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:27.786437 dv-cinder-819668-6-smb devstack@keystone.service[81447]: WARNING keystone.server.flask.common [None req-e7657b47-c39c-4376-b6a4-9400fd254469 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 30 01:17:27.803410 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:27.805054 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.sql.core [None req-e7657b47-c39c-4376-b6a4-9400fd254469 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 30 01:17:27.805054 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 30 01:17:27.805054 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [parameters: {'id': '3255709851bd431abd5513592458e50c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 30 01:17:27.805054 dv-cinder-819668-6-smb devstack@keystone.service[81447]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81447) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 30 01:17:27.812166 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8ef07-9f18-41a8-a468-2a1872fd1bdd None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:27.812449 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8ef07-9f18-41a8-a468-2a1872fd1bdd None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:27.812803 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8ef07-9f18-41a8-a468-2a1872fd1bdd None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:27.817884 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 473/947] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:17:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:17:27.820272 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3cbb42-126c-4686-8678-8cf27688728c None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:27.820557 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3cbb42-126c-4686-8678-8cf27688728c None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:27.820832 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3cbb42-126c-4686-8678-8cf27688728c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:27.826391 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-e7657b47-c39c-4376-b6a4-9400fd254469 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3255709851bd431abd5513592458e50c.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3255709851bd431abd5513592458e50c. Aug 30 01:17:27.826391 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:27.826391 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 01:17:27.826391 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 01:17:27.826391 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 01:17:27.826391 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 01:17:27.826391 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 01:17:27.826391 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 01:17:27.826391 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 01:17:27.826391 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application conn.query(q) Aug 30 01:17:27.826391 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 01:17:27.826391 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 01:17:27.826391 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 01:17:27.827200 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application result.read() Aug 30 01:17:27.827200 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 01:17:27.827200 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 01:17:27.827200 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 01:17:27.827200 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 01:17:27.827200 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 01:17:27.827200 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 01:17:27.827200 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 01:17:27.827200 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 01:17:27.827200 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 30 01:17:27.827200 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:27.827200 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 30 01:17:27.827200 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:27.827200 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:27.827200 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 30 01:17:27.827200 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 30 01:17:27.827200 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 30 01:17:27.827200 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 30 01:17:27.828265 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 01:17:27.828265 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application next(self.gen) Aug 30 01:17:27.828265 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 30 01:17:27.828265 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application yield resource Aug 30 01:17:27.828265 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 01:17:27.828265 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application next(self.gen) Aug 30 01:17:27.828265 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 30 01:17:27.828265 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application self.session.rollback() Aug 30 01:17:27.828265 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 01:17:27.828265 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application self.force_reraise() Aug 30 01:17:27.828265 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 01:17:27.828265 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise self.value Aug 30 01:17:27.828265 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 30 01:17:27.828265 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 30 01:17:27.828265 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 30 01:17:27.828265 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application session.commit() Aug 30 01:17:27.828265 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 30 01:17:27.829176 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 30 01:17:27.829176 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 30 01:17:27.829176 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application self._prepare_impl() Aug 30 01:17:27.829176 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 30 01:17:27.829176 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application self.session.flush() Aug 30 01:17:27.829176 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 30 01:17:27.829176 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application self._flush(objects) Aug 30 01:17:27.829176 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 30 01:17:27.829176 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 30 01:17:27.829176 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 30 01:17:27.829176 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application compat.raise_( Aug 30 01:17:27.829176 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 01:17:27.829176 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception Aug 30 01:17:27.829176 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 30 01:17:27.829176 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application flush_context.execute() Aug 30 01:17:27.829176 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 30 01:17:27.829176 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rec.execute(self) Aug 30 01:17:27.835646 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 30 01:17:27.835646 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 30 01:17:27.835646 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 30 01:17:27.835646 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 30 01:17:27.835646 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 30 01:17:27.835646 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 30 01:17:27.835646 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 30 01:17:27.835646 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 30 01:17:27.835646 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 30 01:17:27.835646 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 30 01:17:27.835646 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 30 01:17:27.835646 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 30 01:17:27.835646 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 30 01:17:27.835646 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 30 01:17:27.835646 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 30 01:17:27.836668 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 30 01:17:27.836668 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 01:17:27.836668 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception Aug 30 01:17:27.836668 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 01:17:27.836668 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 01:17:27.836668 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 01:17:27.836668 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 01:17:27.836668 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 01:17:27.836668 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 01:17:27.836668 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 01:17:27.836668 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application conn.query(q) Aug 30 01:17:27.836668 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 01:17:27.836668 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 01:17:27.836668 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 01:17:27.836668 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application result.read() Aug 30 01:17:27.836668 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 01:17:27.836668 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 01:17:27.837594 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 01:17:27.837594 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 01:17:27.837594 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 01:17:27.837594 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 01:17:27.837594 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 01:17:27.837594 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 01:17:27.837594 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 30 01:17:27.837594 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 30 01:17:27.837594 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [parameters: {'id': '3255709851bd431abd5513592458e50c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 30 01:17:27.837594 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 30 01:17:27.837594 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:27.837594 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 01:17:27.837594 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:27.837594 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:27.837594 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 30 01:17:27.838621 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 30 01:17:27.838621 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 30 01:17:27.838621 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 30 01:17:27.838621 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 30 01:17:27.838621 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:27.838621 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 01:17:27.838621 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:27.838621 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:27.838621 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:27.838621 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:27.838621 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:27.838621 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:27.838621 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:27.838621 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:27.838621 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:27.838621 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:27.838621 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:27.839768 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:27.839768 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 30 01:17:27.839768 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 30 01:17:27.839768 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:27.839768 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:27.839768 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 30 01:17:27.839768 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 30 01:17:27.839768 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3255709851bd431abd5513592458e50c. Aug 30 01:17:27.839768 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:27.839768 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 475/948] 10.222.0.60 () {60 vars in 1140 bytes} [Tue Aug 30 01:17:27 2022] POST /identity/v3/projects => generated 262 bytes in 200 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:27.841188 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7657b47-c39c-4376-b6a4-9400fd254469 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:27.863525 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-cb3cbb42-126c-4686-8678-8cf27688728c None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:27.864653 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-cb3cbb42-126c-4686-8678-8cf27688728c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:27.884204 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:27.958884 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7657b47-c39c-4376-b6a4-9400fd254469 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:27.960826 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 474/949] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:17:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:17:28.004716 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c199f25-c8f8-400b-a757-5c6c31da5594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:28.005352 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c199f25-c8f8-400b-a757-5c6c31da5594 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:28.005637 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c199f25-c8f8-400b-a757-5c6c31da5594 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:28.005912 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c199f25-c8f8-400b-a757-5c6c31da5594 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:28.013076 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c199f25-c8f8-400b-a757-5c6c31da5594 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:28.014725 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c199f25-c8f8-400b-a757-5c6c31da5594 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:28.026859 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-4c199f25-c8f8-400b-a757-5c6c31da5594 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:17:28.026859 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:28.026859 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:28.026859 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:28.026859 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:28.026859 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:28.026859 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:28.026859 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:28.026859 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:28.026859 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:28.026859 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:28.026859 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:28.026859 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 01:17:28.026859 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 01:17:28.026859 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 01:17:28.027850 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 01:17:28.027850 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:28.027850 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:28.027850 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:28.027850 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:28.027850 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:28.027850 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:28.027850 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:28.027850 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:28.027850 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:28.027850 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:28.027850 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:28.027850 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:28.027850 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:28.027850 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:28.027850 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:28.027850 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:28.028739 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 01:17:28.028739 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 01:17:28.028739 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 01:17:28.028739 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 01:17:28.028739 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 01:17:28.028739 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 01:17:28.028739 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:17:28.028739 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:28.028739 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 476/950] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 30 01:17:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:28.034198 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3cbb42-126c-4686-8678-8cf27688728c None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:28.139626 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3cbb42-126c-4686-8678-8cf27688728c None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:28.174997 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463e5d8c-6b55-44a8-83d0-cb8cda426036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:28.175636 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e5d8c-6b55-44a8-83d0-cb8cda426036 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:28.175916 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e5d8c-6b55-44a8-83d0-cb8cda426036 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:28.176188 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e5d8c-6b55-44a8-83d0-cb8cda426036 None admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:28.176854 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463e5d8c-6b55-44a8-83d0-cb8cda426036 None admin] RBAC: Adding query filter params (name=service) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:28.177176 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463e5d8c-6b55-44a8-83d0-cb8cda426036 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:28.178584 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463e5d8c-6b55-44a8-83d0-cb8cda426036 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:28.197155 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 475/951] 10.222.0.60 () {56 vars in 1112 bytes} [Tue Aug 30 01:17:28 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:28.244292 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c199f25-c8f8-400b-a757-5c6c31da5594 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:28.315758 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:28.365892 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c199f25-c8f8-400b-a757-5c6c31da5594 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:28.402011 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20505fe6-1c76-4f38-adb3-5cca3d49f04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:28.402616 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20505fe6-1c76-4f38-adb3-5cca3d49f04b None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:28.402893 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20505fe6-1c76-4f38-adb3-5cca3d49f04b None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:28.403160 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20505fe6-1c76-4f38-adb3-5cca3d49f04b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:28.414642 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20505fe6-1c76-4f38-adb3-5cca3d49f04b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:17:28.419946 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-20505fe6-1c76-4f38-adb3-5cca3d49f04b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 01:17:28.419946 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:28.419946 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:28.419946 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:28.419946 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:28.419946 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:28.419946 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:28.419946 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:28.419946 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:28.419946 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:28.419946 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:28.419946 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:28.419946 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:17:28.419946 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:17:28.419946 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:17:28.419946 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:17:28.420926 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:17:28.420926 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:17:28.420926 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:17:28.420926 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:17:28.420926 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:28.420926 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:28.420926 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:28.420926 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:28.420926 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:28.420926 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:28.420926 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:28.420926 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:28.420926 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:28.420926 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:28.420926 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:28.420926 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:28.421770 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:28.421770 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:28.421770 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:28.421770 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:28.421770 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:17:28.421770 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:17:28.421770 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:17:28.421770 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:17:28.421770 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:17:28.421770 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:17:28.421770 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 01:17:28.421770 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:28.421770 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 477/952] 10.222.0.60 () {56 vars in 1120 bytes} [Tue Aug 30 01:17:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:28.427763 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463e5d8c-6b55-44a8-83d0-cb8cda426036 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:28.439760 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:28.551868 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463e5d8c-6b55-44a8-83d0-cb8cda426036 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:28.592167 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b81ad07-5eeb-4af2-b98b-e28c3b209c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:28.592796 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81ad07-5eeb-4af2-b98b-e28c3b209c6c None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:28.593078 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81ad07-5eeb-4af2-b98b-e28c3b209c6c None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:28.593350 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81ad07-5eeb-4af2-b98b-e28c3b209c6c None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:28.594031 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b81ad07-5eeb-4af2-b98b-e28c3b209c6c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:28.594333 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b81ad07-5eeb-4af2-b98b-e28c3b209c6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:28.596401 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b81ad07-5eeb-4af2-b98b-e28c3b209c6c None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:28.599298 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def6a1c9-2a27-4bc5-b9ea-7609e95f58c2 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:28.599614 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def6a1c9-2a27-4bc5-b9ea-7609e95f58c2 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:28.599886 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def6a1c9-2a27-4bc5-b9ea-7609e95f58c2 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:28.604420 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 478/953] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:17:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:17:28.605985 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 476/954] 10.222.0.60 () {56 vars in 1115 bytes} [Tue Aug 30 01:17:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:28.611611 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def6a1c9-2a27-4bc5-b9ea-7609e95f58c2 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:28.612247 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40cc8e0-a15b-40f5-af99-512caa77deaa None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:28.612545 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40cc8e0-a15b-40f5-af99-512caa77deaa None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:28.612819 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40cc8e0-a15b-40f5-af99-512caa77deaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:28.636826 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-f40cc8e0-a15b-40f5-af99-512caa77deaa None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:28.638481 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-f40cc8e0-a15b-40f5-af99-512caa77deaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:28.724243 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:28.727202 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def6a1c9-2a27-4bc5-b9ea-7609e95f58c2 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:28.736965 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 477/955] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:17:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:17:28.750639 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:28.767265 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a0b490-ca11-48e0-a9e5-e3730a4a3806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:28.768249 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0b490-ca11-48e0-a9e5-e3730a4a3806 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:28.768693 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0b490-ca11-48e0-a9e5-e3730a4a3806 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:28.769118 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0b490-ca11-48e0-a9e5-e3730a4a3806 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:28.779879 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a0b490-ca11-48e0-a9e5-e3730a4a3806 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:28.781950 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a0b490-ca11-48e0-a9e5-e3730a4a3806 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:28.782547 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4c4d2-f636-422d-8a6e-e39157c8f057 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:28.783422 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4c4d2-f636-422d-8a6e-e39157c8f057 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:28.784084 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4c4d2-f636-422d-8a6e-e39157c8f057 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:28.789212 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 478/956] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:17:28 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:17:28.790420 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79c200-9ee9-4415-ad9d-b2b51f23f2db None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:28.790703 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79c200-9ee9-4415-ad9d-b2b51f23f2db None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:28.790976 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79c200-9ee9-4415-ad9d-b2b51f23f2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:28.804784 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-98a0b490-ca11-48e0-a9e5-e3730a4a3806 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:17:28.804784 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:28.804784 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:28.804784 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:28.804784 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:28.804784 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:28.804784 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:28.804784 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:28.804784 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:28.804784 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:28.804784 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:28.804784 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:28.804784 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:17:28.804784 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:17:28.804784 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:17:28.804784 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:17:28.806146 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:28.806146 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:28.806146 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:28.806146 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:28.806146 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:28.806146 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:28.806146 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:28.806146 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:28.806146 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:28.806146 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:28.806146 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:28.806146 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:28.806146 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:28.806146 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:28.806146 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:28.806146 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:28.806146 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:17:28.807334 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:17:28.807334 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:17:28.807334 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:28.808960 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 479/957] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:17:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:28.817318 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a0b490-ca11-48e0-a9e5-e3730a4a3806 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:28.823207 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-2c79c200-9ee9-4415-ad9d-b2b51f23f2db None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:28.825035 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-2c79c200-9ee9-4415-ad9d-b2b51f23f2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:28.918802 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 479/958] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:17:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:17:28.926888 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a0b490-ca11-48e0-a9e5-e3730a4a3806 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:28.966535 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da1e48-81b0-4c78-9336-261bffebfe05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:28.967147 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da1e48-81b0-4c78-9336-261bffebfe05 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:28.967427 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da1e48-81b0-4c78-9336-261bffebfe05 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:28.967725 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da1e48-81b0-4c78-9336-261bffebfe05 None admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:28.968373 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60da1e48-81b0-4c78-9336-261bffebfe05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:28.968678 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60da1e48-81b0-4c78-9336-261bffebfe05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:28.970053 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60da1e48-81b0-4c78-9336-261bffebfe05 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:28.983474 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 480/959] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:17:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:17:28.988796 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79c200-9ee9-4415-ad9d-b2b51f23f2db None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:29.033473 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da1e48-81b0-4c78-9336-261bffebfe05 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:29.067339 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:29.111128 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79c200-9ee9-4415-ad9d-b2b51f23f2db None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:29.149132 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:29.150584 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da1e48-81b0-4c78-9336-261bffebfe05 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:29.156851 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5df9c2-ce01-46e4-af9b-03f0d610a969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:29.157807 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5df9c2-ce01-46e4-af9b-03f0d610a969 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:29.158781 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5df9c2-ce01-46e4-af9b-03f0d610a969 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:29.159236 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5df9c2-ce01-46e4-af9b-03f0d610a969 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:29.168808 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5df9c2-ce01-46e4-af9b-03f0d610a969 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:29.170972 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5df9c2-ce01-46e4-af9b-03f0d610a969 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:29.186627 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-0c5df9c2-ce01-46e4-af9b-03f0d610a969 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 01:17:29.186627 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:29.186627 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:29.186627 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:29.186627 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:29.186627 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:29.186627 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:29.186627 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:29.186627 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:29.186627 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:29.186627 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:29.186627 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:29.186627 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 01:17:29.186627 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 01:17:29.186627 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 01:17:29.186627 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 01:17:29.187984 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:29.187984 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:29.187984 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 01:17:29.187984 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:17:29.187984 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 01:17:29.187984 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:17:29.187984 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:29.187984 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:29.187984 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:29.187984 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:29.187984 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:29.187984 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:29.187984 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:29.187984 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:29.187984 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:29.187984 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:29.187984 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:29.187984 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:29.188985 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:29.188985 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:29.188985 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 01:17:29.188985 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 01:17:29.188985 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 01:17:29.188985 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 01:17:29.188985 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 01:17:29.188985 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 01:17:29.188985 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 01:17:29.188985 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:29.193774 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 480/960] 10.222.0.60 () {56 vars in 1117 bytes} [Tue Aug 30 01:17:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:29.194760 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5df9c2-ce01-46e4-af9b-03f0d610a969 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:29.197447 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a525c3c-8e61-4ec7-a97f-0bf8c0c164b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:29.198455 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a525c3c-8e61-4ec7-a97f-0bf8c0c164b0 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:29.199759 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a525c3c-8e61-4ec7-a97f-0bf8c0c164b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:29.200227 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a525c3c-8e61-4ec7-a97f-0bf8c0c164b0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:29.201016 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a525c3c-8e61-4ec7-a97f-0bf8c0c164b0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:29.202589 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a525c3c-8e61-4ec7-a97f-0bf8c0c164b0 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:29.214973 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-8a525c3c-8e61-4ec7-a97f-0bf8c0c164b0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 01:17:29.214973 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:29.214973 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 01:17:29.214973 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 01:17:29.214973 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 01:17:29.214973 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 01:17:29.214973 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 01:17:29.214973 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:17:29.214973 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 01:17:29.214973 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:29.214973 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 01:17:29.214973 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:29.214973 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:29.214973 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:29.214973 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:29.214973 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:29.214973 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:29.216390 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:29.216390 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:29.216390 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:29.216390 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:29.216390 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:29.216390 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:29.216390 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 01:17:29.216390 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 01:17:29.216390 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 01:17:29.216390 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 01:17:29.216390 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:29.216390 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:29.216390 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:29.216390 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:29.216390 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:29.216390 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:29.218666 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:29.218666 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:29.218666 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:29.218666 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:29.218666 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:29.218666 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:29.218666 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:29.218666 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:29.218666 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:29.218666 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:29.218666 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 01:17:29.218666 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:17:29.218666 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 01:17:29.218666 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:29.218666 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 481/961] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 30 01:17:29 2022] GET /identity/v3/services/compute => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:29.219566 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a525c3c-8e61-4ec7-a97f-0bf8c0c164b0 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:29.308952 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5df9c2-ce01-46e4-af9b-03f0d610a969 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:29.322995 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:29.329545 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a525c3c-8e61-4ec7-a97f-0bf8c0c164b0 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:29.345031 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dce7d6-057f-4d52-89f9-47a5a0613d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:29.345675 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dce7d6-057f-4d52-89f9-47a5a0613d90 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:29.345954 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dce7d6-057f-4d52-89f9-47a5a0613d90 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:29.346230 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dce7d6-057f-4d52-89f9-47a5a0613d90 None admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:29.346965 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dce7d6-057f-4d52-89f9-47a5a0613d90 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:29.347269 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dce7d6-057f-4d52-89f9-47a5a0613d90 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:29.348743 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dce7d6-057f-4d52-89f9-47a5a0613d90 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:29.365931 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 481/962] 10.222.0.60 () {56 vars in 1149 bytes} [Tue Aug 30 01:17:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:17:29.366908 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dce7d6-057f-4d52-89f9-47a5a0613d90 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:29.372230 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132c7974-05f3-462f-8fe9-6178da77a2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:29.372876 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c7974-05f3-462f-8fe9-6178da77a2f0 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:29.373156 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c7974-05f3-462f-8fe9-6178da77a2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:29.373427 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c7974-05f3-462f-8fe9-6178da77a2f0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:29.374005 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132c7974-05f3-462f-8fe9-6178da77a2f0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:29.375375 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132c7974-05f3-462f-8fe9-6178da77a2f0 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:29.389693 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-132c7974-05f3-462f-8fe9-6178da77a2f0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 01:17:29.389693 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:29.389693 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 01:17:29.389693 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 01:17:29.389693 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 01:17:29.389693 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 01:17:29.389693 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 01:17:29.389693 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:17:29.389693 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 01:17:29.389693 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:29.389693 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 01:17:29.389693 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:29.389693 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:29.389693 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:29.389693 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:29.389693 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:29.389693 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:29.390940 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:29.390940 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:29.390940 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:29.390940 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:29.390940 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:29.390940 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:29.390940 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 01:17:29.390940 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 01:17:29.390940 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 01:17:29.390940 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 01:17:29.390940 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:29.390940 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:29.390940 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:29.390940 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:29.390940 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:29.390940 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:29.392007 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:29.392007 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:29.392007 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:29.392007 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:29.392007 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:29.392007 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:29.392007 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:29.392007 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:29.392007 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:29.392007 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:29.392007 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 01:17:29.392007 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:17:29.392007 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 01:17:29.392007 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:29.392007 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 482/963] 10.222.0.60 () {56 vars in 1126 bytes} [Tue Aug 30 01:17:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:29.394192 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132c7974-05f3-462f-8fe9-6178da77a2f0 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:29.439895 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:29.492783 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dce7d6-057f-4d52-89f9-47a5a0613d90 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:29.498422 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132c7974-05f3-462f-8fe9-6178da77a2f0 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:29.530766 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0dceb0-b8a3-4b69-8459-724a48a0b9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:29.531372 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0dceb0-b8a3-4b69-8459-724a48a0b9f3 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:29.531685 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0dceb0-b8a3-4b69-8459-724a48a0b9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:29.531957 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0dceb0-b8a3-4b69-8459-724a48a0b9f3 None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:29.532586 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0dceb0-b8a3-4b69-8459-724a48a0b9f3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:29.532960 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0dceb0-b8a3-4b69-8459-724a48a0b9f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:29.534286 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0dceb0-b8a3-4b69-8459-724a48a0b9f3 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:29.535973 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f355438f-1a0c-4015-aa15-c0713bc31544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:29.536629 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f355438f-1a0c-4015-aa15-c0713bc31544 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:29.536984 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f355438f-1a0c-4015-aa15-c0713bc31544 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:29.537112 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f355438f-1a0c-4015-aa15-c0713bc31544 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:29.543647 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 482/964] 10.222.0.60 () {56 vars in 1112 bytes} [Tue Aug 30 01:17:29 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:29.543647 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0dceb0-b8a3-4b69-8459-724a48a0b9f3 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:29.571471 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:29.619311 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f355438f-1a0c-4015-aa15-c0713bc31544 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:29.621161 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f355438f-1a0c-4015-aa15-c0713bc31544 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:29.651833 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0dceb0-b8a3-4b69-8459-724a48a0b9f3 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:29.666028 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:29.687555 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3326d701-3ef4-457b-801d-801675276a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:29.688169 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326d701-3ef4-457b-801d-801675276a9d None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:29.688444 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326d701-3ef4-457b-801d-801675276a9d None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:29.688713 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326d701-3ef4-457b-801d-801675276a9d None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:29.689882 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3326d701-3ef4-457b-801d-801675276a9d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:29.690183 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3326d701-3ef4-457b-801d-801675276a9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:29.691572 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3326d701-3ef4-457b-801d-801675276a9d None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:29.700938 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 483/965] 10.222.0.60 () {56 vars in 1122 bytes} [Tue Aug 30 01:17:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:29.700938 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3326d701-3ef4-457b-801d-801675276a9d None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:29.729631 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 483/966] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 30 01:17:29 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 01:17:29.730477 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f355438f-1a0c-4015-aa15-c0713bc31544 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:29.792807 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:29.804704 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3326d701-3ef4-457b-801d-801675276a9d None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:29.842065 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db334b2-0cb2-472d-a760-be5f5c533306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:29.842602 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db334b2-0cb2-472d-a760-be5f5c533306 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:29.842875 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db334b2-0cb2-472d-a760-be5f5c533306 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:29.843146 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db334b2-0cb2-472d-a760-be5f5c533306 None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:29.843811 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db334b2-0cb2-472d-a760-be5f5c533306 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:29.844110 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db334b2-0cb2-472d-a760-be5f5c533306 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:29.845515 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db334b2-0cb2-472d-a760-be5f5c533306 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:29.848851 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f355438f-1a0c-4015-aa15-c0713bc31544 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:29.855689 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 484/967] 10.222.0.60 () {56 vars in 1112 bytes} [Tue Aug 30 01:17:29 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:29.855689 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db334b2-0cb2-472d-a760-be5f5c533306 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:29.900321 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f043307-8b8f-4e4d-94d0-c009a88db883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:29.901248 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f043307-8b8f-4e4d-94d0-c009a88db883 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:29.901676 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f043307-8b8f-4e4d-94d0-c009a88db883 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:29.902093 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f043307-8b8f-4e4d-94d0-c009a88db883 None admin] PATH_INFO: `/v3/services` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:29.902874 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f043307-8b8f-4e4d-94d0-c009a88db883 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:29.903322 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f043307-8b8f-4e4d-94d0-c009a88db883 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:29.904884 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f043307-8b8f-4e4d-94d0-c009a88db883 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:29.910711 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 484/968] 10.222.0.60 () {56 vars in 1122 bytes} [Tue Aug 30 01:17:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:29.916997 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f043307-8b8f-4e4d-94d0-c009a88db883 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:29.924332 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:30.007621 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db334b2-0cb2-472d-a760-be5f5c533306 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:30.033244 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f043307-8b8f-4e4d-94d0-c009a88db883 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:30.047521 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4927410-57d1-4db0-9a6f-4893d2e39f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:30.048160 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4927410-57d1-4db0-9a6f-4893d2e39f17 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:30.048975 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4927410-57d1-4db0-9a6f-4893d2e39f17 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:30.049249 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4927410-57d1-4db0-9a6f-4893d2e39f17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:30.061189 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:30.061482 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4927410-57d1-4db0-9a6f-4893d2e39f17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:30.064617 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4927410-57d1-4db0-9a6f-4893d2e39f17 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:30.077131 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c81a7-33d3-4e84-82b7-4ea729bd9a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:30.077755 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c81a7-33d3-4e84-82b7-4ea729bd9a6b None admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:30.078039 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c81a7-33d3-4e84-82b7-4ea729bd9a6b None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:30.078316 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c81a7-33d3-4e84-82b7-4ea729bd9a6b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:30.078993 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4c81a7-33d3-4e84-82b7-4ea729bd9a6b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:30.080481 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4c81a7-33d3-4e84-82b7-4ea729bd9a6b None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:30.085922 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-f4927410-57d1-4db0-9a6f-4893d2e39f17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:17:30.085922 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:30.085922 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:30.085922 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:30.085922 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:30.085922 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:30.085922 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:30.085922 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:30.085922 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:30.085922 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:30.085922 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:30.085922 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:30.085922 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:17:30.085922 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:17:30.085922 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:17:30.085922 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:17:30.086920 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:30.086920 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:30.086920 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:30.086920 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:30.086920 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:30.086920 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:30.086920 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:30.086920 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:30.086920 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:30.086920 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:30.086920 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:30.086920 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:30.086920 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:30.086920 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:30.086920 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:30.086920 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:30.086920 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:17:30.087901 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:17:30.087901 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:17:30.087901 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:30.093758 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 485/969] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:17:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:30.096916 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4927410-57d1-4db0-9a6f-4893d2e39f17 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:30.105933 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 485/970] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:17:29 2022] POST /identity/v3/endpoints => generated 349 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:17:30.216341 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:30.228069 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4927410-57d1-4db0-9a6f-4893d2e39f17 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:30.271643 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfaa777-0a9d-4ca7-8a05-4c45fc613772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:30.272261 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfaa777-0a9d-4ca7-8a05-4c45fc613772 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:30.272536 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfaa777-0a9d-4ca7-8a05-4c45fc613772 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:30.272802 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfaa777-0a9d-4ca7-8a05-4c45fc613772 None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:30.273441 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfaa777-0a9d-4ca7-8a05-4c45fc613772 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:30.273741 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfaa777-0a9d-4ca7-8a05-4c45fc613772 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:30.275112 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfaa777-0a9d-4ca7-8a05-4c45fc613772 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:30.281276 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66794178-93f3-4cca-9878-ea4333d0c510 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:30.281553 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66794178-93f3-4cca-9878-ea4333d0c510 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:30.281826 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66794178-93f3-4cca-9878-ea4333d0c510 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:30.284010 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 486/971] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:17:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:17:30.289041 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd56da-b247-4de6-82aa-78cedba2c151 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:30.289602 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd56da-b247-4de6-82aa-78cedba2c151 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:30.290083 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd56da-b247-4de6-82aa-78cedba2c151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:30.293592 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 486/972] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:17:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:17:30.294091 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfaa777-0a9d-4ca7-8a05-4c45fc613772 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:30.316051 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-3bfd56da-b247-4de6-82aa-78cedba2c151 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:30.317804 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-3bfd56da-b247-4de6-82aa-78cedba2c151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:30.402895 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 487/973] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:17:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:17:30.426415 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfaa777-0a9d-4ca7-8a05-4c45fc613772 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:30.463276 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8115cfda-6db8-4f25-89ac-32efd80dc89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:30.464737 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115cfda-6db8-4f25-89ac-32efd80dc89b None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:30.465493 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115cfda-6db8-4f25-89ac-32efd80dc89b None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:30.465971 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115cfda-6db8-4f25-89ac-32efd80dc89b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:30.473825 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8115cfda-6db8-4f25-89ac-32efd80dc89b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:30.475553 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8115cfda-6db8-4f25-89ac-32efd80dc89b None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:30.487572 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-8115cfda-6db8-4f25-89ac-32efd80dc89b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:17:30.487572 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:30.487572 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:30.487572 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:30.487572 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:30.487572 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:30.487572 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:30.487572 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:30.487572 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:30.487572 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:30.487572 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:30.487572 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:30.487572 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 01:17:30.487572 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 01:17:30.487572 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 01:17:30.488510 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 01:17:30.488510 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:30.488510 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:30.488510 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:30.488510 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:30.488510 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:30.488510 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:30.488510 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:30.488510 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:30.488510 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:30.488510 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:30.488510 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:30.488510 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:30.488510 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:30.488510 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:30.488510 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:30.488510 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:30.489453 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 01:17:30.489453 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 01:17:30.489453 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 01:17:30.489453 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 01:17:30.489453 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 01:17:30.489453 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 01:17:30.489453 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:17:30.489453 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:30.491824 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 487/974] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 30 01:17:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:17:30.502996 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfd56da-b247-4de6-82aa-78cedba2c151 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:30.604171 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfd56da-b247-4de6-82aa-78cedba2c151 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:30.616167 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:30.643154 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252da856-3bf2-44c2-95e5-3a1112890513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:30.643792 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252da856-3bf2-44c2-95e5-3a1112890513 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:30.644074 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252da856-3bf2-44c2-95e5-3a1112890513 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:30.644344 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252da856-3bf2-44c2-95e5-3a1112890513 None admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:30.645035 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252da856-3bf2-44c2-95e5-3a1112890513 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:30.645339 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252da856-3bf2-44c2-95e5-3a1112890513 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:30.646765 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252da856-3bf2-44c2-95e5-3a1112890513 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:30.663723 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 488/975] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 30 01:17:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:30.665687 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8115cfda-6db8-4f25-89ac-32efd80dc89b None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:30.679774 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:30.684032 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252da856-3bf2-44c2-95e5-3a1112890513 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:30.773962 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8115cfda-6db8-4f25-89ac-32efd80dc89b None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:30.789805 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252da856-3bf2-44c2-95e5-3a1112890513 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:30.811369 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787bbbfe-f29b-4b00-9b70-62743fcea9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:30.812017 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787bbbfe-f29b-4b00-9b70-62743fcea9bd None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:30.812531 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787bbbfe-f29b-4b00-9b70-62743fcea9bd None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:30.812803 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787bbbfe-f29b-4b00-9b70-62743fcea9bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:30.813527 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787bbbfe-f29b-4b00-9b70-62743fcea9bd None admin] RBAC: Adding query filter params (role.id=3cf30b69be074b7bade51cb0dc428655, scope.project.id=b050b2dad22a4a06875072e44c8c9824, user.id=edc11f8a9c5843939ec230e63ca7fa3b) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:30.813825 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787bbbfe-f29b-4b00-9b70-62743fcea9bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:30.816140 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787bbbfe-f29b-4b00-9b70-62743fcea9bd None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:30.822897 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 488/976] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 30 01:17:30 2022] GET /identity/v3/role_assignments?user.id=edc11f8a9c5843939ec230e63ca7fa3b&scope.project.id=b050b2dad22a4a06875072e44c8c9824&role.id=3cf30b69be074b7bade51cb0dc428655 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:30.836348 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e9c22-ff82-4f8e-83b6-a7c05f9295fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:30.837029 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e9c22-ff82-4f8e-83b6-a7c05f9295fd None admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:30.837355 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e9c22-ff82-4f8e-83b6-a7c05f9295fd None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:30.837631 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e9c22-ff82-4f8e-83b6-a7c05f9295fd None admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:30.838298 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318e9c22-ff82-4f8e-83b6-a7c05f9295fd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:30.839863 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318e9c22-ff82-4f8e-83b6-a7c05f9295fd None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:30.858982 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.sql.core [None req-318e9c22-ff82-4f8e-83b6-a7c05f9295fd None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 30 01:17:30.858982 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 30 01:17:30.858982 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [parameters: {'user_id': '475e41bed0674fd8932cd060aed5cb86', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 30 01:17:30.858982 dv-cinder-819668-6-smb devstack@keystone.service[81447]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81447) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 30 01:17:30.869139 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-318e9c22-ff82-4f8e-83b6-a7c05f9295fd None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 30 01:17:30.869139 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:30.869139 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 01:17:30.869139 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 01:17:30.869139 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 01:17:30.869139 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 01:17:30.869139 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 01:17:30.869139 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 01:17:30.869139 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 01:17:30.869139 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application conn.query(q) Aug 30 01:17:30.869139 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 01:17:30.869139 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 01:17:30.869139 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 01:17:30.869139 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application result.read() Aug 30 01:17:30.869139 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 01:17:30.870099 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 01:17:30.870099 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 01:17:30.870099 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 01:17:30.870099 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 01:17:30.870099 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 01:17:30.870099 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 01:17:30.870099 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 01:17:30.870099 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 30 01:17:30.870099 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:30.870099 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 30 01:17:30.870099 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:30.870099 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:30.870099 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 30 01:17:30.870099 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 30 01:17:30.870099 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 30 01:17:30.870099 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 30 01:17:30.870099 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 01:17:30.870099 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application next(self.gen) Aug 30 01:17:30.871543 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 30 01:17:30.871543 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application yield resource Aug 30 01:17:30.871543 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 01:17:30.871543 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application next(self.gen) Aug 30 01:17:30.871543 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 30 01:17:30.871543 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application self.session.rollback() Aug 30 01:17:30.871543 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 01:17:30.871543 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application self.force_reraise() Aug 30 01:17:30.871543 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 01:17:30.871543 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise self.value Aug 30 01:17:30.871543 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 30 01:17:30.871543 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 30 01:17:30.871543 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 30 01:17:30.871543 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application session.commit() Aug 30 01:17:30.871543 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 30 01:17:30.871543 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 30 01:17:30.871543 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 30 01:17:30.872675 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application self._prepare_impl() Aug 30 01:17:30.872675 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 30 01:17:30.872675 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application self.session.flush() Aug 30 01:17:30.872675 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 30 01:17:30.872675 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application self._flush(objects) Aug 30 01:17:30.872675 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 30 01:17:30.872675 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 30 01:17:30.872675 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 30 01:17:30.872675 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application compat.raise_( Aug 30 01:17:30.872675 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 01:17:30.872675 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception Aug 30 01:17:30.872675 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 30 01:17:30.872675 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application flush_context.execute() Aug 30 01:17:30.872675 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 30 01:17:30.872675 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rec.execute(self) Aug 30 01:17:30.872675 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 30 01:17:30.872675 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 30 01:17:30.873597 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 30 01:17:30.873597 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 30 01:17:30.873597 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 30 01:17:30.873597 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 30 01:17:30.873597 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 30 01:17:30.873597 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 30 01:17:30.873597 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 30 01:17:30.873597 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 30 01:17:30.873597 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 30 01:17:30.873597 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 30 01:17:30.873597 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 30 01:17:30.873597 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 30 01:17:30.873597 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 30 01:17:30.873597 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 30 01:17:30.873597 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 01:17:30.873597 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception Aug 30 01:17:30.874448 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 01:17:30.874448 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 01:17:30.874448 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 01:17:30.874448 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 01:17:30.874448 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 01:17:30.874448 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 01:17:30.874448 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 01:17:30.874448 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application conn.query(q) Aug 30 01:17:30.874448 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 01:17:30.874448 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 01:17:30.874448 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 01:17:30.874448 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application result.read() Aug 30 01:17:30.874448 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 01:17:30.874448 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 01:17:30.874448 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 01:17:30.874448 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 01:17:30.875290 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 01:17:30.875290 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 01:17:30.875290 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 01:17:30.875290 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 01:17:30.875290 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 30 01:17:30.875290 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 30 01:17:30.875290 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [parameters: {'user_id': '475e41bed0674fd8932cd060aed5cb86', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 30 01:17:30.875290 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 30 01:17:30.875290 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:30.875290 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 01:17:30.875290 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:30.875290 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:30.875290 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:30.875290 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:30.875290 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:30.878171 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:30.878171 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:30.878171 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:30.878171 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:30.878171 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:30.878171 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:30.878171 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:30.878171 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 30 01:17:30.878171 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 30 01:17:30.878171 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:30.878171 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:30.878171 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 01:17:30.878171 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:17:30.878171 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 01:17:30.878171 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:17:30.878171 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 30 01:17:30.878171 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 30 01:17:30.880304 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 30 01:17:30.880304 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 30 01:17:30.880304 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 30 01:17:30.880304 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 30 01:17:30.880304 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 30 01:17:30.880304 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:30.880304 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 489/977] 10.222.0.60 () {60 vars in 1131 bytes} [Tue Aug 30 01:17:30 2022] POST /identity/v3/users => generated 160 bytes in 187 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:17:30.880794 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787bbbfe-f29b-4b00-9b70-62743fcea9bd None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:30.970859 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:31.004745 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787bbbfe-f29b-4b00-9b70-62743fcea9bd None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:31.042815 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4b8bd2-3cc6-4a32-acdf-07124e898a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:31.043479 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b8bd2-3cc6-4a32-acdf-07124e898a06 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:31.043751 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b8bd2-3cc6-4a32-acdf-07124e898a06 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:31.044020 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b8bd2-3cc6-4a32-acdf-07124e898a06 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:31.052423 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4b8bd2-3cc6-4a32-acdf-07124e898a06 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:31.053808 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4b8bd2-3cc6-4a32-acdf-07124e898a06 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:31.066347 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-5f4b8bd2-3cc6-4a32-acdf-07124e898a06 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 01:17:31.066347 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:31.066347 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:31.066347 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:31.066347 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:31.066347 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:31.066347 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:31.066347 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:31.066347 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:31.066347 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:31.066347 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:31.066347 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:31.066347 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 01:17:31.066347 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 01:17:31.066347 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 01:17:31.066347 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 01:17:31.068729 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:31.068729 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:31.068729 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 01:17:31.068729 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:17:31.068729 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 01:17:31.068729 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:17:31.068729 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:31.068729 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:31.068729 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:31.068729 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:31.068729 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:31.068729 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:31.068729 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:31.068729 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:31.068729 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:31.068729 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:31.068729 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:31.068729 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:31.070980 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:31.070980 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:31.070980 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 01:17:31.070980 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 01:17:31.070980 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 01:17:31.070980 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 01:17:31.070980 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 01:17:31.070980 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 01:17:31.070980 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 01:17:31.070980 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:31.070980 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 489/978] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 30 01:17:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:31.073514 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e9c22-ff82-4f8e-83b6-a7c05f9295fd None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:31.110485 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:31.189499 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e9c22-ff82-4f8e-83b6-a7c05f9295fd None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:31.225523 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f645c9-949c-465d-b07c-c5209c108720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:31.226051 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f645c9-949c-465d-b07c-c5209c108720 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:31.226326 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f645c9-949c-465d-b07c-c5209c108720 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:31.226596 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f645c9-949c-465d-b07c-c5209c108720 None admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:31.227291 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f645c9-949c-465d-b07c-c5209c108720 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:31.227623 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f645c9-949c-465d-b07c-c5209c108720 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:31.229245 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f645c9-949c-465d-b07c-c5209c108720 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:31.268793 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 490/979] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Aug 30 01:17:31 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:31.867073 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d660ad-0c62-4efd-b862-6b801f5b925f None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:31.867810 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d660ad-0c62-4efd-b862-6b801f5b925f None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:31.867810 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d660ad-0c62-4efd-b862-6b801f5b925f None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:31.869044 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 490/980] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:17:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:17:31.874025 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a27971-846e-4125-8121-c988db2ff857 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:31.874499 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a27971-846e-4125-8121-c988db2ff857 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:31.874666 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a27971-846e-4125-8121-c988db2ff857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:31.894249 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-94a27971-846e-4125-8121-c988db2ff857 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:31.895772 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-94a27971-846e-4125-8121-c988db2ff857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:31.963959 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 491/981] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:17:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:17:32.195948 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6f075-a082-4dfe-8905-6bcc31f320b6 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:32.196313 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6f075-a082-4dfe-8905-6bcc31f320b6 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:32.196550 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6f075-a082-4dfe-8905-6bcc31f320b6 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:32.197956 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 491/982] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:17:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:17:32.202872 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b559c1d-a372-4302-bd78-9942ee85f916 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:32.203166 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b559c1d-a372-4302-bd78-9942ee85f916 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:32.203455 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b559c1d-a372-4302-bd78-9942ee85f916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:32.221399 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-4b559c1d-a372-4302-bd78-9942ee85f916 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:32.222568 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-4b559c1d-a372-4302-bd78-9942ee85f916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:32.232169 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb6f075-a082-4dfe-8905-6bcc31f320b6 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:32.238967 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:32.295888 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 492/983] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:17:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:17:32.347678 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb6f075-a082-4dfe-8905-6bcc31f320b6 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:32.385045 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:32.391346 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c7ec10-fb14-4e2a-af38-4bbf26877387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:32.391999 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7ec10-fb14-4e2a-af38-4bbf26877387 None admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:32.392286 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7ec10-fb14-4e2a-af38-4bbf26877387 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:32.392563 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7ec10-fb14-4e2a-af38-4bbf26877387 None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:32.393243 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c7ec10-fb14-4e2a-af38-4bbf26877387 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:32.394620 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c7ec10-fb14-4e2a-af38-4bbf26877387 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:32.417534 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 492/984] 10.222.0.60 () {60 vars in 1141 bytes} [Tue Aug 30 01:17:32 2022] POST /identity/v3/services => generated 242 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:17:32.571417 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b559c1d-a372-4302-bd78-9942ee85f916 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:32.684248 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b559c1d-a372-4302-bd78-9942ee85f916 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:32.725764 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c2e59c-f1ec-43ac-9de1-dd3bd4210e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:32.726396 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2e59c-f1ec-43ac-9de1-dd3bd4210e99 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:32.726670 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2e59c-f1ec-43ac-9de1-dd3bd4210e99 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:32.726934 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2e59c-f1ec-43ac-9de1-dd3bd4210e99 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:32.727549 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c2e59c-f1ec-43ac-9de1-dd3bd4210e99 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:32.728924 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c2e59c-f1ec-43ac-9de1-dd3bd4210e99 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:32.737848 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-15c2e59c-f1ec-43ac-9de1-dd3bd4210e99 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 01:17:32.737848 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:32.737848 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 01:17:32.737848 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 01:17:32.737848 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 01:17:32.737848 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 01:17:32.737848 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 01:17:32.737848 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:17:32.737848 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 01:17:32.737848 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:32.737848 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 01:17:32.737848 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:32.737848 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:32.737848 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:32.737848 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:32.737848 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:32.737848 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:32.738861 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:32.738861 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:32.738861 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:32.738861 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:32.738861 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:32.738861 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:32.738861 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 01:17:32.738861 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 01:17:32.738861 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 01:17:32.738861 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 01:17:32.738861 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:32.738861 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:32.738861 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:32.738861 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:32.738861 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:32.738861 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:32.739752 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:32.739752 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:32.739752 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:32.739752 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:32.739752 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:32.739752 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:32.739752 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:32.739752 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:32.739752 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:32.739752 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:32.739752 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 01:17:32.739752 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:17:32.739752 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 01:17:32.739752 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:32.739752 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 493/985] 10.222.0.60 () {56 vars in 1126 bytes} [Tue Aug 30 01:17:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:32.745283 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c7ec10-fb14-4e2a-af38-4bbf26877387 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:32.852012 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c7ec10-fb14-4e2a-af38-4bbf26877387 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:32.885909 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4846acf9-39e2-4bc4-bb87-7646aa277309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:32.886567 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846acf9-39e2-4bc4-bb87-7646aa277309 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:32.886794 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846acf9-39e2-4bc4-bb87-7646aa277309 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:32.887057 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846acf9-39e2-4bc4-bb87-7646aa277309 None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:32.887712 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4846acf9-39e2-4bc4-bb87-7646aa277309 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:32.888014 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4846acf9-39e2-4bc4-bb87-7646aa277309 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:32.889391 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4846acf9-39e2-4bc4-bb87-7646aa277309 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:32.895797 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 493/986] 10.222.0.60 () {56 vars in 1122 bytes} [Tue Aug 30 01:17:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:32.900465 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c2e59c-f1ec-43ac-9de1-dd3bd4210e99 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:32.906979 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93b390-871a-4c18-bc4c-5736ad97dad6 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:32.907263 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93b390-871a-4c18-bc4c-5736ad97dad6 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:32.907607 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93b390-871a-4c18-bc4c-5736ad97dad6 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:32.909591 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 494/987] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:17:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:17:32.914476 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:32.914747 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb282f-9bcc-4a54-a21a-dd45a8432557 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:32.915042 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb282f-9bcc-4a54-a21a-dd45a8432557 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:32.915294 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb282f-9bcc-4a54-a21a-dd45a8432557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:32.933386 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-74fb282f-9bcc-4a54-a21a-dd45a8432557 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:32.934699 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-74fb282f-9bcc-4a54-a21a-dd45a8432557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:32.989695 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:33.009780 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 495/988] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:17:32 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 01:17:33.013622 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c2e59c-f1ec-43ac-9de1-dd3bd4210e99 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:33.048833 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eab095-1d50-4212-b53e-9a45566b5ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:33.049440 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eab095-1d50-4212-b53e-9a45566b5ece None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:33.049717 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eab095-1d50-4212-b53e-9a45566b5ece None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:33.049987 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eab095-1d50-4212-b53e-9a45566b5ece None admin] PATH_INFO: `/v3/services` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:33.050608 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eab095-1d50-4212-b53e-9a45566b5ece None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:33.050908 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eab095-1d50-4212-b53e-9a45566b5ece None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:33.052553 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eab095-1d50-4212-b53e-9a45566b5ece None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:33.057702 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 494/989] 10.222.0.60 () {56 vars in 1122 bytes} [Tue Aug 30 01:17:32 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:33.063312 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fb282f-9bcc-4a54-a21a-dd45a8432557 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:33.164529 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fb282f-9bcc-4a54-a21a-dd45a8432557 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:33.200260 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8693fe-8d41-4e22-86ae-f906be992555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:33.200862 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8693fe-8d41-4e22-86ae-f906be992555 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:33.201141 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8693fe-8d41-4e22-86ae-f906be992555 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:33.201412 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8693fe-8d41-4e22-86ae-f906be992555 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:33.202122 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8693fe-8d41-4e22-86ae-f906be992555 None admin] RBAC: Adding query filter params (interface=admin, service_id=9e014d8ef0504be28eae582ba32bc0cd, region_id=RegionOne) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:33.202430 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8693fe-8d41-4e22-86ae-f906be992555 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:33.203830 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8693fe-8d41-4e22-86ae-f906be992555 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:33.209516 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 496/990] 10.222.0.60 () {56 vars in 1249 bytes} [Tue Aug 30 01:17:33 2022] GET /identity/v3/endpoints?service_id=9e014d8ef0504be28eae582ba32bc0cd&interface=admin®ion_id=RegionOne => generated 193 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:33.214884 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eab095-1d50-4212-b53e-9a45566b5ece None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:33.282621 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8693fe-8d41-4e22-86ae-f906be992555 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:33.291113 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:33.319381 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eab095-1d50-4212-b53e-9a45566b5ece None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:33.336214 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:33.355819 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ee93c5-af3a-4381-bbb5-83525bf66256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:33.356577 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee93c5-af3a-4381-bbb5-83525bf66256 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:33.356859 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee93c5-af3a-4381-bbb5-83525bf66256 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:33.357117 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee93c5-af3a-4381-bbb5-83525bf66256 None admin] PATH_INFO: `/v3/services` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:33.358464 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ee93c5-af3a-4381-bbb5-83525bf66256 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:33.359848 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ee93c5-af3a-4381-bbb5-83525bf66256 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:33.379462 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 495/991] 10.222.0.60 () {56 vars in 1087 bytes} [Tue Aug 30 01:17:33 2022] GET /identity/v3/services => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:17:33.390883 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8693fe-8d41-4e22-86ae-f906be992555 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:33.431952 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b605d0-dacc-46f7-aac9-d85028bb792a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:33.432518 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b605d0-dacc-46f7-aac9-d85028bb792a None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:33.432799 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b605d0-dacc-46f7-aac9-d85028bb792a None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:33.433070 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b605d0-dacc-46f7-aac9-d85028bb792a None admin] PATH_INFO: `/v3/services/image` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:33.433667 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b605d0-dacc-46f7-aac9-d85028bb792a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:33.435071 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b605d0-dacc-46f7-aac9-d85028bb792a None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:33.444806 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-e3b605d0-dacc-46f7-aac9-d85028bb792a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 01:17:33.444806 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:33.444806 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 01:17:33.444806 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 01:17:33.444806 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 01:17:33.444806 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 01:17:33.444806 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 01:17:33.444806 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:17:33.444806 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 01:17:33.444806 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:33.444806 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 01:17:33.444806 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:33.444806 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:33.444806 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:33.444806 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:33.444806 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:33.444806 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:33.445910 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:33.445910 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:33.445910 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:33.445910 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:33.445910 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:33.445910 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:33.445910 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 01:17:33.445910 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 01:17:33.445910 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 01:17:33.445910 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 01:17:33.445910 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:33.445910 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:33.445910 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:33.445910 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:33.445910 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:33.445910 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:33.448524 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:33.448524 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:33.448524 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:33.448524 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:33.448524 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:33.448524 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:33.448524 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:33.448524 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:33.448524 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:33.448524 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:33.448524 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 01:17:33.448524 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:17:33.448524 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 01:17:33.448524 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:33.448524 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 497/992] 10.222.0.60 () {56 vars in 1105 bytes} [Tue Aug 30 01:17:33 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:17:33.452087 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ee93c5-af3a-4381-bbb5-83525bf66256 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:33.561530 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ee93c5-af3a-4381-bbb5-83525bf66256 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:33.608328 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3407a550-d621-4fd1-a3ba-68f93d959517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:33.608945 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407a550-d621-4fd1-a3ba-68f93d959517 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:33.609224 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407a550-d621-4fd1-a3ba-68f93d959517 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:33.609495 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407a550-d621-4fd1-a3ba-68f93d959517 None admin] PATH_INFO: `/v3/services` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:33.610123 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3407a550-d621-4fd1-a3ba-68f93d959517 None admin] RBAC: Adding query filter params (name=image) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:33.610421 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3407a550-d621-4fd1-a3ba-68f93d959517 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:33.611865 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3407a550-d621-4fd1-a3ba-68f93d959517 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:33.621097 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 496/993] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:17:33 2022] GET /identity/v3/services?name=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:17:33.622319 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b605d0-dacc-46f7-aac9-d85028bb792a None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:33.727407 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b605d0-dacc-46f7-aac9-d85028bb792a None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:33.741298 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:33.762075 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b94db58-d240-43b6-9fcf-5d3a66181e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:33.762679 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94db58-d240-43b6-9fcf-5d3a66181e1c None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:33.762953 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94db58-d240-43b6-9fcf-5d3a66181e1c None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:33.763221 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94db58-d240-43b6-9fcf-5d3a66181e1c None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:33.763866 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b94db58-d240-43b6-9fcf-5d3a66181e1c None admin] RBAC: Adding query filter params (type=image) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:33.764171 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b94db58-d240-43b6-9fcf-5d3a66181e1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:33.765522 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b94db58-d240-43b6-9fcf-5d3a66181e1c None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:33.770652 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 498/994] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:17:33 2022] GET /identity/v3/services?type=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:34.372422 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512fc7b7-a21f-4028-b9b2-054f8978bb07 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:34.372941 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512fc7b7-a21f-4028-b9b2-054f8978bb07 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:34.372941 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512fc7b7-a21f-4028-b9b2-054f8978bb07 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:34.374350 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 497/995] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:17:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:17:34.380187 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55bca2-8c18-4cd4-8f0e-a10690121f45 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:34.380651 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55bca2-8c18-4cd4-8f0e-a10690121f45 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:34.380727 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55bca2-8c18-4cd4-8f0e-a10690121f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:34.398759 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-3a55bca2-8c18-4cd4-8f0e-a10690121f45 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:34.399978 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-3a55bca2-8c18-4cd4-8f0e-a10690121f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:34.471587 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 499/996] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:17:34 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:17:34.739067 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512fc7b7-a21f-4028-b9b2-054f8978bb07 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:34.742597 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:34.851239 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512fc7b7-a21f-4028-b9b2-054f8978bb07 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:34.886642 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd14d0b1-b671-4a85-aa18-8b065552c0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:34.887314 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14d0b1-b671-4a85-aa18-8b065552c0dc None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:34.887622 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14d0b1-b671-4a85-aa18-8b065552c0dc None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:34.887894 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14d0b1-b671-4a85-aa18-8b065552c0dc None admin] PATH_INFO: `/v3/services/compute` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:34.888483 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd14d0b1-b671-4a85-aa18-8b065552c0dc None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:34.889865 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd14d0b1-b671-4a85-aa18-8b065552c0dc None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:34.898797 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-cd14d0b1-b671-4a85-aa18-8b065552c0dc None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 01:17:34.898797 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:34.898797 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 01:17:34.898797 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 01:17:34.898797 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 01:17:34.898797 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 01:17:34.898797 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 01:17:34.898797 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:17:34.898797 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 01:17:34.898797 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:34.898797 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 01:17:34.898797 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:34.898797 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:34.898797 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:34.898797 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:34.898797 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:34.898797 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:34.900034 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:34.900034 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:34.900034 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:34.900034 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:34.900034 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:34.900034 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:34.900034 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 01:17:34.900034 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 01:17:34.900034 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 01:17:34.900034 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 01:17:34.900034 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:34.900034 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:34.900034 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:34.900034 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:34.900034 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:34.900034 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:34.901135 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:34.901135 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:34.901135 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:34.901135 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:34.901135 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:34.901135 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:34.901135 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:34.901135 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:34.901135 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:34.901135 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:34.901135 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 01:17:34.901135 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:17:34.901135 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 01:17:34.901135 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:34.901135 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 498/997] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 30 01:17:34 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:34.905883 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55bca2-8c18-4cd4-8f0e-a10690121f45 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:35.005973 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55bca2-8c18-4cd4-8f0e-a10690121f45 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:35.015098 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:35.041298 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127eb126-f1d2-4a8a-a000-ee7319bc9e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:35.041900 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127eb126-f1d2-4a8a-a000-ee7319bc9e0b None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:35.042181 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127eb126-f1d2-4a8a-a000-ee7319bc9e0b None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:35.042451 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127eb126-f1d2-4a8a-a000-ee7319bc9e0b None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:35.043074 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127eb126-f1d2-4a8a-a000-ee7319bc9e0b None admin] RBAC: Adding query filter params (name=compute) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:35.043377 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127eb126-f1d2-4a8a-a000-ee7319bc9e0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:35.044776 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127eb126-f1d2-4a8a-a000-ee7319bc9e0b None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:35.050011 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 500/998] 10.222.0.60 () {56 vars in 1112 bytes} [Tue Aug 30 01:17:34 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:35.055672 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd14d0b1-b671-4a85-aa18-8b065552c0dc None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:35.124912 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:35.162595 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd14d0b1-b671-4a85-aa18-8b065552c0dc None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:35.196555 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c6bfe7-a9ea-4df9-ad11-6cd2ec3ae010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:35.197164 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c6bfe7-a9ea-4df9-ad11-6cd2ec3ae010 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:35.197444 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c6bfe7-a9ea-4df9-ad11-6cd2ec3ae010 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:35.197715 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c6bfe7-a9ea-4df9-ad11-6cd2ec3ae010 None admin] PATH_INFO: `/v3/services` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:35.198344 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c6bfe7-a9ea-4df9-ad11-6cd2ec3ae010 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:35.198705 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c6bfe7-a9ea-4df9-ad11-6cd2ec3ae010 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:35.200104 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c6bfe7-a9ea-4df9-ad11-6cd2ec3ae010 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:35.205895 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 499/999] 10.222.0.60 () {56 vars in 1112 bytes} [Tue Aug 30 01:17:35 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:35.211488 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127eb126-f1d2-4a8a-a000-ee7319bc9e0b None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:35.312843 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a9be3-4e6a-4c47-843b-8f5d29d2e0c8 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:35.313176 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a9be3-4e6a-4c47-843b-8f5d29d2e0c8 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:35.313360 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a9be3-4e6a-4c47-843b-8f5d29d2e0c8 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:35.315506 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 500/1000] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:17:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:17:35.320814 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8c154-b79e-4357-9abb-c81b55b70891 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:35.321096 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8c154-b79e-4357-9abb-c81b55b70891 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:35.321367 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8c154-b79e-4357-9abb-c81b55b70891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:35.334344 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127eb126-f1d2-4a8a-a000-ee7319bc9e0b None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:35.343883 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-b2f8c154-b79e-4357-9abb-c81b55b70891 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:35.345102 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-b2f8c154-b79e-4357-9abb-c81b55b70891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:35.369380 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38c2cde-1a79-4d08-84e2-432ddea1f26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:35.369994 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38c2cde-1a79-4d08-84e2-432ddea1f26d None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:35.370276 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38c2cde-1a79-4d08-84e2-432ddea1f26d None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:35.370550 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38c2cde-1a79-4d08-84e2-432ddea1f26d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:35.371251 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38c2cde-1a79-4d08-84e2-432ddea1f26d None admin] RBAC: Adding query filter params (interface=public, service_id=73f5ddf1d6524e2daa0d0f746cbffa45, region_id=RegionOne) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:35.371607 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38c2cde-1a79-4d08-84e2-432ddea1f26d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:35.372978 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38c2cde-1a79-4d08-84e2-432ddea1f26d None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:35.378502 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 501/1001] 10.222.0.60 () {56 vars in 1251 bytes} [Tue Aug 30 01:17:35 2022] GET /identity/v3/endpoints?service_id=73f5ddf1d6524e2daa0d0f746cbffa45&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:35.384022 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38c2cde-1a79-4d08-84e2-432ddea1f26d None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:35.420162 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:35.423773 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 501/1002] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:17:35 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 01:17:35.487485 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38c2cde-1a79-4d08-84e2-432ddea1f26d None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:35.522983 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d918c6eb-b7a7-4b43-a2f2-bdc6368c141b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:35.523628 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d918c6eb-b7a7-4b43-a2f2-bdc6368c141b None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:35.523910 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d918c6eb-b7a7-4b43-a2f2-bdc6368c141b None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:35.524179 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d918c6eb-b7a7-4b43-a2f2-bdc6368c141b None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:35.524782 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d918c6eb-b7a7-4b43-a2f2-bdc6368c141b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:35.526156 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d918c6eb-b7a7-4b43-a2f2-bdc6368c141b None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:35.532610 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 502/1003] 10.222.0.60 () {56 vars in 1087 bytes} [Tue Aug 30 01:17:35 2022] GET /identity/v3/services => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:17:35.694602 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f8c154-b79e-4357-9abb-c81b55b70891 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:35.752248 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b044c1-6593-4782-b18e-5551f3941c20 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:35.752583 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b044c1-6593-4782-b18e-5551f3941c20 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:35.752802 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b044c1-6593-4782-b18e-5551f3941c20 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:35.754268 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 503/1004] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:17:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:17:35.759012 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403bbd39-b9ac-4e3d-95ac-557b0ea08dc1 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:35.759297 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403bbd39-b9ac-4e3d-95ac-557b0ea08dc1 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:35.759600 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403bbd39-b9ac-4e3d-95ac-557b0ea08dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:35.765153 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:35.787355 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-403bbd39-b9ac-4e3d-95ac-557b0ea08dc1 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:35.788627 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-403bbd39-b9ac-4e3d-95ac-557b0ea08dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:35.809796 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f8c154-b79e-4357-9abb-c81b55b70891 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:35.850772 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79e356b-3c34-4990-9a0f-aed48f9a5fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:35.851320 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e356b-3c34-4990-9a0f-aed48f9a5fad None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:35.851626 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e356b-3c34-4990-9a0f-aed48f9a5fad None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:35.852009 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e356b-3c34-4990-9a0f-aed48f9a5fad None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:35.852600 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79e356b-3c34-4990-9a0f-aed48f9a5fad None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:35.854091 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79e356b-3c34-4990-9a0f-aed48f9a5fad None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:35.867283 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-c79e356b-3c34-4990-9a0f-aed48f9a5fad None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 01:17:35.867283 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:35.867283 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 01:17:35.867283 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 01:17:35.867283 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 01:17:35.867283 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 01:17:35.867283 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 01:17:35.867283 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:17:35.867283 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 01:17:35.867283 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:35.867283 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 01:17:35.867283 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:35.867283 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:35.867283 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:35.867283 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:35.867283 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:35.867283 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:35.868657 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:35.868657 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:35.868657 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:35.868657 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:35.868657 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:35.868657 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:35.868657 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 01:17:35.868657 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 01:17:35.868657 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 01:17:35.868657 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 01:17:35.868657 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:35.868657 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:35.868657 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:35.868657 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:35.868657 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:35.868657 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:35.870109 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:35.870109 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:35.870109 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:35.870109 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:35.870109 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:35.870109 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:35.870109 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:35.870109 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:35.870109 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:35.870109 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:35.870109 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 01:17:35.870109 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:17:35.870109 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 01:17:35.870109 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:35.870109 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 502/1005] 10.222.0.60 () {56 vars in 1126 bytes} [Tue Aug 30 01:17:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:35.874438 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79e356b-3c34-4990-9a0f-aed48f9a5fad None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:35.896258 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 504/1006] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:17:35 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 01:17:35.979545 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79e356b-3c34-4990-9a0f-aed48f9a5fad None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:36.005922 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:36.017663 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c9bc1b-715c-462d-a72c-5c6368b3717e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:36.018330 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9bc1b-715c-462d-a72c-5c6368b3717e None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:36.018612 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9bc1b-715c-462d-a72c-5c6368b3717e None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:36.018886 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9bc1b-715c-462d-a72c-5c6368b3717e None admin] PATH_INFO: `/v3/services` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:36.019537 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c9bc1b-715c-462d-a72c-5c6368b3717e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:36.019843 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c9bc1b-715c-462d-a72c-5c6368b3717e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:36.021209 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c9bc1b-715c-462d-a72c-5c6368b3717e None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:36.033142 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 503/1007] 10.222.0.60 () {56 vars in 1122 bytes} [Tue Aug 30 01:17:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:17:36.034402 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403bbd39-b9ac-4e3d-95ac-557b0ea08dc1 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:36.066648 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:36.138262 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403bbd39-b9ac-4e3d-95ac-557b0ea08dc1 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:36.172728 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ef8ece-47f6-4c13-8a11-7ce33632d4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:36.173888 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef8ece-47f6-4c13-8a11-7ce33632d4bf None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:36.174165 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef8ece-47f6-4c13-8a11-7ce33632d4bf None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:36.174493 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef8ece-47f6-4c13-8a11-7ce33632d4bf None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:36.175116 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ef8ece-47f6-4c13-8a11-7ce33632d4bf None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:36.175417 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ef8ece-47f6-4c13-8a11-7ce33632d4bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:36.176845 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ef8ece-47f6-4c13-8a11-7ce33632d4bf None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:36.186538 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 505/1008] 10.222.0.60 () {56 vars in 1122 bytes} [Tue Aug 30 01:17:36 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:17:36.187810 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c9bc1b-715c-462d-a72c-5c6368b3717e None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:36.197026 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ef8ece-47f6-4c13-8a11-7ce33632d4bf None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:36.301607 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:36.303782 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c9bc1b-715c-462d-a72c-5c6368b3717e None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:36.310253 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ef8ece-47f6-4c13-8a11-7ce33632d4bf None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:36.343257 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc172e12-c2a1-4152-b579-49de4210a0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:36.344232 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc172e12-c2a1-4152-b579-49de4210a0d3 None admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:36.344523 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc172e12-c2a1-4152-b579-49de4210a0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:36.344801 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc172e12-c2a1-4152-b579-49de4210a0d3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:36.346416 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc172e12-c2a1-4152-b579-49de4210a0d3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:36.347873 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f9561-81fa-4c24-9aa7-1ebc3e8d4b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:36.348280 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc172e12-c2a1-4152-b579-49de4210a0d3 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:36.348484 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f9561-81fa-4c24-9aa7-1ebc3e8d4b6a None admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:36.348765 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f9561-81fa-4c24-9aa7-1ebc3e8d4b6a None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:36.349089 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f9561-81fa-4c24-9aa7-1ebc3e8d4b6a None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:36.349693 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10f9561-81fa-4c24-9aa7-1ebc3e8d4b6a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:36.351052 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10f9561-81fa-4c24-9aa7-1ebc3e8d4b6a None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:36.371707 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 504/1009] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:17:36 2022] POST /identity/v3/endpoints => generated 325 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:17:36.371931 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 506/1010] 10.222.0.60 () {60 vars in 1141 bytes} [Tue Aug 30 01:17:36 2022] POST /identity/v3/services => generated 242 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:17:37.563395 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f04f3-dc07-45b0-bfc2-0b2164250264 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:37.564451 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f04f3-dc07-45b0-bfc2-0b2164250264 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:37.564530 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f04f3-dc07-45b0-bfc2-0b2164250264 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:37.565857 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 505/1011] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:17:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:17:37.570943 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a16cff-f227-4bd1-92f3-9d9066813ecb None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:37.571349 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a16cff-f227-4bd1-92f3-9d9066813ecb None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:37.571573 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a16cff-f227-4bd1-92f3-9d9066813ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:37.592358 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-d4a16cff-f227-4bd1-92f3-9d9066813ecb None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:37.593912 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-d4a16cff-f227-4bd1-92f3-9d9066813ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:37.670966 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 507/1012] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:17:37 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:17:37.942733 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01f04f3-dc07-45b0-bfc2-0b2164250264 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:37.995144 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:38.055575 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01f04f3-dc07-45b0-bfc2-0b2164250264 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:38.091457 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940ae68c-7eb0-4c96-a956-7e9d26dc486b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:38.092115 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ae68c-7eb0-4c96-a956-7e9d26dc486b None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:38.092392 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ae68c-7eb0-4c96-a956-7e9d26dc486b None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:38.092663 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ae68c-7eb0-4c96-a956-7e9d26dc486b None admin] PATH_INFO: `/v3/services/compute` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:38.093241 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940ae68c-7eb0-4c96-a956-7e9d26dc486b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:38.094600 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940ae68c-7eb0-4c96-a956-7e9d26dc486b None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:38.103321 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-940ae68c-7eb0-4c96-a956-7e9d26dc486b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 01:17:38.103321 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:38.103321 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 01:17:38.103321 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 01:17:38.103321 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 01:17:38.103321 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 01:17:38.103321 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 01:17:38.103321 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:17:38.103321 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 01:17:38.103321 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:38.103321 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 01:17:38.103321 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:38.103321 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:38.103321 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:38.103321 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:38.103321 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:38.103321 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:38.104348 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:38.104348 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:38.104348 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:38.104348 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:38.104348 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:38.104348 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:38.104348 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 01:17:38.104348 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 01:17:38.104348 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 01:17:38.104348 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 01:17:38.104348 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:38.104348 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:38.104348 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:38.104348 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:38.104348 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:38.104348 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:38.108524 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:38.108524 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:38.108524 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:38.108524 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:38.108524 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:38.108524 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:38.108524 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:38.108524 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:38.108524 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:38.108524 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:38.108524 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 01:17:38.108524 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:17:38.108524 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 01:17:38.108524 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:38.108524 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 506/1013] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 30 01:17:37 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:38.111176 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a16cff-f227-4bd1-92f3-9d9066813ecb None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:38.193471 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:38.217068 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a16cff-f227-4bd1-92f3-9d9066813ecb None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:38.251821 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8383003-4a2f-4837-acf3-66fc686c4c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:38.252460 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8383003-4a2f-4837-acf3-66fc686c4c30 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:38.252738 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8383003-4a2f-4837-acf3-66fc686c4c30 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:38.253004 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8383003-4a2f-4837-acf3-66fc686c4c30 None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:38.253631 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8383003-4a2f-4837-acf3-66fc686c4c30 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:38.253928 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8383003-4a2f-4837-acf3-66fc686c4c30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:38.255311 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8383003-4a2f-4837-acf3-66fc686c4c30 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:38.264854 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 508/1014] 10.222.0.60 () {56 vars in 1112 bytes} [Tue Aug 30 01:17:38 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:17:38.265897 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940ae68c-7eb0-4c96-a956-7e9d26dc486b None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:38.309178 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389ee57-5fe2-41d9-85a3-4af216e468de None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:38.309513 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389ee57-5fe2-41d9-85a3-4af216e468de None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:38.309729 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389ee57-5fe2-41d9-85a3-4af216e468de None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:38.311425 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 509/1015] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:17:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:17:38.317524 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f560c64-b8ad-46e9-9501-bf64c3a1e73c None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:38.318172 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f560c64-b8ad-46e9-9501-bf64c3a1e73c None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:38.318445 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f560c64-b8ad-46e9-9501-bf64c3a1e73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:38.336070 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-1f560c64-b8ad-46e9-9501-bf64c3a1e73c None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:38.337255 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-1f560c64-b8ad-46e9-9501-bf64c3a1e73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:38.373280 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940ae68c-7eb0-4c96-a956-7e9d26dc486b None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:38.385849 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:38.404861 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 510/1016] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:17:38 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:17:38.406307 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd6f4b-4c44-4f4c-a3c8-212cacb7bf0c None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:38.406591 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd6f4b-4c44-4f4c-a3c8-212cacb7bf0c None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:38.406863 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd6f4b-4c44-4f4c-a3c8-212cacb7bf0c None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:38.407075 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9108289a-0d32-4979-9c53-ac80ec06bd6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:38.408313 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108289a-0d32-4979-9c53-ac80ec06bd6e None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:38.408598 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108289a-0d32-4979-9c53-ac80ec06bd6e None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:38.408988 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 511/1017] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:17:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:17:38.415062 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108289a-0d32-4979-9c53-ac80ec06bd6e None admin] PATH_INFO: `/v3/services` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:38.415062 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9108289a-0d32-4979-9c53-ac80ec06bd6e None admin] RBAC: Adding query filter params (type=compute) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:38.415062 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9108289a-0d32-4979-9c53-ac80ec06bd6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:38.415062 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9108289a-0d32-4979-9c53-ac80ec06bd6e None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:38.415457 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4357f-9438-4d54-8464-e49e3f43c83b None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:38.415457 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4357f-9438-4d54-8464-e49e3f43c83b None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:38.415457 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4357f-9438-4d54-8464-e49e3f43c83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:38.425199 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 507/1018] 10.222.0.60 () {56 vars in 1112 bytes} [Tue Aug 30 01:17:38 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:17:38.426073 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9108289a-0d32-4979-9c53-ac80ec06bd6e None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:38.432942 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-7ab4357f-9438-4d54-8464-e49e3f43c83b None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:38.434133 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-7ab4357f-9438-4d54-8464-e49e3f43c83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:38.508571 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 512/1019] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:17:38 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 01:17:38.539341 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9108289a-0d32-4979-9c53-ac80ec06bd6e None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:38.573422 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fee1c3-e5c2-4611-b0ee-e95c1017d40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:38.574018 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fee1c3-e5c2-4611-b0ee-e95c1017d40a None admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:38.574287 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fee1c3-e5c2-4611-b0ee-e95c1017d40a None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:38.574555 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fee1c3-e5c2-4611-b0ee-e95c1017d40a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:38.575240 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fee1c3-e5c2-4611-b0ee-e95c1017d40a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:38.576623 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fee1c3-e5c2-4611-b0ee-e95c1017d40a None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:38.611488 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 508/1020] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:17:38 2022] POST /identity/v3/endpoints => generated 334 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:17:38.674677 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab4357f-9438-4d54-8464-e49e3f43c83b None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:38.679407 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:38.783532 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fee1c3-e5c2-4611-b0ee-e95c1017d40a None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:38.783903 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab4357f-9438-4d54-8464-e49e3f43c83b None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:38.823006 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:38.831057 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaebe265-884e-45de-92a7-abc2e66bae7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:38.831725 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaebe265-884e-45de-92a7-abc2e66bae7f None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:38.832058 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaebe265-884e-45de-92a7-abc2e66bae7f None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:38.832271 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaebe265-884e-45de-92a7-abc2e66bae7f None admin] PATH_INFO: `/v3/services/image` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:38.832859 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaebe265-884e-45de-92a7-abc2e66bae7f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:38.834243 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaebe265-884e-45de-92a7-abc2e66bae7f None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:38.843536 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-aaebe265-884e-45de-92a7-abc2e66bae7f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 01:17:38.843536 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:38.843536 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 01:17:38.843536 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 01:17:38.843536 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 01:17:38.843536 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 01:17:38.843536 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 01:17:38.843536 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:17:38.843536 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 01:17:38.843536 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:38.843536 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 01:17:38.843536 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:38.843536 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:38.843536 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:38.843536 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:38.843536 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:38.843536 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:38.844533 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:38.844533 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:38.844533 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:38.844533 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:38.844533 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:38.844533 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:38.844533 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 01:17:38.844533 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 01:17:38.844533 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 01:17:38.844533 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 01:17:38.844533 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:38.844533 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:38.844533 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:38.844533 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:38.844533 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:38.844533 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:38.846479 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:38.846479 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:38.846479 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:38.846479 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:38.846479 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:38.846479 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:38.846479 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:38.846479 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:38.846479 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:38.846479 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:38.846479 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 01:17:38.846479 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:17:38.846479 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 01:17:38.846479 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:38.846479 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 513/1021] 10.222.0.60 () {56 vars in 1105 bytes} [Tue Aug 30 01:17:38 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:38.851208 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaebe265-884e-45de-92a7-abc2e66bae7f None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:38.913195 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fee1c3-e5c2-4611-b0ee-e95c1017d40a None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:38.922693 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:38.953729 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0088f3f-3769-470a-a239-6c569365d28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:38.954902 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0088f3f-3769-470a-a239-6c569365d28c None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:38.955186 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0088f3f-3769-470a-a239-6c569365d28c None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:38.955515 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0088f3f-3769-470a-a239-6c569365d28c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:38.956603 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0088f3f-3769-470a-a239-6c569365d28c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:38.958044 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0088f3f-3769-470a-a239-6c569365d28c None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:38.959838 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 509/1022] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:17:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:17:38.963896 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaebe265-884e-45de-92a7-abc2e66bae7f None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:38.965228 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0088f3f-3769-470a-a239-6c569365d28c None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:39.002635 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f866fc6a-4048-467a-b2e2-7ebbd77cfdd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:39.003251 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866fc6a-4048-467a-b2e2-7ebbd77cfdd1 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:39.003570 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866fc6a-4048-467a-b2e2-7ebbd77cfdd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:39.003850 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866fc6a-4048-467a-b2e2-7ebbd77cfdd1 None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:39.004484 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f866fc6a-4048-467a-b2e2-7ebbd77cfdd1 None admin] RBAC: Adding query filter params (name=image) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:39.004790 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f866fc6a-4048-467a-b2e2-7ebbd77cfdd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:39.006184 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f866fc6a-4048-467a-b2e2-7ebbd77cfdd1 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:39.016064 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 514/1023] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:17:38 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:17:39.018291 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f866fc6a-4048-467a-b2e2-7ebbd77cfdd1 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:39.071423 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:39.074768 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0088f3f-3769-470a-a239-6c569365d28c None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:39.113718 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b433d60f-17a4-43cc-b205-e3f8355e699e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:39.114323 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433d60f-17a4-43cc-b205-e3f8355e699e None admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:39.114601 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433d60f-17a4-43cc-b205-e3f8355e699e None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:39.114872 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433d60f-17a4-43cc-b205-e3f8355e699e None admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:39.115561 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b433d60f-17a4-43cc-b205-e3f8355e699e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:39.116989 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b433d60f-17a4-43cc-b205-e3f8355e699e None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:39.136016 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f866fc6a-4048-467a-b2e2-7ebbd77cfdd1 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:39.147512 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 510/1024] 10.222.0.60 () {60 vars in 1141 bytes} [Tue Aug 30 01:17:38 2022] POST /identity/v3/projects => generated 311 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:17:39.176074 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:39.185408 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3c961-8f9b-45c9-b786-d1945ecf0809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:39.186133 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3c961-8f9b-45c9-b786-d1945ecf0809 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:39.186490 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3c961-8f9b-45c9-b786-d1945ecf0809 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:39.186837 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3c961-8f9b-45c9-b786-d1945ecf0809 None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:39.187744 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3c961-8f9b-45c9-b786-d1945ecf0809 None admin] RBAC: Adding query filter params (type=image) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:39.188131 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3c961-8f9b-45c9-b786-d1945ecf0809 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:39.190105 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3c961-8f9b-45c9-b786-d1945ecf0809 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:39.201196 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 515/1025] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:17:39 2022] GET /identity/v3/services?type=image => generated 350 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:17:39.202924 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b433d60f-17a4-43cc-b205-e3f8355e699e None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:39.315578 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b433d60f-17a4-43cc-b205-e3f8355e699e None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:39.352856 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280508c8-609e-43da-8d91-e41686a81fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:39.353398 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280508c8-609e-43da-8d91-e41686a81fc8 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:39.353676 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280508c8-609e-43da-8d91-e41686a81fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:39.353945 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280508c8-609e-43da-8d91-e41686a81fc8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:39.354650 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280508c8-609e-43da-8d91-e41686a81fc8 None admin] RBAC: Adding query filter params (interface=public, service_id=77d0d60a3d5c49e89060cb7fbc872a4d, region_id=RegionOne) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:39.354955 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280508c8-609e-43da-8d91-e41686a81fc8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:39.356365 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280508c8-609e-43da-8d91-e41686a81fc8 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:39.362148 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 511/1026] 10.222.0.60 () {56 vars in 1251 bytes} [Tue Aug 30 01:17:39 2022] GET /identity/v3/endpoints?service_id=77d0d60a3d5c49e89060cb7fbc872a4d&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:39.367644 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3c961-8f9b-45c9-b786-d1945ecf0809 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:39.469264 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3c961-8f9b-45c9-b786-d1945ecf0809 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:39.503174 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c713dc3-7d43-4c7a-9703-09b88ba283b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:39.503809 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c713dc3-7d43-4c7a-9703-09b88ba283b3 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:39.504089 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c713dc3-7d43-4c7a-9703-09b88ba283b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:39.504364 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c713dc3-7d43-4c7a-9703-09b88ba283b3 None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:39.504976 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c713dc3-7d43-4c7a-9703-09b88ba283b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:39.506348 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c713dc3-7d43-4c7a-9703-09b88ba283b3 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:39.519455 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 516/1027] 10.222.0.60 () {56 vars in 1087 bytes} [Tue Aug 30 01:17:39 2022] GET /identity/v3/services => generated 1957 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:17:40.638749 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5eed1f-434f-466d-9f6c-4abda9b0bff8 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:40.639289 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5eed1f-434f-466d-9f6c-4abda9b0bff8 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:40.639289 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5eed1f-434f-466d-9f6c-4abda9b0bff8 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:40.640801 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 512/1028] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:17:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:17:40.646301 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76368b-15ab-48bd-b6f8-b2cf8a41bc3a None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:40.646701 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76368b-15ab-48bd-b6f8-b2cf8a41bc3a None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:40.646886 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76368b-15ab-48bd-b6f8-b2cf8a41bc3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:40.665012 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-1b76368b-15ab-48bd-b6f8-b2cf8a41bc3a None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:40.666199 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-1b76368b-15ab-48bd-b6f8-b2cf8a41bc3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:40.718771 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:40.737333 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 517/1029] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:17:40 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:17:41.002028 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5eed1f-434f-466d-9f6c-4abda9b0bff8 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:41.021881 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:41.109764 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5eed1f-434f-466d-9f6c-4abda9b0bff8 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:41.145763 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4590f696-0a0a-4a51-bda0-23d77ece519d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:41.146393 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4590f696-0a0a-4a51-bda0-23d77ece519d None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:41.146669 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4590f696-0a0a-4a51-bda0-23d77ece519d None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:41.146937 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4590f696-0a0a-4a51-bda0-23d77ece519d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:41.154524 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b5ef3-4d11-4e29-94d6-c65e087e32d5 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:41.154812 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b5ef3-4d11-4e29-94d6-c65e087e32d5 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:41.155091 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b5ef3-4d11-4e29-94d6-c65e087e32d5 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:41.156604 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 518/1030] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:17:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:17:41.157629 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4590f696-0a0a-4a51-bda0-23d77ece519d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:17:41.161251 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee94971-50d4-4697-9ad9-f240de9f471c None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:41.161530 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee94971-50d4-4697-9ad9-f240de9f471c None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:41.161806 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee94971-50d4-4697-9ad9-f240de9f471c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:41.162443 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-4590f696-0a0a-4a51-bda0-23d77ece519d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 01:17:41.162443 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:41.162443 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:41.162443 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:41.162443 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:41.162443 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:41.162443 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:41.162443 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:41.162443 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:41.162443 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:41.162443 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:41.162443 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:41.162443 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:17:41.162443 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:17:41.162443 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:17:41.162443 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:17:41.163371 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:17:41.163371 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:17:41.163371 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:17:41.163371 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:17:41.163371 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:41.163371 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:41.163371 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:41.163371 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:41.163371 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:41.163371 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:41.163371 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:41.163371 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:41.163371 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:41.163371 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:41.163371 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:41.163371 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:41.164270 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:41.164270 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:41.164270 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:41.164270 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:41.164270 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:17:41.164270 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:17:41.164270 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:17:41.164270 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:17:41.164270 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:17:41.164270 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:17:41.164270 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 01:17:41.164270 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:41.167590 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 513/1031] 10.222.0.60 () {56 vars in 1120 bytes} [Tue Aug 30 01:17:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:41.169274 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4590f696-0a0a-4a51-bda0-23d77ece519d None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:41.180778 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-3ee94971-50d4-4697-9ad9-f240de9f471c None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:41.182260 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-3ee94971-50d4-4697-9ad9-f240de9f471c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:41.257774 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 519/1032] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:17:41 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 01:17:41.258373 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:41.282480 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4590f696-0a0a-4a51-bda0-23d77ece519d None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:41.318421 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a6174-904d-4e02-8c0a-fbab63b350ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:41.319032 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a6174-904d-4e02-8c0a-fbab63b350ed None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:41.319308 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a6174-904d-4e02-8c0a-fbab63b350ed None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:41.319612 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a6174-904d-4e02-8c0a-fbab63b350ed None admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:41.320272 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a6174-904d-4e02-8c0a-fbab63b350ed None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:41.320572 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a6174-904d-4e02-8c0a-fbab63b350ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:41.321933 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a6174-904d-4e02-8c0a-fbab63b350ed None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:41.332371 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 514/1033] 10.222.0.60 () {56 vars in 1115 bytes} [Tue Aug 30 01:17:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:17:41.338234 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee94971-50d4-4697-9ad9-f240de9f471c None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:41.438260 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f6314-b8a9-4328-a2c2-a428257a4bd7 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:41.438619 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f6314-b8a9-4328-a2c2-a428257a4bd7 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:41.438889 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f6314-b8a9-4328-a2c2-a428257a4bd7 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:41.439982 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee94971-50d4-4697-9ad9-f240de9f471c None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:41.440426 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 515/1034] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:17:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:17:41.446111 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47106aec-b5c8-4b8a-a8a2-fa1a4f54c2db None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:41.446394 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47106aec-b5c8-4b8a-a8a2-fa1a4f54c2db None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:41.446668 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47106aec-b5c8-4b8a-a8a2-fa1a4f54c2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:41.462867 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:41.467123 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-47106aec-b5c8-4b8a-a8a2-fa1a4f54c2db None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:41.468786 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-47106aec-b5c8-4b8a-a8a2-fa1a4f54c2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:41.482617 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8213df4-b309-4f01-909f-6118a4804853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:41.483245 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8213df4-b309-4f01-909f-6118a4804853 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:41.483558 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8213df4-b309-4f01-909f-6118a4804853 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:41.483848 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8213df4-b309-4f01-909f-6118a4804853 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:41.494556 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8213df4-b309-4f01-909f-6118a4804853 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:41.496110 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8213df4-b309-4f01-909f-6118a4804853 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:41.510928 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-a8213df4-b309-4f01-909f-6118a4804853 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:17:41.510928 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:41.510928 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:41.510928 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:41.510928 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:41.510928 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:41.510928 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:41.510928 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:41.510928 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:41.510928 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:41.510928 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:41.510928 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:41.510928 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:17:41.510928 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:17:41.510928 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:17:41.510928 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:17:41.511921 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:41.511921 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:41.511921 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:41.511921 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:41.511921 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:41.511921 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:41.511921 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:41.511921 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:41.511921 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:41.511921 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:41.511921 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:41.511921 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:41.511921 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:41.511921 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:41.511921 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:41.511921 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:41.511921 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:17:41.512844 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:17:41.512844 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:17:41.512844 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:41.512844 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 520/1035] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:17:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:41.517758 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8213df4-b309-4f01-909f-6118a4804853 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:41.541048 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 516/1036] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:17:41 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:17:41.541888 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47106aec-b5c8-4b8a-a8a2-fa1a4f54c2db None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:41.616496 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:41.628393 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8213df4-b309-4f01-909f-6118a4804853 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:41.654149 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47106aec-b5c8-4b8a-a8a2-fa1a4f54c2db None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:41.664676 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae17747c-6f53-4477-8ab0-b54c8d11831c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:41.665283 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae17747c-6f53-4477-8ab0-b54c8d11831c None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:41.665686 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae17747c-6f53-4477-8ab0-b54c8d11831c None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:41.665964 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae17747c-6f53-4477-8ab0-b54c8d11831c None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:41.666611 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae17747c-6f53-4477-8ab0-b54c8d11831c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:41.666919 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae17747c-6f53-4477-8ab0-b54c8d11831c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:41.668340 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae17747c-6f53-4477-8ab0-b54c8d11831c None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:41.685404 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 521/1037] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:17:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:17:41.686488 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae17747c-6f53-4477-8ab0-b54c8d11831c None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:41.697128 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c80d3-cb25-4248-af81-ce55c0a23159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:41.697798 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c80d3-cb25-4248-af81-ce55c0a23159 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:41.698072 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c80d3-cb25-4248-af81-ce55c0a23159 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:41.698356 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c80d3-cb25-4248-af81-ce55c0a23159 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:41.699553 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735c80d3-cb25-4248-af81-ce55c0a23159 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:41.700975 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735c80d3-cb25-4248-af81-ce55c0a23159 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:41.702667 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 517/1038] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:17:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:41.709068 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c80d3-cb25-4248-af81-ce55c0a23159 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:41.724370 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:41.807893 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae17747c-6f53-4477-8ab0-b54c8d11831c None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:41.815045 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c80d3-cb25-4248-af81-ce55c0a23159 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:41.843291 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f87e803-f05a-46df-96ee-f1d8a1a5b2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:41.844166 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87e803-f05a-46df-96ee-f1d8a1a5b2bc None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:41.844285 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87e803-f05a-46df-96ee-f1d8a1a5b2bc None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:41.844485 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87e803-f05a-46df-96ee-f1d8a1a5b2bc None admin] PATH_INFO: `/v3/users/nova` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:41.849314 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b8e59-08dc-403b-8a71-5b270bd0c477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:41.849912 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b8e59-08dc-403b-8a71-5b270bd0c477 None admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:41.850185 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b8e59-08dc-403b-8a71-5b270bd0c477 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:41.850450 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b8e59-08dc-403b-8a71-5b270bd0c477 None admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:41.851099 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7b8e59-08dc-403b-8a71-5b270bd0c477 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:41.852181 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f87e803-f05a-46df-96ee-f1d8a1a5b2bc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:41.852612 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7b8e59-08dc-403b-8a71-5b270bd0c477 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:41.853619 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f87e803-f05a-46df-96ee-f1d8a1a5b2bc None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:41.861561 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:41.865517 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-1f87e803-f05a-46df-96ee-f1d8a1a5b2bc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 01:17:41.865517 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:41.865517 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:41.865517 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:41.865517 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:41.865517 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:41.865517 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:41.865517 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:41.865517 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:41.865517 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:41.865517 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:41.865517 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:41.865517 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 01:17:41.865517 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 01:17:41.865517 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 01:17:41.865517 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 01:17:41.866678 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:41.866678 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:41.866678 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 01:17:41.866678 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:17:41.866678 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 01:17:41.866678 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:17:41.866678 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:41.866678 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:41.866678 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:41.866678 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:41.866678 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:41.866678 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:41.866678 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:41.866678 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:41.866678 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:41.866678 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:41.866678 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:41.866678 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:41.867720 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:41.867720 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:41.867720 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 01:17:41.867720 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 01:17:41.867720 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 01:17:41.867720 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 01:17:41.867720 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 01:17:41.867720 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 01:17:41.867720 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 01:17:41.867720 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:41.867720 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 522/1039] 10.222.0.60 () {56 vars in 1093 bytes} [Tue Aug 30 01:17:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:41.867720 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f87e803-f05a-46df-96ee-f1d8a1a5b2bc None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:41.883473 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 518/1040] 10.222.0.60 () {60 vars in 1132 bytes} [Tue Aug 30 01:17:41 2022] POST /identity/v3/users => generated 285 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:17:41.883473 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b8e59-08dc-403b-8a71-5b270bd0c477 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:41.976320 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:41.991391 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f87e803-f05a-46df-96ee-f1d8a1a5b2bc None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:41.997861 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b8e59-08dc-403b-8a71-5b270bd0c477 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:42.032133 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7ba848-d6da-49ed-bfba-b52c33963ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:42.033364 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7ba848-d6da-49ed-bfba-b52c33963ce8 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:42.033637 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7ba848-d6da-49ed-bfba-b52c33963ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:42.033903 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7ba848-d6da-49ed-bfba-b52c33963ce8 None admin] PATH_INFO: `/v3/services/image` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:42.034484 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7ba848-d6da-49ed-bfba-b52c33963ce8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:42.035900 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7ba848-d6da-49ed-bfba-b52c33963ce8 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:42.036503 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02c303-4fe5-41df-8518-2672dae7a6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:42.037123 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02c303-4fe5-41df-8518-2672dae7a6b0 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:42.037399 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02c303-4fe5-41df-8518-2672dae7a6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:42.037672 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02c303-4fe5-41df-8518-2672dae7a6b0 None admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:42.038408 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e02c303-4fe5-41df-8518-2672dae7a6b0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:42.038716 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e02c303-4fe5-41df-8518-2672dae7a6b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:42.040484 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e02c303-4fe5-41df-8518-2672dae7a6b0 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:42.046986 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-af7ba848-d6da-49ed-bfba-b52c33963ce8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 01:17:42.046986 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:42.046986 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 01:17:42.046986 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 01:17:42.046986 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 01:17:42.046986 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 01:17:42.046986 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 01:17:42.046986 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:17:42.046986 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 01:17:42.046986 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:42.046986 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 01:17:42.046986 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:42.046986 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:42.046986 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:42.046986 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:42.046986 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:42.046986 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:42.048289 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:42.048289 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:42.048289 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:42.048289 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:42.048289 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:42.048289 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:42.048289 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 01:17:42.048289 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 01:17:42.048289 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 01:17:42.048289 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 01:17:42.048289 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:42.048289 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:42.048289 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:42.048289 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:42.048289 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:42.048289 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:42.049214 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:42.049214 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:42.049214 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:42.049214 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:42.049214 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:42.049214 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:42.049214 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:42.049214 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:42.049214 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:42.049214 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:42.049214 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 01:17:42.049214 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:17:42.049214 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 01:17:42.049214 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:42.049214 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 523/1041] 10.222.0.60 () {56 vars in 1105 bytes} [Tue Aug 30 01:17:41 2022] GET /identity/v3/services/image => generated 86 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:42.055552 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7ba848-d6da-49ed-bfba-b52c33963ce8 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:42.062214 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 519/1042] 10.222.0.60 () {56 vars in 1133 bytes} [Tue Aug 30 01:17:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:42.069241 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02c303-4fe5-41df-8518-2672dae7a6b0 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:42.128595 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:42.164973 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7ba848-d6da-49ed-bfba-b52c33963ce8 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:42.186365 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02c303-4fe5-41df-8518-2672dae7a6b0 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:42.199709 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c2fd7-a30f-4b2a-b44c-066e233d28dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:42.200535 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c2fd7-a30f-4b2a-b44c-066e233d28dd None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:42.200978 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c2fd7-a30f-4b2a-b44c-066e233d28dd None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:42.201408 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c2fd7-a30f-4b2a-b44c-066e233d28dd None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:42.202186 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c2fd7-a30f-4b2a-b44c-066e233d28dd None admin] RBAC: Adding query filter params (name=image) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:42.202642 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c2fd7-a30f-4b2a-b44c-066e233d28dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:42.204186 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c2fd7-a30f-4b2a-b44c-066e233d28dd None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:42.209970 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 524/1043] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:17:42 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:17:42.215965 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c2fd7-a30f-4b2a-b44c-066e233d28dd None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:42.225102 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ee2dc8-650b-4995-a9ed-2cf224e6d8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:42.225699 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee2dc8-650b-4995-a9ed-2cf224e6d8d7 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:42.225977 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee2dc8-650b-4995-a9ed-2cf224e6d8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:42.226248 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee2dc8-650b-4995-a9ed-2cf224e6d8d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:42.234946 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:42.300473 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ee2dc8-650b-4995-a9ed-2cf224e6d8d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:42.301921 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ee2dc8-650b-4995-a9ed-2cf224e6d8d7 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:42.330670 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c2fd7-a30f-4b2a-b44c-066e233d28dd None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:42.359560 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:42.377206 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f0746b-b0e6-40b8-9177-bc16f4d1db0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:42.377875 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0746b-b0e6-40b8-9177-bc16f4d1db0e None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:42.378077 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0746b-b0e6-40b8-9177-bc16f4d1db0e None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:42.378335 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0746b-b0e6-40b8-9177-bc16f4d1db0e None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:42.378961 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f0746b-b0e6-40b8-9177-bc16f4d1db0e None admin] RBAC: Adding query filter params (type=image) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:42.379258 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f0746b-b0e6-40b8-9177-bc16f4d1db0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:42.380657 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f0746b-b0e6-40b8-9177-bc16f4d1db0e None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:42.385844 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 525/1044] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:17:42 2022] GET /identity/v3/services?type=image => generated 350 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:17:42.391226 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f0746b-b0e6-40b8-9177-bc16f4d1db0e None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:42.421240 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 520/1045] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 30 01:17:42 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 01:17:42.426844 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ee2dc8-650b-4995-a9ed-2cf224e6d8d7 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:42.482183 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:42.508455 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f0746b-b0e6-40b8-9177-bc16f4d1db0e None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:42.538988 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ee2dc8-650b-4995-a9ed-2cf224e6d8d7 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:42.544237 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be46e1-19c2-49f3-af81-67f35f3da9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:42.544847 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be46e1-19c2-49f3-af81-67f35f3da9ed None admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:42.545127 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be46e1-19c2-49f3-af81-67f35f3da9ed None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:42.545400 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be46e1-19c2-49f3-af81-67f35f3da9ed None admin] PATH_INFO: `/v3/endpoints` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:42.546370 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14be46e1-19c2-49f3-af81-67f35f3da9ed None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:42.547603 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14be46e1-19c2-49f3-af81-67f35f3da9ed None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:42.579466 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 526/1046] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:17:42 2022] POST /identity/v3/endpoints => generated 327 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:17:42.586583 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c4fc9-ff22-409c-aa88-3f9db7f262c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:42.587244 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c4fc9-ff22-409c-aa88-3f9db7f262c9 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:42.587611 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c4fc9-ff22-409c-aa88-3f9db7f262c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:42.591134 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c4fc9-ff22-409c-aa88-3f9db7f262c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:42.604043 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86c4fc9-ff22-409c-aa88-3f9db7f262c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:42.605605 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86c4fc9-ff22-409c-aa88-3f9db7f262c9 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:42.616094 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:42.629238 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-b86c4fc9-ff22-409c-aa88-3f9db7f262c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:17:42.629238 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:42.629238 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:42.629238 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:42.629238 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:42.629238 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:42.629238 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:42.629238 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:42.629238 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:42.629238 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:42.629238 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:42.629238 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:42.629238 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:17:42.629238 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:17:42.629238 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:17:42.629238 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:17:42.630400 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:42.630400 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:42.630400 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:42.630400 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:42.630400 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:42.630400 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:42.630400 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:42.630400 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:42.630400 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:42.630400 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:42.630400 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:42.630400 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:42.630400 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:42.630400 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:42.630400 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:42.630400 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:42.630400 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:17:42.631804 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:17:42.631804 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:17:42.631804 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:42.635309 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 521/1047] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:17:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:17:42.636593 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be46e1-19c2-49f3-af81-67f35f3da9ed None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:42.749489 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be46e1-19c2-49f3-af81-67f35f3da9ed None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:42.785512 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6ad747-afac-4fd6-83b3-254022e1bd3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:42.786268 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ad747-afac-4fd6-83b3-254022e1bd3c None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:42.786562 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ad747-afac-4fd6-83b3-254022e1bd3c None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:42.786808 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ad747-afac-4fd6-83b3-254022e1bd3c None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:42.787523 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6ad747-afac-4fd6-83b3-254022e1bd3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:42.787828 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6ad747-afac-4fd6-83b3-254022e1bd3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:42.789196 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6ad747-afac-4fd6-83b3-254022e1bd3c None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:42.792026 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:42.803884 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 527/1048] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:17:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:42.809506 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c4fc9-ff22-409c-aa88-3f9db7f262c9 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:42.916377 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c4fc9-ff22-409c-aa88-3f9db7f262c9 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:42.950817 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f429ea-3fce-406d-b863-01f0f3f3ed5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:42.951577 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f429ea-3fce-406d-b863-01f0f3f3ed5f None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:42.951926 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f429ea-3fce-406d-b863-01f0f3f3ed5f None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:42.952268 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f429ea-3fce-406d-b863-01f0f3f3ed5f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:42.959792 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f429ea-3fce-406d-b863-01f0f3f3ed5f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:42.961315 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f429ea-3fce-406d-b863-01f0f3f3ed5f None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:42.973054 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-00f429ea-3fce-406d-b863-01f0f3f3ed5f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:17:42.973054 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:42.973054 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:42.973054 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:42.973054 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:42.973054 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:42.973054 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:42.973054 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:42.973054 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:42.973054 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:42.973054 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:42.973054 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:42.973054 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 01:17:42.973054 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 01:17:42.973054 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 01:17:42.974190 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 01:17:42.974190 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:42.974190 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:42.974190 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:42.974190 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:42.974190 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:42.974190 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:42.974190 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:42.974190 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:42.974190 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:42.974190 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:42.974190 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:42.974190 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:42.974190 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:42.974190 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:42.974190 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:42.974190 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:42.975337 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 01:17:42.975337 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 01:17:42.975337 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 01:17:42.975337 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 01:17:42.975337 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 01:17:42.975337 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 01:17:42.975337 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:17:42.975337 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:42.979508 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 522/1049] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 30 01:17:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:42.981448 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6ad747-afac-4fd6-83b3-254022e1bd3c None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:43.091379 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6ad747-afac-4fd6-83b3-254022e1bd3c None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:43.127613 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972b257a-e888-4928-a5ca-b94c0b24f05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:43.128494 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b257a-e888-4928-a5ca-b94c0b24f05b None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:43.128945 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b257a-e888-4928-a5ca-b94c0b24f05b None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:43.129365 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b257a-e888-4928-a5ca-b94c0b24f05b None admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:43.130206 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972b257a-e888-4928-a5ca-b94c0b24f05b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:43.130668 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972b257a-e888-4928-a5ca-b94c0b24f05b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:43.132271 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972b257a-e888-4928-a5ca-b94c0b24f05b None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:43.149492 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 528/1050] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 30 01:17:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:17:43.150644 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f429ea-3fce-406d-b863-01f0f3f3ed5f None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:43.210772 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:43.259891 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f429ea-3fce-406d-b863-01f0f3f3ed5f None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:43.292924 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3b06ef-1984-4c5c-98c2-35cf1beb52cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:43.293516 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b06ef-1984-4c5c-98c2-35cf1beb52cc None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:43.293790 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b06ef-1984-4c5c-98c2-35cf1beb52cc None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:43.294059 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b06ef-1984-4c5c-98c2-35cf1beb52cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:43.294776 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3b06ef-1984-4c5c-98c2-35cf1beb52cc None admin] RBAC: Adding query filter params (role.id=3cf30b69be074b7bade51cb0dc428655, scope.project.id=b050b2dad22a4a06875072e44c8c9824, user.id=8889145228a24fb6bd539a11925e62f2) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:43.295077 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3b06ef-1984-4c5c-98c2-35cf1beb52cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:43.296511 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3b06ef-1984-4c5c-98c2-35cf1beb52cc None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:43.302546 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 523/1051] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 30 01:17:43 2022] GET /identity/v3/role_assignments?user.id=8889145228a24fb6bd539a11925e62f2&scope.project.id=b050b2dad22a4a06875072e44c8c9824&role.id=3cf30b69be074b7bade51cb0dc428655 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:43.879801 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c55e0d-02a6-4a7a-98af-7c24dc9819fe None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:43.880750 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c55e0d-02a6-4a7a-98af-7c24dc9819fe None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:43.880750 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c55e0d-02a6-4a7a-98af-7c24dc9819fe None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:43.881783 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 529/1052] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:17:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:17:43.886746 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888a547-4112-4140-8ccf-8ddd84bf82ec None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:43.887165 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888a547-4112-4140-8ccf-8ddd84bf82ec None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:43.887355 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888a547-4112-4140-8ccf-8ddd84bf82ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:43.905270 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-e888a547-4112-4140-8ccf-8ddd84bf82ec None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:43.906466 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-e888a547-4112-4140-8ccf-8ddd84bf82ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:43.975325 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 524/1053] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:17:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:17:44.246374 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c55e0d-02a6-4a7a-98af-7c24dc9819fe None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:44.312514 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:44.361034 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c55e0d-02a6-4a7a-98af-7c24dc9819fe None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:44.398415 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292099d3-f485-4ea1-bd4d-3fb8658a97e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:44.399131 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292099d3-f485-4ea1-bd4d-3fb8658a97e7 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:44.399508 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292099d3-f485-4ea1-bd4d-3fb8658a97e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:44.399847 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292099d3-f485-4ea1-bd4d-3fb8658a97e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:44.410649 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292099d3-f485-4ea1-bd4d-3fb8658a97e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:17:44.415731 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-292099d3-f485-4ea1-bd4d-3fb8658a97e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:17:44.415731 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:44.415731 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:44.415731 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:44.415731 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:44.415731 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:44.415731 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:44.415731 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:44.415731 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:44.415731 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:44.415731 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:44.415731 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:44.415731 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:17:44.415731 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:17:44.415731 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:17:44.415731 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:17:44.416913 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:17:44.416913 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:17:44.416913 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:17:44.416913 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:17:44.416913 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:44.416913 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:44.416913 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:44.416913 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:44.416913 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:44.416913 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:44.416913 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:44.416913 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:44.416913 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:44.416913 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:44.416913 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:44.416913 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:44.417996 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:44.417996 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:44.417996 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:44.417996 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:44.417996 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:17:44.417996 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:17:44.417996 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:17:44.417996 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:17:44.417996 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:17:44.417996 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:17:44.417996 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:17:44.417996 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:44.419752 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 530/1054] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 30 01:17:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:44.424140 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e888a547-4112-4140-8ccf-8ddd84bf82ec None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:44.477900 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:44.506508 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36902ecc-9266-4ab3-94cf-b191cb7807e3 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:44.506705 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36902ecc-9266-4ab3-94cf-b191cb7807e3 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:44.506954 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36902ecc-9266-4ab3-94cf-b191cb7807e3 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:44.508652 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 531/1055] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:17:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:17:44.513707 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714465d9-bf51-4b91-a39d-01741a38eefd None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:44.513987 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714465d9-bf51-4b91-a39d-01741a38eefd None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:44.514253 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714465d9-bf51-4b91-a39d-01741a38eefd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:44.531553 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e888a547-4112-4140-8ccf-8ddd84bf82ec None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:44.532922 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-714465d9-bf51-4b91-a39d-01741a38eefd None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:44.534106 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-714465d9-bf51-4b91-a39d-01741a38eefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:44.567698 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68e942f-93a7-42ef-ba62-4e46ffe6d1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:44.568389 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e942f-93a7-42ef-ba62-4e46ffe6d1f2 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:44.568738 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e942f-93a7-42ef-ba62-4e46ffe6d1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:44.569082 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e942f-93a7-42ef-ba62-4e46ffe6d1f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:44.569757 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68e942f-93a7-42ef-ba62-4e46ffe6d1f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:44.570076 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68e942f-93a7-42ef-ba62-4e46ffe6d1f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:44.571443 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68e942f-93a7-42ef-ba62-4e46ffe6d1f2 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:44.585618 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 525/1056] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 30 01:17:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:44.589720 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68e942f-93a7-42ef-ba62-4e46ffe6d1f2 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:44.611201 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 532/1057] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:17:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 01:17:44.699548 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68e942f-93a7-42ef-ba62-4e46ffe6d1f2 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:44.713834 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:44.735217 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e7ca96-a730-403c-a1b9-55b14516c727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:44.736549 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7ca96-a730-403c-a1b9-55b14516c727 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:44.736908 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7ca96-a730-403c-a1b9-55b14516c727 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:44.737250 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7ca96-a730-403c-a1b9-55b14516c727 None admin] PATH_INFO: `/v3/users/2b09399db02c4e8ab7756f49f9fa6b08` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:44.751027 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e7ca96-a730-403c-a1b9-55b14516c727 None admin] RBAC: Authorizing `identity:get_user(user_id=2b09399db02c4e8ab7756f49f9fa6b08)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:44.753100 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e7ca96-a730-403c-a1b9-55b14516c727 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:44.755000 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 526/1058] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 30 01:17:44 2022] GET /identity/v3/users/2b09399db02c4e8ab7756f49f9fa6b08 => generated 285 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:44.760794 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714465d9-bf51-4b91-a39d-01741a38eefd None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:44.810752 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:44.866351 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714465d9-bf51-4b91-a39d-01741a38eefd None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:44.880521 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e7ca96-a730-403c-a1b9-55b14516c727 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:44.907710 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0219915-9883-481a-85cd-6fc1001887f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:44.908632 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0219915-9883-481a-85cd-6fc1001887f4 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:44.908919 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0219915-9883-481a-85cd-6fc1001887f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:44.909465 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0219915-9883-481a-85cd-6fc1001887f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:44.981854 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0219915-9883-481a-85cd-6fc1001887f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:44.983313 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0219915-9883-481a-85cd-6fc1001887f4 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:44.989137 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e7ca96-a730-403c-a1b9-55b14516c727 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:45.026628 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b62c7-cb08-48d5-ad03-8a3d78c19847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:45.027264 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b62c7-cb08-48d5-ad03-8a3d78c19847 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:45.027496 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b62c7-cb08-48d5-ad03-8a3d78c19847 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:45.027702 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b62c7-cb08-48d5-ad03-8a3d78c19847 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:45.033269 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:45.076665 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:45.103469 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 533/1059] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 30 01:17:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 01:17:45.109165 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0219915-9883-481a-85cd-6fc1001887f4 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:45.110031 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b62c7-cb08-48d5-ad03-8a3d78c19847 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:45.112280 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b62c7-cb08-48d5-ad03-8a3d78c19847 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:45.211960 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0219915-9883-481a-85cd-6fc1001887f4 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:45.217897 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 527/1060] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 30 01:17:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 01:17:45.219354 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66bfebe-3a2b-4f55-a8d9-5da6270b7a78 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:45.219671 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66bfebe-3a2b-4f55-a8d9-5da6270b7a78 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:45.220474 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66bfebe-3a2b-4f55-a8d9-5da6270b7a78 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:45.221948 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 528/1061] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:17:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:17:45.224479 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66bfebe-3a2b-4f55-a8d9-5da6270b7a78 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:45.248021 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06faf035-5acc-46a6-940d-e82aa52404cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:45.248643 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06faf035-5acc-46a6-940d-e82aa52404cb None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:45.248918 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06faf035-5acc-46a6-940d-e82aa52404cb None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:45.249193 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06faf035-5acc-46a6-940d-e82aa52404cb None admin] PATH_INFO: `/v3/projects/8bf756ef3cd649319539495d632ed38a` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:45.250298 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06faf035-5acc-46a6-940d-e82aa52404cb None admin] RBAC: Authorizing `identity:get_project(project_id=8bf756ef3cd649319539495d632ed38a)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:45.251790 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06faf035-5acc-46a6-940d-e82aa52404cb None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:45.258686 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 534/1062] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 30 01:17:45 2022] GET /identity/v3/projects/8bf756ef3cd649319539495d632ed38a => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:17:45.258686 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b545a5-e7e8-441f-9816-341c573a569b None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:45.258686 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b545a5-e7e8-441f-9816-341c573a569b None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:45.258686 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b545a5-e7e8-441f-9816-341c573a569b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:45.272245 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-87b545a5-e7e8-441f-9816-341c573a569b None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:45.273438 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-87b545a5-e7e8-441f-9816-341c573a569b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:45.283158 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:45.300920 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:45.332166 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66bfebe-3a2b-4f55-a8d9-5da6270b7a78 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:45.345793 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 535/1063] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:17:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:17:45.346661 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b545a5-e7e8-441f-9816-341c573a569b None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:45.372644 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e30b32-db26-4135-ae6e-01c0a89611c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:45.373425 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e30b32-db26-4135-ae6e-01c0a89611c6 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:45.373700 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e30b32-db26-4135-ae6e-01c0a89611c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:45.373968 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e30b32-db26-4135-ae6e-01c0a89611c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:45.384292 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e30b32-db26-4135-ae6e-01c0a89611c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:45.385725 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e30b32-db26-4135-ae6e-01c0a89611c6 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:45.400541 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-26e30b32-db26-4135-ae6e-01c0a89611c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:17:45.400541 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:45.400541 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:45.400541 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:45.400541 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:45.400541 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:45.400541 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:45.400541 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:45.400541 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:45.400541 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:45.400541 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:45.400541 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:45.400541 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:17:45.400541 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:17:45.400541 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:17:45.400541 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:17:45.401519 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:45.401519 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:45.401519 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:45.401519 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:45.401519 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:45.401519 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:45.401519 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:45.401519 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:45.401519 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:45.401519 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:45.401519 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:45.401519 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:45.401519 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:45.401519 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:45.401519 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:45.401519 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:45.401519 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:17:45.404930 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:17:45.404930 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:17:45.404930 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:45.404930 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 529/1064] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:17:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:17:45.408122 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e30b32-db26-4135-ae6e-01c0a89611c6 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:45.460592 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b545a5-e7e8-441f-9816-341c573a569b None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:45.495803 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79078a7-779b-4668-9791-4cb74dbb8e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:45.496622 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79078a7-779b-4668-9791-4cb74dbb8e92 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:45.497075 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79078a7-779b-4668-9791-4cb74dbb8e92 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:45.497492 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79078a7-779b-4668-9791-4cb74dbb8e92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:45.498352 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79078a7-779b-4668-9791-4cb74dbb8e92 None admin] RBAC: Adding query filter params (role.id=f6bc03b6972e420eb338ee7fd1443974, scope.project.id=8bf756ef3cd649319539495d632ed38a, user.id=2b09399db02c4e8ab7756f49f9fa6b08) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:45.498810 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79078a7-779b-4668-9791-4cb74dbb8e92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:45.500423 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79078a7-779b-4668-9791-4cb74dbb8e92 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:45.506025 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 536/1065] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 30 01:17:45 2022] GET /identity/v3/role_assignments?user.id=2b09399db02c4e8ab7756f49f9fa6b08&scope.project.id=8bf756ef3cd649319539495d632ed38a&role.id=f6bc03b6972e420eb338ee7fd1443974 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:45.522265 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e30b32-db26-4135-ae6e-01c0a89611c6 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:45.549610 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:45.563324 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d0341-bec9-41ac-a216-8eb8fa4ace2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:45.564023 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d0341-bec9-41ac-a216-8eb8fa4ace2e None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:45.564304 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d0341-bec9-41ac-a216-8eb8fa4ace2e None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:45.564584 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d0341-bec9-41ac-a216-8eb8fa4ace2e None admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:45.565242 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576d0341-bec9-41ac-a216-8eb8fa4ace2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:45.565547 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576d0341-bec9-41ac-a216-8eb8fa4ace2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:45.566965 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576d0341-bec9-41ac-a216-8eb8fa4ace2e None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:45.587375 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 530/1066] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:17:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:17:45.617123 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79078a7-779b-4668-9791-4cb74dbb8e92 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:45.630477 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:45.737521 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79078a7-779b-4668-9791-4cb74dbb8e92 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:45.774333 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde792ad-f121-40c3-bbf2-c7b7a60d3c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:45.775312 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde792ad-f121-40c3-bbf2-c7b7a60d3c6e None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:45.775802 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde792ad-f121-40c3-bbf2-c7b7a60d3c6e None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:45.776261 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde792ad-f121-40c3-bbf2-c7b7a60d3c6e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:45.788914 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde792ad-f121-40c3-bbf2-c7b7a60d3c6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:17:45.793850 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-cde792ad-f121-40c3-bbf2-c7b7a60d3c6e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 01:17:45.793850 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:45.793850 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:45.793850 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:45.793850 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:45.793850 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:45.793850 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:45.793850 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:45.793850 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:45.793850 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:45.793850 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:45.793850 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:45.793850 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:17:45.793850 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:17:45.793850 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:17:45.793850 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:17:45.794830 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:17:45.794830 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:17:45.794830 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:17:45.794830 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:17:45.794830 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:45.794830 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:45.794830 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:45.794830 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:45.794830 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:45.794830 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:45.794830 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:45.794830 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:45.794830 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:45.794830 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:45.794830 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:45.794830 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:45.795741 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:45.795741 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:45.795741 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:45.795741 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:45.795741 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:17:45.795741 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:17:45.795741 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:17:45.795741 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:17:45.795741 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:17:45.795741 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:17:45.795741 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 01:17:45.795741 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:45.795741 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 537/1067] 10.222.0.60 () {56 vars in 1120 bytes} [Tue Aug 30 01:17:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:45.801312 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d0341-bec9-41ac-a216-8eb8fa4ace2e None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:45.907445 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d0341-bec9-41ac-a216-8eb8fa4ace2e None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:45.942222 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8591e7-3780-4a2e-88cf-23ebdfc100d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:45.942872 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8591e7-3780-4a2e-88cf-23ebdfc100d2 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:45.943098 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8591e7-3780-4a2e-88cf-23ebdfc100d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:45.943368 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8591e7-3780-4a2e-88cf-23ebdfc100d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:45.944059 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8591e7-3780-4a2e-88cf-23ebdfc100d2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:45.944362 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8591e7-3780-4a2e-88cf-23ebdfc100d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:45.945738 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8591e7-3780-4a2e-88cf-23ebdfc100d2 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:45.953761 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 531/1068] 10.222.0.60 () {56 vars in 1115 bytes} [Tue Aug 30 01:17:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:45.960301 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde792ad-f121-40c3-bbf2-c7b7a60d3c6e None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:46.028846 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:46.062265 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde792ad-f121-40c3-bbf2-c7b7a60d3c6e None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:46.095928 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3801d3dd-a1d1-422c-879f-e5d0dba78e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:46.096545 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801d3dd-a1d1-422c-879f-e5d0dba78e88 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:46.096822 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801d3dd-a1d1-422c-879f-e5d0dba78e88 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:46.097091 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801d3dd-a1d1-422c-879f-e5d0dba78e88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:46.107568 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3801d3dd-a1d1-422c-879f-e5d0dba78e88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:46.109015 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3801d3dd-a1d1-422c-879f-e5d0dba78e88 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:46.122699 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-3801d3dd-a1d1-422c-879f-e5d0dba78e88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:17:46.122699 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:46.122699 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:46.122699 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:46.122699 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:46.122699 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:46.122699 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:46.122699 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:46.122699 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:46.122699 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:46.122699 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:46.122699 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:46.122699 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:17:46.122699 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:17:46.122699 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:17:46.122699 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:17:46.123713 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:46.123713 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:46.123713 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:46.123713 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:46.123713 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:46.123713 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:46.123713 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:46.123713 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:46.123713 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:46.123713 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:46.123713 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:46.123713 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:46.123713 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:46.123713 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:46.123713 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:46.123713 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:46.123713 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:17:46.124648 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:17:46.124648 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:17:46.124648 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:46.127574 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 538/1069] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:17:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:46.130116 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8591e7-3780-4a2e-88cf-23ebdfc100d2 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:46.176556 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:46.228850 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8591e7-3780-4a2e-88cf-23ebdfc100d2 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:46.262269 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e2f428-1b65-4d12-9769-3b2bec3109bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:46.262863 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2f428-1b65-4d12-9769-3b2bec3109bd None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:46.263139 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2f428-1b65-4d12-9769-3b2bec3109bd None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:46.263409 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2f428-1b65-4d12-9769-3b2bec3109bd None admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:46.264070 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e2f428-1b65-4d12-9769-3b2bec3109bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:46.264369 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e2f428-1b65-4d12-9769-3b2bec3109bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:46.265731 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e2f428-1b65-4d12-9769-3b2bec3109bd None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:46.277904 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 532/1070] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:17:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:46.284238 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3801d3dd-a1d1-422c-879f-e5d0dba78e88 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:46.393219 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3801d3dd-a1d1-422c-879f-e5d0dba78e88 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:46.413131 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:46.427711 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28bead7-6fb7-4a23-80ba-278eb5a7835f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:46.428328 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28bead7-6fb7-4a23-80ba-278eb5a7835f None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:46.428603 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28bead7-6fb7-4a23-80ba-278eb5a7835f None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:46.428868 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28bead7-6fb7-4a23-80ba-278eb5a7835f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:46.436013 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28bead7-6fb7-4a23-80ba-278eb5a7835f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:46.437448 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28bead7-6fb7-4a23-80ba-278eb5a7835f None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:46.448373 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-a28bead7-6fb7-4a23-80ba-278eb5a7835f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 01:17:46.448373 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:46.448373 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:46.448373 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:46.448373 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:46.448373 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:46.448373 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:46.448373 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:46.448373 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:46.448373 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:46.448373 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:46.448373 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:46.448373 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 01:17:46.448373 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 01:17:46.448373 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 01:17:46.448373 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 01:17:46.449541 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:46.449541 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:46.449541 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 01:17:46.449541 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:17:46.449541 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 01:17:46.449541 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:17:46.449541 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:46.449541 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:46.449541 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:46.449541 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:46.449541 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:46.449541 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:46.449541 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:46.449541 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:46.449541 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:46.449541 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:46.449541 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:46.449541 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:46.450536 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:46.450536 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:46.450536 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 01:17:46.450536 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 01:17:46.450536 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 01:17:46.450536 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 01:17:46.450536 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 01:17:46.450536 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 01:17:46.450536 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 01:17:46.450536 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:46.450536 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 539/1071] 10.222.0.60 () {56 vars in 1093 bytes} [Tue Aug 30 01:17:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:46.455793 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e2f428-1b65-4d12-9769-3b2bec3109bd None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:46.552860 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e2f428-1b65-4d12-9769-3b2bec3109bd None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:46.560685 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:46.588459 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82319a54-e34e-4069-97af-27b215b9ee43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:46.589092 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82319a54-e34e-4069-97af-27b215b9ee43 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:46.589370 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82319a54-e34e-4069-97af-27b215b9ee43 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:46.589639 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82319a54-e34e-4069-97af-27b215b9ee43 None admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:46.590644 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82319a54-e34e-4069-97af-27b215b9ee43 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:46.590946 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82319a54-e34e-4069-97af-27b215b9ee43 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:46.592434 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82319a54-e34e-4069-97af-27b215b9ee43 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:46.610582 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 533/1072] 10.222.0.60 () {56 vars in 1133 bytes} [Tue Aug 30 01:17:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:46.616050 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28bead7-6fb7-4a23-80ba-278eb5a7835f None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:46.715811 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28bead7-6fb7-4a23-80ba-278eb5a7835f None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:46.747379 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9764178-2d11-4688-bc85-b520914a63c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:46.748022 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9764178-2d11-4688-bc85-b520914a63c6 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:46.748297 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9764178-2d11-4688-bc85-b520914a63c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:46.748569 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9764178-2d11-4688-bc85-b520914a63c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:46.759214 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9764178-2d11-4688-bc85-b520914a63c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:46.760692 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9764178-2d11-4688-bc85-b520914a63c6 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:46.775068 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-f9764178-2d11-4688-bc85-b520914a63c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:17:46.775068 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:46.775068 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:46.775068 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:46.775068 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:46.775068 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:46.775068 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:46.775068 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:46.775068 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:46.775068 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:46.775068 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:46.775068 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:46.775068 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:17:46.775068 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:17:46.775068 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:17:46.775068 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:17:46.776127 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:46.776127 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:46.776127 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:46.776127 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:46.776127 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:46.776127 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:46.776127 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:46.776127 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:46.776127 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:46.776127 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:46.776127 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:46.776127 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:46.776127 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:46.776127 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:46.776127 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:46.776127 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:46.776127 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:17:46.777064 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:17:46.777064 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:17:46.777064 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:46.777064 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 540/1073] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:17:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:46.782004 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82319a54-e34e-4069-97af-27b215b9ee43 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:46.880090 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82319a54-e34e-4069-97af-27b215b9ee43 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:46.913294 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971990f7-5aa5-4169-9b78-987542e63bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:46.913895 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971990f7-5aa5-4169-9b78-987542e63bdd None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:46.914181 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971990f7-5aa5-4169-9b78-987542e63bdd None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:46.914461 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971990f7-5aa5-4169-9b78-987542e63bdd None admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:46.915129 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971990f7-5aa5-4169-9b78-987542e63bdd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:46.915424 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971990f7-5aa5-4169-9b78-987542e63bdd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:46.916820 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971990f7-5aa5-4169-9b78-987542e63bdd None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:46.931360 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 534/1074] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:17:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:46.938971 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9764178-2d11-4688-bc85-b520914a63c6 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:46.972050 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:47.040394 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9764178-2d11-4688-bc85-b520914a63c6 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:47.074048 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd10bd-f1ea-4591-b5ef-748fa1ba61e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:47.074668 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd10bd-f1ea-4591-b5ef-748fa1ba61e5 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:47.074945 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd10bd-f1ea-4591-b5ef-748fa1ba61e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:47.075215 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd10bd-f1ea-4591-b5ef-748fa1ba61e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:47.081708 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecd10bd-f1ea-4591-b5ef-748fa1ba61e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:47.083156 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecd10bd-f1ea-4591-b5ef-748fa1ba61e5 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:47.094535 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-4ecd10bd-f1ea-4591-b5ef-748fa1ba61e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:17:47.094535 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:47.094535 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:47.094535 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:47.094535 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:47.094535 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:47.094535 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:47.094535 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:47.094535 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:47.094535 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:47.094535 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:47.094535 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:47.094535 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 01:17:47.094535 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 01:17:47.094535 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 01:17:47.095563 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 01:17:47.095563 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:47.095563 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:47.095563 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:47.095563 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:47.095563 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:47.095563 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:47.095563 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:47.095563 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:47.095563 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:47.095563 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:47.095563 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:47.095563 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:47.095563 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:47.095563 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:47.095563 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:47.095563 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:47.096657 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 01:17:47.096657 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 01:17:47.096657 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 01:17:47.096657 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 01:17:47.096657 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 01:17:47.096657 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 01:17:47.096657 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:17:47.096657 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:47.096657 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 541/1075] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 30 01:17:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:47.101683 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971990f7-5aa5-4169-9b78-987542e63bdd None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:47.128083 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:47.200986 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971990f7-5aa5-4169-9b78-987542e63bdd None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:47.233668 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7581f61b-d501-465b-8f22-0571382c2c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:47.234201 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7581f61b-d501-465b-8f22-0571382c2c28 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:47.234475 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7581f61b-d501-465b-8f22-0571382c2c28 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:47.234743 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7581f61b-d501-465b-8f22-0571382c2c28 None admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:47.236308 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7581f61b-d501-465b-8f22-0571382c2c28 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:47.236308 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7581f61b-d501-465b-8f22-0571382c2c28 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:47.237712 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7581f61b-d501-465b-8f22-0571382c2c28 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:47.249357 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 535/1076] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 30 01:17:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:17:47.256178 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd10bd-f1ea-4591-b5ef-748fa1ba61e5 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:47.348694 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:47.357844 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd10bd-f1ea-4591-b5ef-748fa1ba61e5 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:47.393905 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3956a41e-45ff-4de7-8d80-21be096a6133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:47.394567 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956a41e-45ff-4de7-8d80-21be096a6133 None admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:47.394848 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956a41e-45ff-4de7-8d80-21be096a6133 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:47.395126 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956a41e-45ff-4de7-8d80-21be096a6133 None admin] PATH_INFO: `/v3/projects/b050b2dad22a4a06875072e44c8c9824/users/8889145228a24fb6bd539a11925e62f2/roles/3cf30b69be074b7bade51cb0dc428655` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:47.397306 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3956a41e-45ff-4de7-8d80-21be096a6133 None admin] RBAC: Authorizing `identity:create_grant(project_id=b050b2dad22a4a06875072e44c8c9824, user_id=8889145228a24fb6bd539a11925e62f2, role_id=3cf30b69be074b7bade51cb0dc428655)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:47.398748 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3956a41e-45ff-4de7-8d80-21be096a6133 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:47.412154 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 542/1077] 10.222.0.60 () {58 vars in 1439 bytes} [Tue Aug 30 01:17:47 2022] PUT /identity/v3/projects/b050b2dad22a4a06875072e44c8c9824/users/8889145228a24fb6bd539a11925e62f2/roles/3cf30b69be074b7bade51cb0dc428655 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:17:47.443830 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5a4ee-354a-424c-9efe-116c26d6bb9e None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:47.444115 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5a4ee-354a-424c-9efe-116c26d6bb9e None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:47.444389 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5a4ee-354a-424c-9efe-116c26d6bb9e None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:47.445812 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 536/1078] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:17:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:17:47.451657 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a2774-2fce-4449-b02d-ba54f124a601 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:47.451956 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a2774-2fce-4449-b02d-ba54f124a601 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:47.452226 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a2774-2fce-4449-b02d-ba54f124a601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:47.472548 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-858a2774-2fce-4449-b02d-ba54f124a601 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:47.473769 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-858a2774-2fce-4449-b02d-ba54f124a601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:47.546687 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 543/1079] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:17:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:17:47.812489 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e5a4ee-354a-424c-9efe-116c26d6bb9e None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:47.897560 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:47.915006 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e5a4ee-354a-424c-9efe-116c26d6bb9e None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:47.948619 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab546981-a705-453f-a51c-9659a4881737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:47.949238 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab546981-a705-453f-a51c-9659a4881737 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:47.949519 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab546981-a705-453f-a51c-9659a4881737 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:47.949795 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab546981-a705-453f-a51c-9659a4881737 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:47.960798 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab546981-a705-453f-a51c-9659a4881737 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:17:47.965854 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-ab546981-a705-453f-a51c-9659a4881737 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:17:47.965854 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:47.965854 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:47.965854 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:47.965854 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:47.965854 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:47.965854 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:47.965854 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:47.965854 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:47.965854 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:47.965854 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:47.965854 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:47.965854 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:17:47.965854 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:17:47.965854 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:17:47.965854 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:17:47.966877 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:17:47.966877 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:17:47.966877 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:17:47.966877 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:17:47.966877 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:47.966877 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:47.966877 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:47.966877 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:47.966877 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:47.966877 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:47.966877 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:47.966877 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:47.966877 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:47.966877 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:47.966877 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:47.966877 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:47.967750 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:47.967750 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:47.967750 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:47.967750 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:47.967750 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:17:47.967750 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:17:47.967750 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:17:47.967750 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:17:47.967750 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:17:47.967750 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:17:47.967750 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:17:47.967750 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:47.967750 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 537/1080] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 30 01:17:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:47.973738 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858a2774-2fce-4449-b02d-ba54f124a601 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:48.053970 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:48.072798 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858a2774-2fce-4449-b02d-ba54f124a601 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:48.106635 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3cfe3-c017-439a-9850-b90732324175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:48.107239 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3cfe3-c017-439a-9850-b90732324175 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:48.107542 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3cfe3-c017-439a-9850-b90732324175 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:48.107813 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3cfe3-c017-439a-9850-b90732324175 None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:48.108466 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de3cfe3-c017-439a-9850-b90732324175 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:48.108766 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de3cfe3-c017-439a-9850-b90732324175 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:48.110136 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de3cfe3-c017-439a-9850-b90732324175 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:48.118081 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 544/1081] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 30 01:17:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:48.123877 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab546981-a705-453f-a51c-9659a4881737 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:48.221551 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab546981-a705-453f-a51c-9659a4881737 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:48.254939 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404c82a1-0ff4-4e5e-90d9-de45d3106ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:48.255594 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c82a1-0ff4-4e5e-90d9-de45d3106ec8 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:48.255878 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c82a1-0ff4-4e5e-90d9-de45d3106ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:48.256153 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c82a1-0ff4-4e5e-90d9-de45d3106ec8 None admin] PATH_INFO: `/v3/users/2b09399db02c4e8ab7756f49f9fa6b08` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:48.257277 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404c82a1-0ff4-4e5e-90d9-de45d3106ec8 None admin] RBAC: Authorizing `identity:get_user(user_id=2b09399db02c4e8ab7756f49f9fa6b08)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:48.258705 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404c82a1-0ff4-4e5e-90d9-de45d3106ec8 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:48.260371 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 538/1082] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 30 01:17:48 2022] GET /identity/v3/users/2b09399db02c4e8ab7756f49f9fa6b08 => generated 285 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:48.266068 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3cfe3-c017-439a-9850-b90732324175 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:48.365387 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3cfe3-c017-439a-9850-b90732324175 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:48.399252 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d215d813-9d51-48fa-840c-36553de9fce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:48.399908 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215d813-9d51-48fa-840c-36553de9fce1 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:48.400194 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215d813-9d51-48fa-840c-36553de9fce1 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:48.400460 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215d813-9d51-48fa-840c-36553de9fce1 None admin] PATH_INFO: `/v3/projects/8bf756ef3cd649319539495d632ed38a` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:48.401563 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d215d813-9d51-48fa-840c-36553de9fce1 None admin] RBAC: Authorizing `identity:get_project(project_id=8bf756ef3cd649319539495d632ed38a)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:48.402997 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d215d813-9d51-48fa-840c-36553de9fce1 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:48.404644 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 545/1083] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 30 01:17:48 2022] GET /identity/v3/projects/8bf756ef3cd649319539495d632ed38a => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:48.410705 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404c82a1-0ff4-4e5e-90d9-de45d3106ec8 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:48.425707 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:48.514750 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404c82a1-0ff4-4e5e-90d9-de45d3106ec8 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:48.546689 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8318559a-582b-4284-a139-42003d9a264d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:48.547342 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318559a-582b-4284-a139-42003d9a264d None admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:48.547649 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318559a-582b-4284-a139-42003d9a264d None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:48.548453 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318559a-582b-4284-a139-42003d9a264d None admin] PATH_INFO: `/v3/projects/8bf756ef3cd649319539495d632ed38a/users/2b09399db02c4e8ab7756f49f9fa6b08/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:48.550328 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8318559a-582b-4284-a139-42003d9a264d None admin] RBAC: Authorizing `identity:create_grant(project_id=8bf756ef3cd649319539495d632ed38a, user_id=2b09399db02c4e8ab7756f49f9fa6b08, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:48.551781 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8318559a-582b-4284-a139-42003d9a264d None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:48.565486 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 539/1084] 10.222.0.60 () {58 vars in 1439 bytes} [Tue Aug 30 01:17:48 2022] PUT /identity/v3/projects/8bf756ef3cd649319539495d632ed38a/users/2b09399db02c4e8ab7756f49f9fa6b08/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:17:49.303053 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6975721f-8083-44f5-b01a-0885f88df183 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:49.303608 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6975721f-8083-44f5-b01a-0885f88df183 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:49.303608 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6975721f-8083-44f5-b01a-0885f88df183 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:49.304955 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 546/1085] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:17:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:17:49.310229 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f4cb77-f079-49cf-b058-1b9052403553 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:49.310608 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f4cb77-f079-49cf-b058-1b9052403553 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:49.310785 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f4cb77-f079-49cf-b058-1b9052403553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:49.330464 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-27f4cb77-f079-49cf-b058-1b9052403553 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:49.331685 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-27f4cb77-f079-49cf-b058-1b9052403553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:49.398708 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 540/1086] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:17:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:17:49.670950 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6975721f-8083-44f5-b01a-0885f88df183 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:49.686208 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:49.771909 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6975721f-8083-44f5-b01a-0885f88df183 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:49.803771 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075181bf-317c-47b4-8873-2cc2d5aff0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:49.804386 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075181bf-317c-47b4-8873-2cc2d5aff0f1 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:49.804662 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075181bf-317c-47b4-8873-2cc2d5aff0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:49.804929 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075181bf-317c-47b4-8873-2cc2d5aff0f1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:49.817907 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075181bf-317c-47b4-8873-2cc2d5aff0f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:17:49.822690 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-075181bf-317c-47b4-8873-2cc2d5aff0f1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 01:17:49.822690 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:49.822690 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:49.822690 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:49.822690 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:49.822690 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:49.822690 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:49.822690 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:49.822690 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:49.822690 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:49.822690 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:49.822690 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:49.822690 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:17:49.822690 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:17:49.822690 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:17:49.822690 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:17:49.823791 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:17:49.823791 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:17:49.823791 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:17:49.823791 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:17:49.823791 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:49.823791 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:49.823791 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:49.823791 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:49.823791 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:49.823791 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:49.823791 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:49.823791 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:49.823791 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:49.823791 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:49.823791 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:49.823791 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:49.825126 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:49.825126 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:49.825126 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:49.825126 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:49.825126 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:17:49.825126 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:17:49.825126 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:17:49.825126 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:17:49.825126 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:17:49.825126 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:17:49.825126 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 01:17:49.825126 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:49.825126 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 547/1087] 10.222.0.60 () {56 vars in 1120 bytes} [Tue Aug 30 01:17:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:49.830427 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f4cb77-f079-49cf-b058-1b9052403553 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:49.832650 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:49.928143 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f4cb77-f079-49cf-b058-1b9052403553 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:49.961774 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe7c296-721f-4d6f-8000-62cdb9c35a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:49.962376 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7c296-721f-4d6f-8000-62cdb9c35a53 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:49.962690 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7c296-721f-4d6f-8000-62cdb9c35a53 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:49.962960 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7c296-721f-4d6f-8000-62cdb9c35a53 None admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:49.963657 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe7c296-721f-4d6f-8000-62cdb9c35a53 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:49.963962 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe7c296-721f-4d6f-8000-62cdb9c35a53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:49.965579 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe7c296-721f-4d6f-8000-62cdb9c35a53 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:49.973455 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 541/1088] 10.222.0.60 () {56 vars in 1115 bytes} [Tue Aug 30 01:17:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:49.979130 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075181bf-317c-47b4-8873-2cc2d5aff0f1 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:50.048594 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:50.078588 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075181bf-317c-47b4-8873-2cc2d5aff0f1 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:50.111782 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b964134f-ac26-4021-b20e-de354c4d5696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:50.112406 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964134f-ac26-4021-b20e-de354c4d5696 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:50.112682 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964134f-ac26-4021-b20e-de354c4d5696 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:50.112951 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964134f-ac26-4021-b20e-de354c4d5696 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:50.123136 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b964134f-ac26-4021-b20e-de354c4d5696 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:50.124617 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b964134f-ac26-4021-b20e-de354c4d5696 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:50.139117 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-b964134f-ac26-4021-b20e-de354c4d5696 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:17:50.139117 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:50.139117 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:50.139117 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:50.139117 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:50.139117 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:50.139117 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:50.139117 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:50.139117 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:50.139117 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:50.139117 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:50.139117 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:50.139117 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:17:50.139117 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:17:50.139117 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:17:50.139117 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:17:50.140168 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:50.140168 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:50.140168 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:50.140168 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:50.140168 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:50.140168 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:50.140168 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:50.140168 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:50.140168 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:50.140168 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:50.140168 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:50.140168 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:50.140168 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:50.140168 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:50.140168 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:50.140168 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:50.140168 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:17:50.141455 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:17:50.141455 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:17:50.141455 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:50.141455 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 548/1089] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:17:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:50.146143 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe7c296-721f-4d6f-8000-62cdb9c35a53 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:50.207468 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:50.245305 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe7c296-721f-4d6f-8000-62cdb9c35a53 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:50.277748 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81719cd-fa35-44ea-8c39-b4e3c6cc3df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:50.278343 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81719cd-fa35-44ea-8c39-b4e3c6cc3df4 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:50.278623 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81719cd-fa35-44ea-8c39-b4e3c6cc3df4 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:50.278894 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81719cd-fa35-44ea-8c39-b4e3c6cc3df4 None admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:50.279564 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81719cd-fa35-44ea-8c39-b4e3c6cc3df4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:50.279868 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81719cd-fa35-44ea-8c39-b4e3c6cc3df4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:50.281231 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81719cd-fa35-44ea-8c39-b4e3c6cc3df4 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:50.293779 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 542/1090] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:17:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:50.300232 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b964134f-ac26-4021-b20e-de354c4d5696 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:50.404283 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b964134f-ac26-4021-b20e-de354c4d5696 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:50.428432 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:50.439157 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e4015-da7f-49d1-8c28-2f955eda39ae None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:50.439697 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e4015-da7f-49d1-8c28-2f955eda39ae None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:50.439812 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e4015-da7f-49d1-8c28-2f955eda39ae None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:50.439901 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d1aa6-a981-469b-a466-90f9027f408a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:50.440365 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d1aa6-a981-469b-a466-90f9027f408a None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:50.440645 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d1aa6-a981-469b-a466-90f9027f408a None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:50.440916 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d1aa6-a981-469b-a466-90f9027f408a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:50.441169 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 543/1091] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:17:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:17:50.445760 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf6298-3d02-4a08-bca0-f8057426394c None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:50.446044 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf6298-3d02-4a08-bca0-f8057426394c None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:50.446316 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf6298-3d02-4a08-bca0-f8057426394c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:50.449571 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479d1aa6-a981-469b-a466-90f9027f408a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:50.451082 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479d1aa6-a981-469b-a466-90f9027f408a None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:50.462352 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-479d1aa6-a981-469b-a466-90f9027f408a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 01:17:50.462352 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:50.462352 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:50.462352 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:50.462352 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:50.462352 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:50.462352 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:50.462352 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:50.462352 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:50.462352 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:50.462352 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:50.462352 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:50.462352 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 01:17:50.462352 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 01:17:50.462352 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 01:17:50.462352 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 01:17:50.463401 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:50.463401 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:50.463401 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 01:17:50.463401 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:17:50.463401 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 01:17:50.463401 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:17:50.463401 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:50.463401 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:50.463401 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:50.463401 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:50.463401 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:50.463401 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:50.463401 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:50.463401 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:50.463401 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:50.463401 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:50.463401 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:50.463401 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:50.464546 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:50.464546 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:50.464546 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 01:17:50.464546 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 01:17:50.464546 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 01:17:50.464546 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 01:17:50.464546 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 01:17:50.464546 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 01:17:50.464546 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 01:17:50.464546 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:50.464546 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 549/1092] 10.222.0.60 () {56 vars in 1093 bytes} [Tue Aug 30 01:17:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:50.465139 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-9fbf6298-3d02-4a08-bca0-f8057426394c None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:50.465576 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-9fbf6298-3d02-4a08-bca0-f8057426394c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:50.469243 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d1aa6-a981-469b-a466-90f9027f408a None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:50.531784 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 544/1093] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:17:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 01:17:50.568734 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d1aa6-a981-469b-a466-90f9027f408a None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:50.607149 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca4e462-6fa9-431a-a6e6-b8082e1748e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:50.607795 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4e462-6fa9-431a-a6e6-b8082e1748e8 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:50.608075 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4e462-6fa9-431a-a6e6-b8082e1748e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:50.608348 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4e462-6fa9-431a-a6e6-b8082e1748e8 None admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:50.609080 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca4e462-6fa9-431a-a6e6-b8082e1748e8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:50.609413 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca4e462-6fa9-431a-a6e6-b8082e1748e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:50.611526 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca4e462-6fa9-431a-a6e6-b8082e1748e8 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:50.628332 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 550/1094] 10.222.0.60 () {56 vars in 1133 bytes} [Tue Aug 30 01:17:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:17:50.634077 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf6298-3d02-4a08-bca0-f8057426394c None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:50.698289 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:50.748948 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf6298-3d02-4a08-bca0-f8057426394c None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:50.783382 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b090b725-df4c-48d3-96c0-57dcd4b08ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:50.784015 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090b725-df4c-48d3-96c0-57dcd4b08ee5 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:50.784287 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090b725-df4c-48d3-96c0-57dcd4b08ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:50.784551 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090b725-df4c-48d3-96c0-57dcd4b08ee5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:50.815709 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca4e462-6fa9-431a-a6e6-b8082e1748e8 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:50.860525 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b090b725-df4c-48d3-96c0-57dcd4b08ee5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:50.861632 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b090b725-df4c-48d3-96c0-57dcd4b08ee5 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:50.864761 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:50.918699 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:50.934014 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca4e462-6fa9-431a-a6e6-b8082e1748e8 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:50.967121 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 545/1095] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 30 01:17:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 01:17:50.972484 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82a4ddd-3e80-473a-872b-6dfae1bb55a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:50.973531 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a4ddd-3e80-473a-872b-6dfae1bb55a1 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:50.974022 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a4ddd-3e80-473a-872b-6dfae1bb55a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:50.974498 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a4ddd-3e80-473a-872b-6dfae1bb55a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:50.976895 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b090b725-df4c-48d3-96c0-57dcd4b08ee5 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:50.986161 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82a4ddd-3e80-473a-872b-6dfae1bb55a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:17:50.990688 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-f82a4ddd-3e80-473a-872b-6dfae1bb55a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:17:50.990688 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:50.990688 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:50.990688 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:50.990688 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:50.990688 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:50.990688 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:50.990688 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:50.990688 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:50.990688 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:50.990688 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:50.990688 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:50.990688 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:17:50.990688 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:17:50.990688 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:17:50.990688 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:17:50.991690 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:17:50.991690 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:17:50.991690 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:17:50.991690 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:17:50.991690 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:50.991690 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:50.991690 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:50.991690 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:50.991690 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:50.991690 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:50.991690 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:50.991690 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:50.991690 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:50.991690 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:50.991690 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:50.991690 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:50.992558 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:50.992558 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:50.992558 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:50.992558 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:50.992558 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:17:50.992558 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:17:50.992558 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:17:50.992558 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:17:50.992558 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:17:50.992558 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:17:50.992558 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:17:50.992558 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:17:50.992558 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 551/1096] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 30 01:17:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:17:50.997688 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82a4ddd-3e80-473a-872b-6dfae1bb55a1 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:51.090735 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b090b725-df4c-48d3-96c0-57dcd4b08ee5 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:51.097952 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82a4ddd-3e80-473a-872b-6dfae1bb55a1 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:51.099512 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:51.124008 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83818fec-d9e3-4e29-9738-fc1b23e59423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:51.124635 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83818fec-d9e3-4e29-9738-fc1b23e59423 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:51.124917 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83818fec-d9e3-4e29-9738-fc1b23e59423 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:51.125194 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83818fec-d9e3-4e29-9738-fc1b23e59423 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:51.132913 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ee74e-fa0a-49b0-b646-e8766eba16fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:51.133561 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ee74e-fa0a-49b0-b646-e8766eba16fa None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:51.133846 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ee74e-fa0a-49b0-b646-e8766eba16fa None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:51.134114 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ee74e-fa0a-49b0-b646-e8766eba16fa None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:51.134770 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1ee74e-fa0a-49b0-b646-e8766eba16fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:51.135070 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1ee74e-fa0a-49b0-b646-e8766eba16fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:51.135455 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83818fec-d9e3-4e29-9738-fc1b23e59423 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:51.136473 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1ee74e-fa0a-49b0-b646-e8766eba16fa None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:51.136917 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83818fec-d9e3-4e29-9738-fc1b23e59423 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:51.145289 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 552/1097] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 30 01:17:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:17:51.150898 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ee74e-fa0a-49b0-b646-e8766eba16fa None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:51.152093 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-83818fec-d9e3-4e29-9738-fc1b23e59423 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:17:51.152093 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:51.152093 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:51.152093 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:51.152093 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:51.152093 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:51.152093 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:51.152093 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:51.152093 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:51.152093 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:51.152093 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:51.152093 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:51.152093 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:17:51.152093 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:17:51.152093 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:17:51.152093 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:17:51.157918 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:51.157918 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:51.157918 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:51.157918 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:51.157918 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:51.157918 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:51.157918 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:51.157918 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:51.157918 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:51.157918 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:51.157918 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:51.157918 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:51.157918 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:51.157918 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:51.157918 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:51.157918 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:51.157918 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:17:51.159117 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:17:51.159117 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:17:51.159117 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:51.159117 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 546/1098] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:17:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:17:51.159117 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83818fec-d9e3-4e29-9738-fc1b23e59423 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:51.167523 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:51.248861 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ee74e-fa0a-49b0-b646-e8766eba16fa None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:51.259369 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83818fec-d9e3-4e29-9738-fc1b23e59423 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:51.282806 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8048116-8923-41af-8483-e93b67dadba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:51.283451 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8048116-8923-41af-8483-e93b67dadba1 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:51.283727 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8048116-8923-41af-8483-e93b67dadba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:51.283996 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8048116-8923-41af-8483-e93b67dadba1 None admin] PATH_INFO: `/v3/users/2b09399db02c4e8ab7756f49f9fa6b08` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:51.285111 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8048116-8923-41af-8483-e93b67dadba1 None admin] RBAC: Authorizing `identity:get_user(user_id=2b09399db02c4e8ab7756f49f9fa6b08)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:51.286554 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8048116-8923-41af-8483-e93b67dadba1 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:51.288271 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 553/1099] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 30 01:17:51 2022] GET /identity/v3/users/2b09399db02c4e8ab7756f49f9fa6b08 => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:17:51.293920 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df64f9e-1807-45de-ad00-508e02a2679d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:51.294087 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8048116-8923-41af-8483-e93b67dadba1 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:51.294529 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df64f9e-1807-45de-ad00-508e02a2679d None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:51.294806 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df64f9e-1807-45de-ad00-508e02a2679d None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:51.295074 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df64f9e-1807-45de-ad00-508e02a2679d None admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:51.295742 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df64f9e-1807-45de-ad00-508e02a2679d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:51.296045 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df64f9e-1807-45de-ad00-508e02a2679d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:51.297408 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df64f9e-1807-45de-ad00-508e02a2679d None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:51.308724 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 547/1100] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:17:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:17:51.314722 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df64f9e-1807-45de-ad00-508e02a2679d None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:51.324447 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:51.381766 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:51.399468 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8048116-8923-41af-8483-e93b67dadba1 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:51.424792 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df64f9e-1807-45de-ad00-508e02a2679d None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:51.432618 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b47cdf4-1aa3-4231-a03d-d104d85b36a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:51.433218 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47cdf4-1aa3-4231-a03d-d104d85b36a3 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:51.433494 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47cdf4-1aa3-4231-a03d-d104d85b36a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:51.433763 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47cdf4-1aa3-4231-a03d-d104d85b36a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:51.461115 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9037c53-2943-4e8d-a859-5388e2082fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:51.462300 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9037c53-2943-4e8d-a859-5388e2082fad None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:51.462578 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9037c53-2943-4e8d-a859-5388e2082fad None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:51.462848 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9037c53-2943-4e8d-a859-5388e2082fad None admin] PATH_INFO: `/v3/projects/service` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:51.469682 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9037c53-2943-4e8d-a859-5388e2082fad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:51.471107 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9037c53-2943-4e8d-a859-5388e2082fad None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:51.482232 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-f9037c53-2943-4e8d-a859-5388e2082fad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:17:51.482232 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:17:51.482232 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:17:51.482232 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:17:51.482232 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:17:51.482232 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:17:51.482232 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:17:51.482232 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:17:51.482232 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:17:51.482232 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:17:51.482232 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:17:51.482232 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:17:51.482232 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 01:17:51.482232 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 01:17:51.482232 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 01:17:51.483142 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 01:17:51.483142 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:17:51.483142 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:17:51.483142 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:17:51.483142 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:17:51.483142 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:17:51.483142 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:17:51.483142 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:17:51.483142 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:17:51.483142 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:17:51.483142 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:17:51.483142 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:17:51.483142 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:17:51.483142 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:17:51.483142 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:17:51.483142 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:17:51.483142 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:17:51.484346 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 01:17:51.484346 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 01:17:51.484346 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 01:17:51.484346 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 01:17:51.484346 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 01:17:51.484346 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 01:17:51.484346 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:17:51.484346 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:17:51.484346 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 548/1101] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 30 01:17:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:17:51.489694 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9037c53-2943-4e8d-a859-5388e2082fad None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:51.504549 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b47cdf4-1aa3-4231-a03d-d104d85b36a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:51.505998 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b47cdf4-1aa3-4231-a03d-d104d85b36a3 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:51.535890 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:51.592675 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9037c53-2943-4e8d-a859-5388e2082fad None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:51.612309 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 554/1102] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 30 01:17:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 01:17:51.618100 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b47cdf4-1aa3-4231-a03d-d104d85b36a3 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:51.619104 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:51.630928 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf42eeae-9569-41c0-ba67-967bc87e1df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:51.631571 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf42eeae-9569-41c0-ba67-967bc87e1df7 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:51.631904 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf42eeae-9569-41c0-ba67-967bc87e1df7 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:51.632124 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf42eeae-9569-41c0-ba67-967bc87e1df7 None admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:51.632811 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf42eeae-9569-41c0-ba67-967bc87e1df7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:51.633113 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf42eeae-9569-41c0-ba67-967bc87e1df7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:51.634527 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf42eeae-9569-41c0-ba67-967bc87e1df7 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:51.646155 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 549/1103] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 30 01:17:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:17:51.652111 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf42eeae-9569-41c0-ba67-967bc87e1df7 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:51.716723 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b47cdf4-1aa3-4231-a03d-d104d85b36a3 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:51.745283 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:51.749441 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf42eeae-9569-41c0-ba67-967bc87e1df7 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:51.751413 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d3fdb-ab73-4eca-821d-0b9d6e2fa8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:51.752068 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d3fdb-ab73-4eca-821d-0b9d6e2fa8a2 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:51.752346 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d3fdb-ab73-4eca-821d-0b9d6e2fa8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:51.752615 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d3fdb-ab73-4eca-821d-0b9d6e2fa8a2 None admin] PATH_INFO: `/v3/projects/8bf756ef3cd649319539495d632ed38a` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:51.753727 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5d3fdb-ab73-4eca-821d-0b9d6e2fa8a2 None admin] RBAC: Authorizing `identity:get_project(project_id=8bf756ef3cd649319539495d632ed38a)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:51.755165 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5d3fdb-ab73-4eca-821d-0b9d6e2fa8a2 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:51.756820 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 555/1104] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 30 01:17:51 2022] GET /identity/v3/projects/8bf756ef3cd649319539495d632ed38a => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:17:51.762762 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d3fdb-ab73-4eca-821d-0b9d6e2fa8a2 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:51.785110 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7292bb5-be70-450e-aebf-b1d54d7fb4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:51.785716 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7292bb5-be70-450e-aebf-b1d54d7fb4a3 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:51.785995 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7292bb5-be70-450e-aebf-b1d54d7fb4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:51.786263 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7292bb5-be70-450e-aebf-b1d54d7fb4a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:51.787016 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7292bb5-be70-450e-aebf-b1d54d7fb4a3 None admin] RBAC: Adding query filter params (role.id=3cf30b69be074b7bade51cb0dc428655, scope.project.id=b050b2dad22a4a06875072e44c8c9824, user.id=8889145228a24fb6bd539a11925e62f2) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:51.787352 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7292bb5-be70-450e-aebf-b1d54d7fb4a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:51.788803 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7292bb5-be70-450e-aebf-b1d54d7fb4a3 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:51.794551 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 550/1105] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 30 01:17:51 2022] GET /identity/v3/role_assignments?user.id=8889145228a24fb6bd539a11925e62f2&scope.project.id=b050b2dad22a4a06875072e44c8c9824&role.id=3cf30b69be074b7bade51cb0dc428655 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:17:51.870523 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d3fdb-ab73-4eca-821d-0b9d6e2fa8a2 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:51.905821 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f133db1a-100c-4b79-840d-5598a15b0d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:51.906344 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f133db1a-100c-4b79-840d-5598a15b0d6d None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:51.906621 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f133db1a-100c-4b79-840d-5598a15b0d6d None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:51.906893 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f133db1a-100c-4b79-840d-5598a15b0d6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:51.908171 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f133db1a-100c-4b79-840d-5598a15b0d6d None admin] RBAC: Adding query filter params (role.id=f6bc03b6972e420eb338ee7fd1443974, scope.project.id=8bf756ef3cd649319539495d632ed38a, user.id=2b09399db02c4e8ab7756f49f9fa6b08) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:51.908479 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f133db1a-100c-4b79-840d-5598a15b0d6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:51.909938 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f133db1a-100c-4b79-840d-5598a15b0d6d None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:51.916273 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 556/1106] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 30 01:17:51 2022] GET /identity/v3/role_assignments?user.id=2b09399db02c4e8ab7756f49f9fa6b08&scope.project.id=8bf756ef3cd649319539495d632ed38a&role.id=f6bc03b6972e420eb338ee7fd1443974 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:17:53.860943 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c0be3-e9fe-43cc-b179-ae4718faaeae None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:53.861469 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c0be3-e9fe-43cc-b179-ae4718faaeae None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:53.861469 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c0be3-e9fe-43cc-b179-ae4718faaeae None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:53.862749 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 551/1107] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:17:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:17:53.867889 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e4d5b-7f8c-427a-b142-25624803bb87 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:53.868299 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e4d5b-7f8c-427a-b142-25624803bb87 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:53.868439 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e4d5b-7f8c-427a-b142-25624803bb87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:53.886484 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-2d8e4d5b-7f8c-427a-b142-25624803bb87 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:53.887721 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-2d8e4d5b-7f8c-427a-b142-25624803bb87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:53.945643 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:53.954669 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 557/1108] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:17:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:17:54.227282 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423c0be3-e9fe-43cc-b179-ae4718faaeae None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:54.277546 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:54.327658 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423c0be3-e9fe-43cc-b179-ae4718faaeae None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:54.361455 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c402998-aacb-4c0c-8a71-26fa4cd1203a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:54.362069 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c402998-aacb-4c0c-8a71-26fa4cd1203a None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:54.362349 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c402998-aacb-4c0c-8a71-26fa4cd1203a None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:54.362621 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c402998-aacb-4c0c-8a71-26fa4cd1203a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:54.363741 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c402998-aacb-4c0c-8a71-26fa4cd1203a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:54.365165 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c402998-aacb-4c0c-8a71-26fa4cd1203a None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:54.366709 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 552/1109] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:17:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:54.372459 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8e4d5b-7f8c-427a-b142-25624803bb87 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:54.469204 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8e4d5b-7f8c-427a-b142-25624803bb87 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:54.502288 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dbac4c-2423-49d8-b86e-78d589720489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:54.502813 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dbac4c-2423-49d8-b86e-78d589720489 None admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:54.503086 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dbac4c-2423-49d8-b86e-78d589720489 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:54.503352 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dbac4c-2423-49d8-b86e-78d589720489 None admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:54.504017 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dbac4c-2423-49d8-b86e-78d589720489 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:54.505542 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dbac4c-2423-49d8-b86e-78d589720489 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:54.526296 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 558/1110] 10.222.0.60 () {60 vars in 1132 bytes} [Tue Aug 30 01:17:54 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:17:56.446134 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43586f-c652-48a7-91fd-f549e7d1db18 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:56.446771 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43586f-c652-48a7-91fd-f549e7d1db18 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:56.446771 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43586f-c652-48a7-91fd-f549e7d1db18 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:56.448016 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 553/1111] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:17:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:17:56.453023 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42d073-cca7-4183-9e29-bdea83dca2cd None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:56.453446 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42d073-cca7-4183-9e29-bdea83dca2cd None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:56.453582 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42d073-cca7-4183-9e29-bdea83dca2cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:56.473151 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-dc42d073-cca7-4183-9e29-bdea83dca2cd None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:56.474362 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-dc42d073-cca7-4183-9e29-bdea83dca2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:56.520035 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:56.541218 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 559/1112] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:17:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:17:56.810820 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c43586f-c652-48a7-91fd-f549e7d1db18 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:56.910167 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c43586f-c652-48a7-91fd-f549e7d1db18 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:56.927208 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:56.944249 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e89a0-f0a8-4eb6-8dfe-b56b620e6fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:56.944862 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e89a0-f0a8-4eb6-8dfe-b56b620e6fe3 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:56.945142 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e89a0-f0a8-4eb6-8dfe-b56b620e6fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:56.945416 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e89a0-f0a8-4eb6-8dfe-b56b620e6fe3 None admin] PATH_INFO: `/v3/roles/449624f20ef248ef97aeceba5b22eccd` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:56.946796 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823e89a0-f0a8-4eb6-8dfe-b56b620e6fe3 None admin] RBAC: Authorizing `identity:get_role(role_id=449624f20ef248ef97aeceba5b22eccd)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:56.948188 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823e89a0-f0a8-4eb6-8dfe-b56b620e6fe3 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:56.949523 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 554/1113] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 30 01:17:56 2022] GET /identity/v3/roles/449624f20ef248ef97aeceba5b22eccd => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:56.955523 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc42d073-cca7-4183-9e29-bdea83dca2cd None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:57.051904 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc42d073-cca7-4183-9e29-bdea83dca2cd None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:57.085202 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4826a5-e268-4ba1-be1b-81b1f19b9957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:57.085758 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4826a5-e268-4ba1-be1b-81b1f19b9957 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:57.086039 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4826a5-e268-4ba1-be1b-81b1f19b9957 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:57.086311 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4826a5-e268-4ba1-be1b-81b1f19b9957 None admin] PATH_INFO: `/v3/users/459929dfa75449e383cfecf1d7028e7a` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:57.099723 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4826a5-e268-4ba1-be1b-81b1f19b9957 None admin] RBAC: Authorizing `identity:get_user(user_id=459929dfa75449e383cfecf1d7028e7a)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:57.101174 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4826a5-e268-4ba1-be1b-81b1f19b9957 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:57.102747 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 560/1114] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 30 01:17:56 2022] GET /identity/v3/users/459929dfa75449e383cfecf1d7028e7a => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:17:57.108575 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e89a0-f0a8-4eb6-8dfe-b56b620e6fe3 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:57.205477 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e89a0-f0a8-4eb6-8dfe-b56b620e6fe3 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:57.238718 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a853110-d794-4d05-82ae-ecd06c0ea575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:57.239314 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a853110-d794-4d05-82ae-ecd06c0ea575 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:57.239633 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a853110-d794-4d05-82ae-ecd06c0ea575 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:57.239909 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a853110-d794-4d05-82ae-ecd06c0ea575 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:57.292387 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:57.305460 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a853110-d794-4d05-82ae-ecd06c0ea575 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:57.306892 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a853110-d794-4d05-82ae-ecd06c0ea575 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:57.402037 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 555/1115] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 30 01:17:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 01:17:57.407964 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4826a5-e268-4ba1-be1b-81b1f19b9957 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:57.448621 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:57.507160 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4826a5-e268-4ba1-be1b-81b1f19b9957 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:57.539603 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc574412-4300-4b96-9806-dbf327047d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:57.540216 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc574412-4300-4b96-9806-dbf327047d91 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:57.540492 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc574412-4300-4b96-9806-dbf327047d91 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:57.540758 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc574412-4300-4b96-9806-dbf327047d91 None admin] PATH_INFO: `/v3/projects/8bf756ef3cd649319539495d632ed38a` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:57.541853 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc574412-4300-4b96-9806-dbf327047d91 None admin] RBAC: Authorizing `identity:get_project(project_id=8bf756ef3cd649319539495d632ed38a)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:57.543284 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc574412-4300-4b96-9806-dbf327047d91 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:57.544919 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 561/1116] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 30 01:17:57 2022] GET /identity/v3/projects/8bf756ef3cd649319539495d632ed38a => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:57.551898 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a853110-d794-4d05-82ae-ecd06c0ea575 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:17:57.635497 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:57.650688 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a853110-d794-4d05-82ae-ecd06c0ea575 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:17:57.683544 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd826bc0-7e26-4e8f-812c-9029cd37fa75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:17:57.684074 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd826bc0-7e26-4e8f-812c-9029cd37fa75 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:57.684349 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd826bc0-7e26-4e8f-812c-9029cd37fa75 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:57.684615 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd826bc0-7e26-4e8f-812c-9029cd37fa75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:57.685321 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd826bc0-7e26-4e8f-812c-9029cd37fa75 None admin] RBAC: Adding query filter params (role.id=449624f20ef248ef97aeceba5b22eccd, scope.project.id=8bf756ef3cd649319539495d632ed38a, user.id=459929dfa75449e383cfecf1d7028e7a) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:17:57.685624 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd826bc0-7e26-4e8f-812c-9029cd37fa75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:17:57.687036 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd826bc0-7e26-4e8f-812c-9029cd37fa75 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:17:57.692189 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 556/1117] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 30 01:17:57 2022] GET /identity/v3/role_assignments?user.id=459929dfa75449e383cfecf1d7028e7a&scope.project.id=8bf756ef3cd649319539495d632ed38a&role.id=449624f20ef248ef97aeceba5b22eccd => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:17:59.593515 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405d6c1-ff44-4182-81c5-fc2330a06b6e None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:59.594057 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405d6c1-ff44-4182-81c5-fc2330a06b6e None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:59.594057 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405d6c1-ff44-4182-81c5-fc2330a06b6e None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:59.595390 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 562/1118] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:17:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:17:59.600748 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d8e60-3091-4d4c-94cd-16313485a243 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:17:59.601117 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d8e60-3091-4d4c-94cd-16313485a243 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:17:59.601289 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d8e60-3091-4d4c-94cd-16313485a243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:17:59.619051 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-048d8e60-3091-4d4c-94cd-16313485a243 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:17:59.620242 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-048d8e60-3091-4d4c-94cd-16313485a243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:17:59.683948 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 557/1119] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:17:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:17:59.950633 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9405d6c1-ff44-4182-81c5-fc2330a06b6e None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:00.050168 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9405d6c1-ff44-4182-81c5-fc2330a06b6e None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:00.057359 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:00.084428 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64016db-627d-4aa0-a906-0d3b25922331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:00.085041 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64016db-627d-4aa0-a906-0d3b25922331 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:00.085319 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64016db-627d-4aa0-a906-0d3b25922331 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:00.085591 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64016db-627d-4aa0-a906-0d3b25922331 None admin] PATH_INFO: `/v3/roles/449624f20ef248ef97aeceba5b22eccd` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:00.086971 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64016db-627d-4aa0-a906-0d3b25922331 None admin] RBAC: Authorizing `identity:get_role(role_id=449624f20ef248ef97aeceba5b22eccd)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:00.088372 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64016db-627d-4aa0-a906-0d3b25922331 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:00.089680 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 563/1120] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 30 01:17:59 2022] GET /identity/v3/roles/449624f20ef248ef97aeceba5b22eccd => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:18:00.095820 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d8e60-3091-4d4c-94cd-16313485a243 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:00.172962 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:00.191548 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d8e60-3091-4d4c-94cd-16313485a243 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:00.224524 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96121a-6bfc-4156-87c1-b07426261660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:00.225076 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96121a-6bfc-4156-87c1-b07426261660 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:00.225353 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96121a-6bfc-4156-87c1-b07426261660 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:00.225624 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96121a-6bfc-4156-87c1-b07426261660 None admin] PATH_INFO: `/v3/users/459929dfa75449e383cfecf1d7028e7a` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:00.226724 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e96121a-6bfc-4156-87c1-b07426261660 None admin] RBAC: Authorizing `identity:get_user(user_id=459929dfa75449e383cfecf1d7028e7a)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:00.228174 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e96121a-6bfc-4156-87c1-b07426261660 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:00.229729 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 558/1121] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 30 01:18:00 2022] GET /identity/v3/users/459929dfa75449e383cfecf1d7028e7a => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:18:00.235539 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64016db-627d-4aa0-a906-0d3b25922331 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:00.333233 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64016db-627d-4aa0-a906-0d3b25922331 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:00.366219 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c92f29-0a29-4397-a3c6-0c2c79e2dfa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:00.366838 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c92f29-0a29-4397-a3c6-0c2c79e2dfa2 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:00.367118 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c92f29-0a29-4397-a3c6-0c2c79e2dfa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:00.367390 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c92f29-0a29-4397-a3c6-0c2c79e2dfa2 None admin] PATH_INFO: `/v3/projects/8bf756ef3cd649319539495d632ed38a` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:00.368537 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c92f29-0a29-4397-a3c6-0c2c79e2dfa2 None admin] RBAC: Authorizing `identity:get_project(project_id=8bf756ef3cd649319539495d632ed38a)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:00.369977 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c92f29-0a29-4397-a3c6-0c2c79e2dfa2 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:00.371623 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 564/1122] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 30 01:18:00 2022] GET /identity/v3/projects/8bf756ef3cd649319539495d632ed38a => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:18:00.378211 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96121a-6bfc-4156-87c1-b07426261660 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:00.474804 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96121a-6bfc-4156-87c1-b07426261660 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:00.507858 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caabf258-0a43-4f2f-9a45-e73ed579d4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:00.508500 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caabf258-0a43-4f2f-9a45-e73ed579d4db None admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:00.508781 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caabf258-0a43-4f2f-9a45-e73ed579d4db None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:00.509056 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caabf258-0a43-4f2f-9a45-e73ed579d4db None admin] PATH_INFO: `/v3/projects/8bf756ef3cd649319539495d632ed38a/users/459929dfa75449e383cfecf1d7028e7a/roles/449624f20ef248ef97aeceba5b22eccd` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:00.511149 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caabf258-0a43-4f2f-9a45-e73ed579d4db None admin] RBAC: Authorizing `identity:create_grant(project_id=8bf756ef3cd649319539495d632ed38a, user_id=459929dfa75449e383cfecf1d7028e7a, role_id=449624f20ef248ef97aeceba5b22eccd)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:00.512701 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caabf258-0a43-4f2f-9a45-e73ed579d4db None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:00.524848 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 559/1123] 10.222.0.60 () {58 vars in 1439 bytes} [Tue Aug 30 01:18:00 2022] PUT /identity/v3/projects/8bf756ef3cd649319539495d632ed38a/users/459929dfa75449e383cfecf1d7028e7a/roles/449624f20ef248ef97aeceba5b22eccd => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:18:02.387621 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f2de2-a7b2-4f41-a91c-607265555ec6 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:02.388154 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f2de2-a7b2-4f41-a91c-607265555ec6 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:02.388154 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f2de2-a7b2-4f41-a91c-607265555ec6 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:02.389473 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 565/1124] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:18:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:18:02.394619 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b180d769-18da-44e9-ac33-976a2b1133ef None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:02.395025 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b180d769-18da-44e9-ac33-976a2b1133ef None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:02.395170 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b180d769-18da-44e9-ac33-976a2b1133ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:02.413357 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-b180d769-18da-44e9-ac33-976a2b1133ef None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:18:02.414545 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-b180d769-18da-44e9-ac33-976a2b1133ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:02.416486 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:02.490306 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 560/1125] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:18:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:18:02.759023 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f2de2-a7b2-4f41-a91c-607265555ec6 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:02.804648 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:02.862189 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f2de2-a7b2-4f41-a91c-607265555ec6 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:02.895731 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba30a074-815f-46c0-adc2-449e812ab295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:02.896344 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30a074-815f-46c0-adc2-449e812ab295 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:02.896621 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30a074-815f-46c0-adc2-449e812ab295 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:02.896891 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30a074-815f-46c0-adc2-449e812ab295 None admin] PATH_INFO: `/v3/roles/449624f20ef248ef97aeceba5b22eccd` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:02.898264 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba30a074-815f-46c0-adc2-449e812ab295 None admin] RBAC: Authorizing `identity:get_role(role_id=449624f20ef248ef97aeceba5b22eccd)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:02.899659 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba30a074-815f-46c0-adc2-449e812ab295 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:02.900971 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 566/1126] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 30 01:18:02 2022] GET /identity/v3/roles/449624f20ef248ef97aeceba5b22eccd => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:18:02.907340 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b180d769-18da-44e9-ac33-976a2b1133ef None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:03.002136 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b180d769-18da-44e9-ac33-976a2b1133ef None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:03.035733 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9443cb4-ef42-48f6-943e-53f0ad820006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:03.036288 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9443cb4-ef42-48f6-943e-53f0ad820006 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:03.036656 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9443cb4-ef42-48f6-943e-53f0ad820006 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:03.036979 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9443cb4-ef42-48f6-943e-53f0ad820006 None admin] PATH_INFO: `/v3/users/459929dfa75449e383cfecf1d7028e7a` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:03.038055 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9443cb4-ef42-48f6-943e-53f0ad820006 None admin] RBAC: Authorizing `identity:get_user(user_id=459929dfa75449e383cfecf1d7028e7a)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:03.039502 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9443cb4-ef42-48f6-943e-53f0ad820006 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:03.041086 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 561/1127] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 30 01:18:02 2022] GET /identity/v3/users/459929dfa75449e383cfecf1d7028e7a => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:18:03.046863 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba30a074-815f-46c0-adc2-449e812ab295 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:03.143749 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba30a074-815f-46c0-adc2-449e812ab295 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:03.153969 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:03.176569 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e56d88-14b1-4750-93a4-6d399e2b27e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:03.177163 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e56d88-14b1-4750-93a4-6d399e2b27e0 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:03.177440 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e56d88-14b1-4750-93a4-6d399e2b27e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:03.177705 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e56d88-14b1-4750-93a4-6d399e2b27e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:03.242114 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e56d88-14b1-4750-93a4-6d399e2b27e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:03.243583 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e56d88-14b1-4750-93a4-6d399e2b27e0 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:03.339789 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 567/1128] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 30 01:18:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 01:18:03.345884 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9443cb4-ef42-48f6-943e-53f0ad820006 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:03.354674 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:03.442918 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9443cb4-ef42-48f6-943e-53f0ad820006 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:03.475859 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b33366-cb84-40b4-ad20-3488952426e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:03.476501 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b33366-cb84-40b4-ad20-3488952426e8 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:03.476764 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b33366-cb84-40b4-ad20-3488952426e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:03.477036 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b33366-cb84-40b4-ad20-3488952426e8 None admin] PATH_INFO: `/v3/projects/8bf756ef3cd649319539495d632ed38a` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:03.478141 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b33366-cb84-40b4-ad20-3488952426e8 None admin] RBAC: Authorizing `identity:get_project(project_id=8bf756ef3cd649319539495d632ed38a)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:03.479606 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b33366-cb84-40b4-ad20-3488952426e8 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:03.481239 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 562/1129] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 30 01:18:03 2022] GET /identity/v3/projects/8bf756ef3cd649319539495d632ed38a => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:18:03.487976 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e56d88-14b1-4750-93a4-6d399e2b27e0 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:03.499271 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:03.584945 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e56d88-14b1-4750-93a4-6d399e2b27e0 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:03.618638 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac182c2e-8830-450e-b8f1-e1055b04cf83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:03.619239 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac182c2e-8830-450e-b8f1-e1055b04cf83 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:03.619550 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac182c2e-8830-450e-b8f1-e1055b04cf83 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:03.619827 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac182c2e-8830-450e-b8f1-e1055b04cf83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:03.620546 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac182c2e-8830-450e-b8f1-e1055b04cf83 None admin] RBAC: Adding query filter params (role.id=449624f20ef248ef97aeceba5b22eccd, scope.project.id=8bf756ef3cd649319539495d632ed38a, user.id=459929dfa75449e383cfecf1d7028e7a) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:18:03.620850 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac182c2e-8830-450e-b8f1-e1055b04cf83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:03.622273 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac182c2e-8830-450e-b8f1-e1055b04cf83 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:03.628409 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 568/1130] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 30 01:18:03 2022] GET /identity/v3/role_assignments?user.id=459929dfa75449e383cfecf1d7028e7a&scope.project.id=8bf756ef3cd649319539495d632ed38a&role.id=449624f20ef248ef97aeceba5b22eccd => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:18:05.539196 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d576b-18b0-4724-af36-35c9b3912746 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:05.539891 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d576b-18b0-4724-af36-35c9b3912746 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:05.539891 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d576b-18b0-4724-af36-35c9b3912746 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:05.541116 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 563/1131] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:18:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:18:05.546233 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2f895-c1b7-484b-956d-a505396f6663 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:05.546605 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2f895-c1b7-484b-956d-a505396f6663 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:05.546777 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2f895-c1b7-484b-956d-a505396f6663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:05.564858 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-9bf2f895-c1b7-484b-956d-a505396f6663 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:18:05.566022 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-9bf2f895-c1b7-484b-956d-a505396f6663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:05.631736 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 569/1132] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:18:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:18:05.902682 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863d576b-18b0-4724-af36-35c9b3912746 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:05.976847 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:06.003901 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863d576b-18b0-4724-af36-35c9b3912746 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:06.037742 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe7f6f8-f6b1-4a73-ab28-1345419d09ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:06.038362 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7f6f8-f6b1-4a73-ab28-1345419d09ba None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:06.038641 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7f6f8-f6b1-4a73-ab28-1345419d09ba None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:06.038912 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7f6f8-f6b1-4a73-ab28-1345419d09ba None admin] PATH_INFO: `/v3/domains/default` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:06.040029 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe7f6f8-f6b1-4a73-ab28-1345419d09ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:06.041454 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe7f6f8-f6b1-4a73-ab28-1345419d09ba None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:06.043004 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 564/1133] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:18:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:18:06.049435 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2f895-c1b7-484b-956d-a505396f6663 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:06.052600 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:06.146367 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2f895-c1b7-484b-956d-a505396f6663 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:06.180310 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4441073e-13c4-468b-a0c1-1339a7f40b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:06.180945 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4441073e-13c4-468b-a0c1-1339a7f40b9e None admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:06.181224 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4441073e-13c4-468b-a0c1-1339a7f40b9e None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:06.181499 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4441073e-13c4-468b-a0c1-1339a7f40b9e None admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:06.182578 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4441073e-13c4-468b-a0c1-1339a7f40b9e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:06.184342 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4441073e-13c4-468b-a0c1-1339a7f40b9e None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:06.221103 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 570/1134] 10.222.0.60 () {60 vars in 1141 bytes} [Tue Aug 30 01:18:06 2022] POST /identity/v3/projects => generated 311 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:18:08.137740 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aaa337-8f78-4fd0-8189-f1fe1128dab5 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:08.138371 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aaa337-8f78-4fd0-8189-f1fe1128dab5 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:08.138371 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aaa337-8f78-4fd0-8189-f1fe1128dab5 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:08.139643 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 565/1135] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:18:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:18:08.147414 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87059c98-9454-4bdb-9bdf-009a8f6350f6 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:08.147868 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87059c98-9454-4bdb-9bdf-009a8f6350f6 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:08.147973 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87059c98-9454-4bdb-9bdf-009a8f6350f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:08.166185 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-87059c98-9454-4bdb-9bdf-009a8f6350f6 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:18:08.167374 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-87059c98-9454-4bdb-9bdf-009a8f6350f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:08.216554 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:08.234378 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 571/1136] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:18:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:18:08.503795 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aaa337-8f78-4fd0-8189-f1fe1128dab5 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:08.602568 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aaa337-8f78-4fd0-8189-f1fe1128dab5 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:08.635554 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab06864-9f8a-4ce8-b926-287d2b7805c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:08.636167 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab06864-9f8a-4ce8-b926-287d2b7805c1 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:08.636445 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab06864-9f8a-4ce8-b926-287d2b7805c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:08.636717 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab06864-9f8a-4ce8-b926-287d2b7805c1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:08.637806 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab06864-9f8a-4ce8-b926-287d2b7805c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:08.639230 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab06864-9f8a-4ce8-b926-287d2b7805c1 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:08.640812 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 566/1137] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:18:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:18:08.647069 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87059c98-9454-4bdb-9bdf-009a8f6350f6 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:08.743151 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87059c98-9454-4bdb-9bdf-009a8f6350f6 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:08.776399 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13fbfaf-0c06-4e3a-b517-33ad08af8464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:08.776928 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13fbfaf-0c06-4e3a-b517-33ad08af8464 None admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:08.777200 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13fbfaf-0c06-4e3a-b517-33ad08af8464 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:08.777464 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13fbfaf-0c06-4e3a-b517-33ad08af8464 None admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:08.778114 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13fbfaf-0c06-4e3a-b517-33ad08af8464 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:08.779568 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13fbfaf-0c06-4e3a-b517-33ad08af8464 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:08.800874 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 572/1138] 10.222.0.60 () {60 vars in 1132 bytes} [Tue Aug 30 01:18:08 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:18:10.713737 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365188a7-b8d1-4172-84b6-ca21720b3ae6 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:10.714286 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365188a7-b8d1-4172-84b6-ca21720b3ae6 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:10.714286 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365188a7-b8d1-4172-84b6-ca21720b3ae6 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:10.715889 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 567/1139] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:18:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:18:10.721501 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee7c78-859a-4dec-90c8-efeffb00258d None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:10.721888 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee7c78-859a-4dec-90c8-efeffb00258d None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:10.722048 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee7c78-859a-4dec-90c8-efeffb00258d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:10.740328 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-0fee7c78-859a-4dec-90c8-efeffb00258d None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:18:10.741510 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-0fee7c78-859a-4dec-90c8-efeffb00258d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:10.778287 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:10.810559 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 573/1140] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:18:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:18:11.078236 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365188a7-b8d1-4172-84b6-ca21720b3ae6 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:11.091253 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:11.180786 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365188a7-b8d1-4172-84b6-ca21720b3ae6 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:11.214086 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2194df0-73c6-4fc5-a463-1a15200ab65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:11.214698 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2194df0-73c6-4fc5-a463-1a15200ab65b None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:11.214971 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2194df0-73c6-4fc5-a463-1a15200ab65b None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:11.215239 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2194df0-73c6-4fc5-a463-1a15200ab65b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:11.226250 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2194df0-73c6-4fc5-a463-1a15200ab65b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:18:11.231118 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-e2194df0-73c6-4fc5-a463-1a15200ab65b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:18:11.231118 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:18:11.231118 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:18:11.231118 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:18:11.231118 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:18:11.231118 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:18:11.231118 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:18:11.231118 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:18:11.231118 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:18:11.231118 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:18:11.231118 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:18:11.231118 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:18:11.231118 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:18:11.231118 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:18:11.231118 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:18:11.231118 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:18:11.232319 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:18:11.232319 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:18:11.232319 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:18:11.232319 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:18:11.232319 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:18:11.232319 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:18:11.232319 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:18:11.232319 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:18:11.232319 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:18:11.232319 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:18:11.232319 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:18:11.232319 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:18:11.232319 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:18:11.232319 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:18:11.232319 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:18:11.232319 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:18:11.233506 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:18:11.233506 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:18:11.233506 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:18:11.233506 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:18:11.233506 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:18:11.233506 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:18:11.233506 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:18:11.233506 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:18:11.233506 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:18:11.233506 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:18:11.233506 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:18:11.233506 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:18:11.233506 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 568/1141] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 30 01:18:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:18:11.238750 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee7c78-859a-4dec-90c8-efeffb00258d None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:11.336063 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee7c78-859a-4dec-90c8-efeffb00258d None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:11.368554 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee2bc49-7e45-4c02-b35f-2d6215699c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:11.369148 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2bc49-7e45-4c02-b35f-2d6215699c49 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:11.369426 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2bc49-7e45-4c02-b35f-2d6215699c49 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:11.369696 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2bc49-7e45-4c02-b35f-2d6215699c49 None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:11.370353 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee2bc49-7e45-4c02-b35f-2d6215699c49 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:18:11.370652 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee2bc49-7e45-4c02-b35f-2d6215699c49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:11.372051 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee2bc49-7e45-4c02-b35f-2d6215699c49 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:11.380279 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 574/1142] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 30 01:18:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:18:11.386260 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2194df0-73c6-4fc5-a463-1a15200ab65b None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:11.454027 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:11.484012 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2194df0-73c6-4fc5-a463-1a15200ab65b None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:11.518601 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccf6bb6-4299-44dc-bf39-90d6d5fb0fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:11.519210 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccf6bb6-4299-44dc-bf39-90d6d5fb0fdf None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:11.519513 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccf6bb6-4299-44dc-bf39-90d6d5fb0fdf None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:11.519786 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccf6bb6-4299-44dc-bf39-90d6d5fb0fdf None admin] PATH_INFO: `/v3/users/08355ec70ff44153802bb530e93fab9b` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:11.532423 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccf6bb6-4299-44dc-bf39-90d6d5fb0fdf None admin] RBAC: Authorizing `identity:get_user(user_id=08355ec70ff44153802bb530e93fab9b)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:11.533954 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccf6bb6-4299-44dc-bf39-90d6d5fb0fdf None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:11.535572 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 569/1143] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 30 01:18:11 2022] GET /identity/v3/users/08355ec70ff44153802bb530e93fab9b => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:18:11.541478 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee2bc49-7e45-4c02-b35f-2d6215699c49 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:11.575638 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:11.642208 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee2bc49-7e45-4c02-b35f-2d6215699c49 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:11.674252 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a8c6a4-6918-499e-b649-bb83e0c9006d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:11.674858 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8c6a4-6918-499e-b649-bb83e0c9006d None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:11.675139 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8c6a4-6918-499e-b649-bb83e0c9006d None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:11.675414 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8c6a4-6918-499e-b649-bb83e0c9006d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:11.740872 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a8c6a4-6918-499e-b649-bb83e0c9006d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:11.742317 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a8c6a4-6918-499e-b649-bb83e0c9006d None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:11.774558 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:11.839051 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 575/1144] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 30 01:18:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 01:18:11.845274 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccf6bb6-4299-44dc-bf39-90d6d5fb0fdf None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:11.943811 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccf6bb6-4299-44dc-bf39-90d6d5fb0fdf None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:11.969468 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:11.977407 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32dfbab-e0cd-4b45-8bcf-a66294625594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:11.978027 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32dfbab-e0cd-4b45-8bcf-a66294625594 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:11.978303 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32dfbab-e0cd-4b45-8bcf-a66294625594 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:11.978571 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32dfbab-e0cd-4b45-8bcf-a66294625594 None admin] PATH_INFO: `/v3/projects/b8f2422f1e814bbda6a22e904823aeaa` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:11.979704 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32dfbab-e0cd-4b45-8bcf-a66294625594 None admin] RBAC: Authorizing `identity:get_project(project_id=b8f2422f1e814bbda6a22e904823aeaa)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:11.981172 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32dfbab-e0cd-4b45-8bcf-a66294625594 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:11.982788 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 570/1145] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 30 01:18:11 2022] GET /identity/v3/projects/b8f2422f1e814bbda6a22e904823aeaa => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:18:11.989733 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a8c6a4-6918-499e-b649-bb83e0c9006d None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:12.085351 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a8c6a4-6918-499e-b649-bb83e0c9006d None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:12.118906 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f962e9c2-9f3e-448f-92a1-f47a036c6899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:12.119519 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f962e9c2-9f3e-448f-92a1-f47a036c6899 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:12.119799 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f962e9c2-9f3e-448f-92a1-f47a036c6899 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:12.120067 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f962e9c2-9f3e-448f-92a1-f47a036c6899 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:12.120779 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f962e9c2-9f3e-448f-92a1-f47a036c6899 None admin] RBAC: Adding query filter params (role.id=f6bc03b6972e420eb338ee7fd1443974, scope.project.id=b8f2422f1e814bbda6a22e904823aeaa, user.id=08355ec70ff44153802bb530e93fab9b) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:18:12.121086 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f962e9c2-9f3e-448f-92a1-f47a036c6899 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:12.122506 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f962e9c2-9f3e-448f-92a1-f47a036c6899 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:12.124232 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:12.128759 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 576/1146] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 30 01:18:11 2022] GET /identity/v3/role_assignments?user.id=08355ec70ff44153802bb530e93fab9b&scope.project.id=b8f2422f1e814bbda6a22e904823aeaa&role.id=f6bc03b6972e420eb338ee7fd1443974 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:18:13.991687 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b51cd-ee9d-4de9-a2da-64ac4483ca55 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:13.992213 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b51cd-ee9d-4de9-a2da-64ac4483ca55 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:13.992213 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b51cd-ee9d-4de9-a2da-64ac4483ca55 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:13.993573 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 571/1147] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:18:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:18:13.998770 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b266b4b-6b9b-4142-8c1d-53d59f6f2270 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:13.999185 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b266b4b-6b9b-4142-8c1d-53d59f6f2270 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:13.999303 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b266b4b-6b9b-4142-8c1d-53d59f6f2270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:14.017454 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-8b266b4b-6b9b-4142-8c1d-53d59f6f2270 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:18:14.018615 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-8b266b4b-6b9b-4142-8c1d-53d59f6f2270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:14.083252 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 577/1148] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:18:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:18:14.353905 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b51cd-ee9d-4de9-a2da-64ac4483ca55 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:14.456433 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b51cd-ee9d-4de9-a2da-64ac4483ca55 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:14.489710 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd14910-22f3-412e-ab21-6e58eed3afa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:14.490322 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd14910-22f3-412e-ab21-6e58eed3afa5 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:14.490602 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd14910-22f3-412e-ab21-6e58eed3afa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:14.490872 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd14910-22f3-412e-ab21-6e58eed3afa5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:14.501258 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd14910-22f3-412e-ab21-6e58eed3afa5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:18:14.506067 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-fdd14910-22f3-412e-ab21-6e58eed3afa5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:18:14.506067 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:18:14.506067 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:18:14.506067 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:18:14.506067 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:18:14.506067 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:18:14.506067 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:18:14.506067 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:18:14.506067 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:18:14.506067 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:18:14.506067 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:18:14.506067 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:18:14.506067 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:18:14.506067 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:18:14.506067 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:18:14.506067 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:18:14.507182 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:18:14.507182 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:18:14.507182 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:18:14.507182 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:18:14.507182 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:18:14.507182 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:18:14.507182 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:18:14.507182 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:18:14.507182 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:18:14.507182 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:18:14.507182 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:18:14.507182 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:18:14.507182 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:18:14.507182 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:18:14.507182 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:18:14.507182 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:18:14.508278 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:18:14.508278 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:18:14.508278 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:18:14.508278 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:18:14.508278 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:18:14.508278 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:18:14.508278 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:18:14.508278 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:18:14.508278 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:18:14.508278 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:18:14.508278 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:18:14.508278 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:18:14.508278 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 572/1149] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 30 01:18:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:18:14.513311 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b266b4b-6b9b-4142-8c1d-53d59f6f2270 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:14.610079 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b266b4b-6b9b-4142-8c1d-53d59f6f2270 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:14.636043 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:14.644573 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a788f486-f2eb-46b1-a392-968f8ddb26a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:14.645173 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788f486-f2eb-46b1-a392-968f8ddb26a7 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:14.645454 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788f486-f2eb-46b1-a392-968f8ddb26a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:14.645730 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788f486-f2eb-46b1-a392-968f8ddb26a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:14.646397 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a788f486-f2eb-46b1-a392-968f8ddb26a7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:18:14.646700 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a788f486-f2eb-46b1-a392-968f8ddb26a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:14.648112 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a788f486-f2eb-46b1-a392-968f8ddb26a7 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:14.655920 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 578/1150] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 30 01:18:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:18:14.662966 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd14910-22f3-412e-ab21-6e58eed3afa5 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:14.721866 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:14.764362 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd14910-22f3-412e-ab21-6e58eed3afa5 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:14.796210 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336086e9-0efc-4c72-b668-2a8abaa1b41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:14.796821 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336086e9-0efc-4c72-b668-2a8abaa1b41d None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:14.797631 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336086e9-0efc-4c72-b668-2a8abaa1b41d None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:14.797898 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336086e9-0efc-4c72-b668-2a8abaa1b41d None admin] PATH_INFO: `/v3/users/08355ec70ff44153802bb530e93fab9b` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:14.799005 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336086e9-0efc-4c72-b668-2a8abaa1b41d None admin] RBAC: Authorizing `identity:get_user(user_id=08355ec70ff44153802bb530e93fab9b)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:14.800455 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336086e9-0efc-4c72-b668-2a8abaa1b41d None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:14.802021 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 573/1151] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 30 01:18:14 2022] GET /identity/v3/users/08355ec70ff44153802bb530e93fab9b => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:18:14.807906 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a788f486-f2eb-46b1-a392-968f8ddb26a7 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:14.910148 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a788f486-f2eb-46b1-a392-968f8ddb26a7 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:14.943334 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d19150-24cc-40cf-84a4-644715ab125b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:14.943982 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d19150-24cc-40cf-84a4-644715ab125b None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:14.944261 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d19150-24cc-40cf-84a4-644715ab125b None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:14.944534 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d19150-24cc-40cf-84a4-644715ab125b None admin] PATH_INFO: `/v3/projects/b8f2422f1e814bbda6a22e904823aeaa` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:14.945729 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d19150-24cc-40cf-84a4-644715ab125b None admin] RBAC: Authorizing `identity:get_project(project_id=b8f2422f1e814bbda6a22e904823aeaa)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:14.947171 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d19150-24cc-40cf-84a4-644715ab125b None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:14.950313 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 579/1152] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 30 01:18:14 2022] GET /identity/v3/projects/b8f2422f1e814bbda6a22e904823aeaa => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:18:14.957140 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336086e9-0efc-4c72-b668-2a8abaa1b41d None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:15.054570 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336086e9-0efc-4c72-b668-2a8abaa1b41d None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:15.077206 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:15.087814 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d340bdc-17b2-4d00-a7d5-8b64d28d19e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:15.088451 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d340bdc-17b2-4d00-a7d5-8b64d28d19e7 None admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:15.088727 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d340bdc-17b2-4d00-a7d5-8b64d28d19e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:15.088994 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d340bdc-17b2-4d00-a7d5-8b64d28d19e7 None admin] PATH_INFO: `/v3/projects/b8f2422f1e814bbda6a22e904823aeaa/users/08355ec70ff44153802bb530e93fab9b/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:15.091112 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d340bdc-17b2-4d00-a7d5-8b64d28d19e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=b8f2422f1e814bbda6a22e904823aeaa, user_id=08355ec70ff44153802bb530e93fab9b, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:15.092563 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d340bdc-17b2-4d00-a7d5-8b64d28d19e7 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:15.106539 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 574/1153] 10.222.0.60 () {58 vars in 1439 bytes} [Tue Aug 30 01:18:14 2022] PUT /identity/v3/projects/b8f2422f1e814bbda6a22e904823aeaa/users/08355ec70ff44153802bb530e93fab9b/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:18:16.986833 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4b46c-062a-42fd-98dd-dc4365bd7a80 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:16.987461 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4b46c-062a-42fd-98dd-dc4365bd7a80 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:16.987461 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4b46c-062a-42fd-98dd-dc4365bd7a80 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:16.988803 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 580/1154] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:18:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:18:16.993922 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74750f-6b25-42d4-846e-4f01d7365a9f None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:16.994306 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74750f-6b25-42d4-846e-4f01d7365a9f None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:16.994473 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74750f-6b25-42d4-846e-4f01d7365a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:17.012264 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-6d74750f-6b25-42d4-846e-4f01d7365a9f None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:18:17.013443 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-6d74750f-6b25-42d4-846e-4f01d7365a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:17.077351 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 575/1155] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:18:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:18:17.346001 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c4b46c-062a-42fd-98dd-dc4365bd7a80 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:17.403865 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:17.446282 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c4b46c-062a-42fd-98dd-dc4365bd7a80 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:17.478285 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12a87dc-e962-484c-9aae-9b87a16850f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:17.478892 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12a87dc-e962-484c-9aae-9b87a16850f8 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:17.479166 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12a87dc-e962-484c-9aae-9b87a16850f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:17.479462 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12a87dc-e962-484c-9aae-9b87a16850f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:17.491047 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12a87dc-e962-484c-9aae-9b87a16850f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:18:17.495898 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-a12a87dc-e962-484c-9aae-9b87a16850f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:18:17.495898 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:18:17.495898 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:18:17.495898 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:18:17.495898 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:18:17.495898 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:18:17.495898 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:18:17.495898 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:18:17.495898 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:18:17.495898 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:18:17.495898 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:18:17.495898 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:18:17.495898 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:18:17.495898 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:18:17.495898 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:18:17.495898 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:18:17.497037 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:18:17.497037 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:18:17.497037 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:18:17.497037 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:18:17.497037 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:18:17.497037 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:18:17.497037 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:18:17.497037 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:18:17.497037 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:18:17.497037 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:18:17.497037 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:18:17.497037 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:18:17.497037 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:18:17.497037 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:18:17.497037 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:18:17.497037 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:18:17.498090 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:18:17.498090 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:18:17.498090 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:18:17.498090 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:18:17.498090 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:18:17.498090 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:18:17.498090 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:18:17.498090 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:18:17.498090 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:18:17.498090 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:18:17.498090 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:18:17.498090 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:18:17.498090 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 581/1156] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 30 01:18:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:18:17.503185 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d74750f-6b25-42d4-846e-4f01d7365a9f None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:17.612036 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d74750f-6b25-42d4-846e-4f01d7365a9f None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:17.625741 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:17.646455 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32201ce7-6ed2-4f72-8754-d0513eab4f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:17.647059 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32201ce7-6ed2-4f72-8754-d0513eab4f21 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:17.647336 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32201ce7-6ed2-4f72-8754-d0513eab4f21 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:17.647634 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32201ce7-6ed2-4f72-8754-d0513eab4f21 None admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:17.648291 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32201ce7-6ed2-4f72-8754-d0513eab4f21 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:18:17.648598 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32201ce7-6ed2-4f72-8754-d0513eab4f21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:17.649956 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32201ce7-6ed2-4f72-8754-d0513eab4f21 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:17.658243 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 576/1157] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 30 01:18:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:18:17.664134 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12a87dc-e962-484c-9aae-9b87a16850f8 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:17.761312 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12a87dc-e962-484c-9aae-9b87a16850f8 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:17.777725 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:17.794775 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2016e46-935e-4eeb-8fe7-805fe11d88d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:17.795390 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2016e46-935e-4eeb-8fe7-805fe11d88d1 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:17.795779 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2016e46-935e-4eeb-8fe7-805fe11d88d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:17.796058 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2016e46-935e-4eeb-8fe7-805fe11d88d1 None admin] PATH_INFO: `/v3/users/08355ec70ff44153802bb530e93fab9b` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:17.797202 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2016e46-935e-4eeb-8fe7-805fe11d88d1 None admin] RBAC: Authorizing `identity:get_user(user_id=08355ec70ff44153802bb530e93fab9b)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:17.798640 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2016e46-935e-4eeb-8fe7-805fe11d88d1 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:17.800223 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 582/1158] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 30 01:18:17 2022] GET /identity/v3/users/08355ec70ff44153802bb530e93fab9b => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:18:17.806099 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32201ce7-6ed2-4f72-8754-d0513eab4f21 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:17.908175 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32201ce7-6ed2-4f72-8754-d0513eab4f21 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:17.940085 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f282b26a-e0e2-4826-976b-77b486cc2ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:17.940684 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f282b26a-e0e2-4826-976b-77b486cc2ddb None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:17.940962 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f282b26a-e0e2-4826-976b-77b486cc2ddb None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:17.941234 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f282b26a-e0e2-4826-976b-77b486cc2ddb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:17.986028 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:18.007723 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f282b26a-e0e2-4826-976b-77b486cc2ddb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:18.009178 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f282b26a-e0e2-4826-976b-77b486cc2ddb None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:18.104048 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 577/1159] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 30 01:18:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 01:18:18.110034 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2016e46-935e-4eeb-8fe7-805fe11d88d1 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:18.208552 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2016e46-935e-4eeb-8fe7-805fe11d88d1 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:18.240545 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeec855-686c-48ce-89d7-02ed99edd70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:18.241158 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeec855-686c-48ce-89d7-02ed99edd70a None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:18.241436 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeec855-686c-48ce-89d7-02ed99edd70a None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:18.241707 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeec855-686c-48ce-89d7-02ed99edd70a None admin] PATH_INFO: `/v3/projects/b8f2422f1e814bbda6a22e904823aeaa` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:18.242806 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeec855-686c-48ce-89d7-02ed99edd70a None admin] RBAC: Authorizing `identity:get_project(project_id=b8f2422f1e814bbda6a22e904823aeaa)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:18.244265 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeec855-686c-48ce-89d7-02ed99edd70a None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:18.245877 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 583/1160] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 30 01:18:18 2022] GET /identity/v3/projects/b8f2422f1e814bbda6a22e904823aeaa => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:18:18.252583 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f282b26a-e0e2-4826-976b-77b486cc2ddb None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:18.326485 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:18.350458 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f282b26a-e0e2-4826-976b-77b486cc2ddb None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:18.383066 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257079c8-0c71-488e-8b01-83c0c7f2cf98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:18.383673 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257079c8-0c71-488e-8b01-83c0c7f2cf98 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:18.383949 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257079c8-0c71-488e-8b01-83c0c7f2cf98 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:18.384218 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257079c8-0c71-488e-8b01-83c0c7f2cf98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:18.384923 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257079c8-0c71-488e-8b01-83c0c7f2cf98 None admin] RBAC: Adding query filter params (role.id=f6bc03b6972e420eb338ee7fd1443974, scope.project.id=b8f2422f1e814bbda6a22e904823aeaa, user.id=08355ec70ff44153802bb530e93fab9b) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:18:18.385222 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257079c8-0c71-488e-8b01-83c0c7f2cf98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:18.386623 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257079c8-0c71-488e-8b01-83c0c7f2cf98 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:18.392852 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 578/1161] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 30 01:18:18 2022] GET /identity/v3/role_assignments?user.id=08355ec70ff44153802bb530e93fab9b&scope.project.id=b8f2422f1e814bbda6a22e904823aeaa&role.id=f6bc03b6972e420eb338ee7fd1443974 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:18:20.298305 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040fda0e-d250-4e31-a77d-f326398fac7f None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:20.298838 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040fda0e-d250-4e31-a77d-f326398fac7f None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:20.298838 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040fda0e-d250-4e31-a77d-f326398fac7f None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:20.300348 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 584/1162] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:18:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:18:20.305320 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc78192-658d-45b7-9cc4-08f3538965a9 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:20.305749 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc78192-658d-45b7-9cc4-08f3538965a9 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:20.305843 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc78192-658d-45b7-9cc4-08f3538965a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:20.324004 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-0fc78192-658d-45b7-9cc4-08f3538965a9 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:18:20.325167 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-0fc78192-658d-45b7-9cc4-08f3538965a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:20.388496 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 579/1163] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:18:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:18:20.660495 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040fda0e-d250-4e31-a77d-f326398fac7f None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:20.717337 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:20.762328 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040fda0e-d250-4e31-a77d-f326398fac7f None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:20.793598 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd532c3e-6a7e-4ba1-ad26-67bdb080fefb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:20.794183 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd532c3e-6a7e-4ba1-ad26-67bdb080fefb None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:20.794456 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd532c3e-6a7e-4ba1-ad26-67bdb080fefb None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:20.794729 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd532c3e-6a7e-4ba1-ad26-67bdb080fefb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:20.860836 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd532c3e-6a7e-4ba1-ad26-67bdb080fefb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:20.862205 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd532c3e-6a7e-4ba1-ad26-67bdb080fefb None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:20.914099 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:20.958244 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 585/1164] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 30 01:18:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 01:18:20.964190 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc78192-658d-45b7-9cc4-08f3538965a9 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:21.030064 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:21.059738 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc78192-658d-45b7-9cc4-08f3538965a9 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:21.093407 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a0304-10eb-4bc1-866d-4ebf17e677b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:21.094046 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a0304-10eb-4bc1-866d-4ebf17e677b0 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:21.094326 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a0304-10eb-4bc1-866d-4ebf17e677b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:21.094603 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a0304-10eb-4bc1-866d-4ebf17e677b0 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:21.101109 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893a0304-10eb-4bc1-866d-4ebf17e677b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:21.102551 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893a0304-10eb-4bc1-866d-4ebf17e677b0 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:21.113774 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-893a0304-10eb-4bc1-866d-4ebf17e677b0 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 30 01:18:21.113774 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:18:21.113774 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 30 01:18:21.113774 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 30 01:18:21.113774 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 01:18:21.113774 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 01:18:21.113774 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 01:18:21.113774 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 01:18:21.113774 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 30 01:18:21.113774 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:18:21.113774 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 01:18:21.113774 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:18:21.113774 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:18:21.113774 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:18:21.113774 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:18:21.113774 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:18:21.113774 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:18:21.114990 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:18:21.114990 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:18:21.114990 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:18:21.114990 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:18:21.114990 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:18:21.114990 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:18:21.114990 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:18:21.114990 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:18:21.114990 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:18:21.114990 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:18:21.114990 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:18:21.114990 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:18:21.114990 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:18:21.114990 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:18:21.114990 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:18:21.114990 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:18:21.115880 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:18:21.115880 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:18:21.115880 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:18:21.115880 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:18:21.115880 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:18:21.115880 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:18:21.115880 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:18:21.115880 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:18:21.115880 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:18:21.115880 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:18:21.115880 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 30 01:18:21.115880 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:18:21.115880 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 30 01:18:21.115880 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:18:21.115880 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 580/1165] 10.222.0.60 () {56 vars in 1117 bytes} [Tue Aug 30 01:18:20 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:18:21.120758 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd532c3e-6a7e-4ba1-ad26-67bdb080fefb None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:21.217630 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd532c3e-6a7e-4ba1-ad26-67bdb080fefb None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:21.250778 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be9919e-e384-4bc6-bc17-fb454c1339bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:21.251366 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be9919e-e384-4bc6-bc17-fb454c1339bf None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:21.251667 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be9919e-e384-4bc6-bc17-fb454c1339bf None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:21.251934 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be9919e-e384-4bc6-bc17-fb454c1339bf None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:21.252564 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be9919e-e384-4bc6-bc17-fb454c1339bf None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:18:21.252858 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be9919e-e384-4bc6-bc17-fb454c1339bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:21.254225 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be9919e-e384-4bc6-bc17-fb454c1339bf None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:21.262072 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 586/1166] 10.222.0.60 () {56 vars in 1115 bytes} [Tue Aug 30 01:18:21 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:18:23.163028 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc4845-2701-4ddc-9aae-b5fe778c8d3d None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:23.163591 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc4845-2701-4ddc-9aae-b5fe778c8d3d None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:23.163591 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc4845-2701-4ddc-9aae-b5fe778c8d3d None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:23.164967 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 581/1167] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:18:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:18:23.170249 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b38e9-b9b5-4b02-b8d9-b75a1698d7b1 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:23.170649 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b38e9-b9b5-4b02-b8d9-b75a1698d7b1 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:23.170798 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b38e9-b9b5-4b02-b8d9-b75a1698d7b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:23.189154 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-fc9b38e9-b9b5-4b02-b8d9-b75a1698d7b1 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:18:23.190358 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-fc9b38e9-b9b5-4b02-b8d9-b75a1698d7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:23.203622 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:23.258162 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 587/1168] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:18:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:18:23.526363 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fc4845-2701-4ddc-9aae-b5fe778c8d3d None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:23.627895 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fc4845-2701-4ddc-9aae-b5fe778c8d3d None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:23.656741 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:23.662544 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef598756-8d32-49f9-9ed4-f41b5f49e6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:23.663137 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef598756-8d32-49f9-9ed4-f41b5f49e6ea None admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:23.663417 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef598756-8d32-49f9-9ed4-f41b5f49e6ea None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:23.663719 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef598756-8d32-49f9-9ed4-f41b5f49e6ea None admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:23.664392 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef598756-8d32-49f9-9ed4-f41b5f49e6ea None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:23.665746 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef598756-8d32-49f9-9ed4-f41b5f49e6ea None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:23.680914 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 582/1169] 10.222.0.60 () {60 vars in 1138 bytes} [Tue Aug 30 01:18:23 2022] POST /identity/v3/domains => generated 267 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:18:25.600963 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6b68c-ae5a-4a0c-a23e-3435289b7c15 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:25.601340 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6b68c-ae5a-4a0c-a23e-3435289b7c15 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:25.601513 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6b68c-ae5a-4a0c-a23e-3435289b7c15 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:25.602844 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 588/1170] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:18:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:18:25.608034 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d59ef94-1572-4d7e-85e3-7c8d0641d75a None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:25.608475 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d59ef94-1572-4d7e-85e3-7c8d0641d75a None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:25.608570 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d59ef94-1572-4d7e-85e3-7c8d0641d75a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:25.626891 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-4d59ef94-1572-4d7e-85e3-7c8d0641d75a None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:18:25.628099 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-4d59ef94-1572-4d7e-85e3-7c8d0641d75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:25.692130 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 583/1171] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:18:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:18:25.957127 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e6b68c-ae5a-4a0c-a23e-3435289b7c15 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:26.055482 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e6b68c-ae5a-4a0c-a23e-3435289b7c15 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:26.087714 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc209ce9-cc6e-4e46-87ca-582a1a9ff7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:26.088326 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc209ce9-cc6e-4e46-87ca-582a1a9ff7c1 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:26.088599 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc209ce9-cc6e-4e46-87ca-582a1a9ff7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:26.088864 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc209ce9-cc6e-4e46-87ca-582a1a9ff7c1 None admin] PATH_INFO: `/v3/domains/53355dc192824e8faf142e56ed0f747e` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:26.099736 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc209ce9-cc6e-4e46-87ca-582a1a9ff7c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=53355dc192824e8faf142e56ed0f747e)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:26.101208 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc209ce9-cc6e-4e46-87ca-582a1a9ff7c1 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:26.102751 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 589/1172] 10.222.0.60 () {56 vars in 1183 bytes} [Tue Aug 30 01:18:25 2022] GET /identity/v3/domains/53355dc192824e8faf142e56ed0f747e => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:18:26.108527 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d59ef94-1572-4d7e-85e3-7c8d0641d75a None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:26.202206 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d59ef94-1572-4d7e-85e3-7c8d0641d75a None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:26.222507 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:26.236994 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ffa9c6-826b-40fe-8a1b-f4da0232f4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:26.237591 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ffa9c6-826b-40fe-8a1b-f4da0232f4f0 None admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:26.237866 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ffa9c6-826b-40fe-8a1b-f4da0232f4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:26.238136 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ffa9c6-826b-40fe-8a1b-f4da0232f4f0 None admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:26.238789 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ffa9c6-826b-40fe-8a1b-f4da0232f4f0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:26.240224 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ffa9c6-826b-40fe-8a1b-f4da0232f4f0 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:26.265340 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 584/1173] 10.222.0.60 () {60 vars in 1141 bytes} [Tue Aug 30 01:18:26 2022] POST /identity/v3/projects => generated 361 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:18:28.172939 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18cbcf-b22c-43db-ba3d-64cbe327790d None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:28.173528 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18cbcf-b22c-43db-ba3d-64cbe327790d None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:28.173528 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18cbcf-b22c-43db-ba3d-64cbe327790d None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:28.174785 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 590/1174] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:18:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:18:28.179945 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331d83d-4927-441f-b598-c5740b73ac5f None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:28.180366 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331d83d-4927-441f-b598-c5740b73ac5f None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:28.180491 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331d83d-4927-441f-b598-c5740b73ac5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:28.198172 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-d331d83d-4927-441f-b598-c5740b73ac5f None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:18:28.199340 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-d331d83d-4927-441f-b598-c5740b73ac5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:28.263692 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 585/1175] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:18:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 01:18:28.534627 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d18cbcf-b22c-43db-ba3d-64cbe327790d None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:28.546129 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:28.636125 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d18cbcf-b22c-43db-ba3d-64cbe327790d None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:28.668388 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf2646f-e247-4482-bf49-e7f1199e0a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:28.669002 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf2646f-e247-4482-bf49-e7f1199e0a85 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:28.669279 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf2646f-e247-4482-bf49-e7f1199e0a85 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:28.669553 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf2646f-e247-4482-bf49-e7f1199e0a85 None admin] PATH_INFO: `/v3/domains/53355dc192824e8faf142e56ed0f747e` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:28.670641 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf2646f-e247-4482-bf49-e7f1199e0a85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=53355dc192824e8faf142e56ed0f747e)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:28.672257 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf2646f-e247-4482-bf49-e7f1199e0a85 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:28.673805 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 591/1176] 10.222.0.60 () {56 vars in 1183 bytes} [Tue Aug 30 01:18:28 2022] GET /identity/v3/domains/53355dc192824e8faf142e56ed0f747e => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:18:28.679557 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d331d83d-4927-441f-b598-c5740b73ac5f None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:28.777083 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d331d83d-4927-441f-b598-c5740b73ac5f None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:28.778564 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:28.810794 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e93e776-fdf3-46ce-9e9d-0e38a17ac84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:28.811340 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e93e776-fdf3-46ce-9e9d-0e38a17ac84e None admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:28.811646 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e93e776-fdf3-46ce-9e9d-0e38a17ac84e None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:28.811918 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e93e776-fdf3-46ce-9e9d-0e38a17ac84e None admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:28.813165 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e93e776-fdf3-46ce-9e9d-0e38a17ac84e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:28.814665 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e93e776-fdf3-46ce-9e9d-0e38a17ac84e None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:28.836637 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 586/1177] 10.222.0.60 () {60 vars in 1132 bytes} [Tue Aug 30 01:18:28 2022] POST /identity/v3/users => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:18:30.753103 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa315f76-f403-42c2-8a75-9cac2de663c5 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:30.753641 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa315f76-f403-42c2-8a75-9cac2de663c5 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:30.753641 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa315f76-f403-42c2-8a75-9cac2de663c5 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:30.754975 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 592/1178] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:18:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:18:30.760064 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf3df2-effb-4af5-9b42-98934eccdf7a None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:30.760483 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf3df2-effb-4af5-9b42-98934eccdf7a None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:30.760623 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf3df2-effb-4af5-9b42-98934eccdf7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:30.778306 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-adcf3df2-effb-4af5-9b42-98934eccdf7a None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:18:30.779517 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-adcf3df2-effb-4af5-9b42-98934eccdf7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:30.846420 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 587/1179] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:18:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:18:31.116519 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa315f76-f403-42c2-8a75-9cac2de663c5 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:31.197717 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:31.221994 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa315f76-f403-42c2-8a75-9cac2de663c5 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:31.253690 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f72311-c697-4f15-b2a7-89a8ad9cc4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:31.254304 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f72311-c697-4f15-b2a7-89a8ad9cc4f5 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:31.254583 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f72311-c697-4f15-b2a7-89a8ad9cc4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:31.254852 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f72311-c697-4f15-b2a7-89a8ad9cc4f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:31.264997 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f72311-c697-4f15-b2a7-89a8ad9cc4f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:18:31.270368 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-a6f72311-c697-4f15-b2a7-89a8ad9cc4f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:18:31.270368 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:18:31.270368 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:18:31.270368 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:18:31.270368 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:18:31.270368 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:18:31.270368 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:18:31.270368 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:18:31.270368 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:18:31.270368 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:18:31.270368 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:18:31.270368 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:18:31.270368 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:18:31.270368 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:18:31.270368 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:18:31.270368 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:18:31.271612 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:18:31.271612 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:18:31.271612 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:18:31.271612 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:18:31.271612 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:18:31.271612 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:18:31.271612 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:18:31.271612 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:18:31.271612 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:18:31.271612 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:18:31.271612 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:18:31.271612 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:18:31.271612 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:18:31.271612 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:18:31.271612 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:18:31.271612 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:18:31.272904 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:18:31.272904 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:18:31.272904 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:18:31.272904 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:18:31.272904 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:18:31.272904 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:18:31.272904 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:18:31.272904 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:18:31.272904 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:18:31.272904 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:18:31.272904 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:18:31.272904 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:18:31.272904 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 593/1180] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 30 01:18:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:18:31.277509 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcf3df2-effb-4af5-9b42-98934eccdf7a None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:31.361036 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:31.373301 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcf3df2-effb-4af5-9b42-98934eccdf7a None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:31.407020 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbdf713-3e27-45f7-bb94-e2a5d909c63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:31.407648 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbdf713-3e27-45f7-bb94-e2a5d909c63b None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:31.407925 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbdf713-3e27-45f7-bb94-e2a5d909c63b None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:31.408194 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbdf713-3e27-45f7-bb94-e2a5d909c63b None admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:31.408854 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbdf713-3e27-45f7-bb94-e2a5d909c63b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:18:31.409153 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbdf713-3e27-45f7-bb94-e2a5d909c63b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:31.410508 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbdf713-3e27-45f7-bb94-e2a5d909c63b None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:31.418437 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 588/1181] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 30 01:18:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:18:31.424193 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f72311-c697-4f15-b2a7-89a8ad9cc4f5 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:31.521403 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f72311-c697-4f15-b2a7-89a8ad9cc4f5 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:31.553737 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1040696a-aa73-40c1-a9c8-b943dd901b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:31.554358 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040696a-aa73-40c1-a9c8-b943dd901b65 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:31.554640 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040696a-aa73-40c1-a9c8-b943dd901b65 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:31.554912 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040696a-aa73-40c1-a9c8-b943dd901b65 None admin] PATH_INFO: `/v3/users/d995803f1a39478ab8861f7fa778b102` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:31.557523 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:31.568642 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1040696a-aa73-40c1-a9c8-b943dd901b65 None admin] RBAC: Authorizing `identity:get_user(user_id=d995803f1a39478ab8861f7fa778b102)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:31.570081 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1040696a-aa73-40c1-a9c8-b943dd901b65 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:31.571705 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 594/1182] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 30 01:18:31 2022] GET /identity/v3/users/d995803f1a39478ab8861f7fa778b102 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:18:31.577630 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbdf713-3e27-45f7-bb94-e2a5d909c63b None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:31.674972 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbdf713-3e27-45f7-bb94-e2a5d909c63b None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:31.707250 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72e52e8-e0ec-47fe-97a1-7c98525ab512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:31.707867 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e52e8-e0ec-47fe-97a1-7c98525ab512 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:31.708144 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e52e8-e0ec-47fe-97a1-7c98525ab512 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:31.708411 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e52e8-e0ec-47fe-97a1-7c98525ab512 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:31.725810 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:31.774534 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72e52e8-e0ec-47fe-97a1-7c98525ab512 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:31.776016 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72e52e8-e0ec-47fe-97a1-7c98525ab512 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:31.870845 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 589/1183] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 30 01:18:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 01:18:31.877300 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1040696a-aa73-40c1-a9c8-b943dd901b65 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:31.974893 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1040696a-aa73-40c1-a9c8-b943dd901b65 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:32.008653 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d13b1f3-6f9b-4604-a4b7-df51012efe75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:32.009270 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13b1f3-6f9b-4604-a4b7-df51012efe75 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:32.009547 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13b1f3-6f9b-4604-a4b7-df51012efe75 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:32.009816 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13b1f3-6f9b-4604-a4b7-df51012efe75 None admin] PATH_INFO: `/v3/projects/faaaa47eae0a4384accb0c066d1638c5` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:32.010919 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d13b1f3-6f9b-4604-a4b7-df51012efe75 None admin] RBAC: Authorizing `identity:get_project(project_id=faaaa47eae0a4384accb0c066d1638c5)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:32.012385 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d13b1f3-6f9b-4604-a4b7-df51012efe75 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:32.013989 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 595/1184] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 30 01:18:31 2022] GET /identity/v3/projects/faaaa47eae0a4384accb0c066d1638c5 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:18:32.020303 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72e52e8-e0ec-47fe-97a1-7c98525ab512 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:32.068599 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:32.116759 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72e52e8-e0ec-47fe-97a1-7c98525ab512 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:32.149442 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74834e5-eacc-42bd-9eeb-3ddc8ca06a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:32.150036 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74834e5-eacc-42bd-9eeb-3ddc8ca06a59 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:32.150314 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74834e5-eacc-42bd-9eeb-3ddc8ca06a59 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:32.150585 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74834e5-eacc-42bd-9eeb-3ddc8ca06a59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:32.151303 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74834e5-eacc-42bd-9eeb-3ddc8ca06a59 None admin] RBAC: Adding query filter params (role.id=f6bc03b6972e420eb338ee7fd1443974, scope.project.id=faaaa47eae0a4384accb0c066d1638c5, user.id=d995803f1a39478ab8861f7fa778b102) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:18:32.151637 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74834e5-eacc-42bd-9eeb-3ddc8ca06a59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:32.153061 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74834e5-eacc-42bd-9eeb-3ddc8ca06a59 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:32.158220 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 590/1185] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 30 01:18:32 2022] GET /identity/v3/role_assignments?user.id=d995803f1a39478ab8861f7fa778b102&scope.project.id=faaaa47eae0a4384accb0c066d1638c5&role.id=f6bc03b6972e420eb338ee7fd1443974 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:18:34.041712 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c3f18-85a3-43a8-b266-7765c44a476e None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:34.042280 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c3f18-85a3-43a8-b266-7765c44a476e None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:34.042280 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c3f18-85a3-43a8-b266-7765c44a476e None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:34.043621 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 596/1186] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:18:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:18:34.049237 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c92ae4-7c67-4978-8279-83fd7f6d8862 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:34.049609 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c92ae4-7c67-4978-8279-83fd7f6d8862 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:34.049791 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c92ae4-7c67-4978-8279-83fd7f6d8862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:34.067642 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-14c92ae4-7c67-4978-8279-83fd7f6d8862 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:18:34.068826 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-14c92ae4-7c67-4978-8279-83fd7f6d8862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:34.133171 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 591/1187] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:18:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:18:34.405319 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51c3f18-85a3-43a8-b266-7765c44a476e None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:34.467086 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:34.506075 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51c3f18-85a3-43a8-b266-7765c44a476e None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:34.539457 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75eba46-df35-492e-a821-7466d254d671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:34.540074 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75eba46-df35-492e-a821-7466d254d671 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:34.540349 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75eba46-df35-492e-a821-7466d254d671 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:34.540615 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75eba46-df35-492e-a821-7466d254d671 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:34.550213 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75eba46-df35-492e-a821-7466d254d671 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:18:34.554999 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-d75eba46-df35-492e-a821-7466d254d671 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:18:34.554999 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:18:34.554999 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:18:34.554999 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:18:34.554999 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:18:34.554999 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:18:34.554999 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:18:34.554999 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:18:34.554999 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:18:34.554999 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:18:34.554999 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:18:34.554999 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:18:34.554999 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:18:34.554999 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:18:34.554999 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:18:34.554999 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:18:34.556142 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:18:34.556142 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:18:34.556142 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:18:34.556142 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:18:34.556142 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:18:34.556142 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:18:34.556142 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:18:34.556142 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:18:34.556142 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:18:34.556142 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:18:34.556142 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:18:34.556142 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:18:34.556142 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:18:34.556142 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:18:34.556142 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:18:34.556142 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:18:34.557022 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:18:34.557022 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:18:34.557022 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:18:34.557022 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:18:34.557022 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:18:34.557022 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:18:34.557022 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:18:34.557022 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:18:34.557022 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:18:34.557022 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:18:34.557022 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:18:34.557022 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:18:34.557022 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 597/1188] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 30 01:18:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:18:34.562716 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c92ae4-7c67-4978-8279-83fd7f6d8862 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:34.609678 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:34.662122 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c92ae4-7c67-4978-8279-83fd7f6d8862 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:34.694599 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b96849-10c1-4718-ac07-a0cd098c7d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:34.695193 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b96849-10c1-4718-ac07-a0cd098c7d5d None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:34.695492 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b96849-10c1-4718-ac07-a0cd098c7d5d None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:34.695761 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b96849-10c1-4718-ac07-a0cd098c7d5d None admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:34.696412 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b96849-10c1-4718-ac07-a0cd098c7d5d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:18:34.696708 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b96849-10c1-4718-ac07-a0cd098c7d5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:34.698054 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b96849-10c1-4718-ac07-a0cd098c7d5d None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:34.706378 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 592/1189] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 30 01:18:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:18:34.712143 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75eba46-df35-492e-a821-7466d254d671 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:34.808486 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75eba46-df35-492e-a821-7466d254d671 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:34.833206 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:34.845505 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c49c7d4-5eb9-4e36-b3a1-06f0193fd873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:34.846129 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49c7d4-5eb9-4e36-b3a1-06f0193fd873 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:34.846407 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49c7d4-5eb9-4e36-b3a1-06f0193fd873 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:34.846679 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49c7d4-5eb9-4e36-b3a1-06f0193fd873 None admin] PATH_INFO: `/v3/users/d995803f1a39478ab8861f7fa778b102` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:34.847834 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c49c7d4-5eb9-4e36-b3a1-06f0193fd873 None admin] RBAC: Authorizing `identity:get_user(user_id=d995803f1a39478ab8861f7fa778b102)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:34.849269 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c49c7d4-5eb9-4e36-b3a1-06f0193fd873 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:34.850827 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 598/1190] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 30 01:18:34 2022] GET /identity/v3/users/d995803f1a39478ab8861f7fa778b102 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:18:34.856700 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b96849-10c1-4718-ac07-a0cd098c7d5d None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:34.955544 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b96849-10c1-4718-ac07-a0cd098c7d5d None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:34.962190 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:34.988947 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c4a86-5ad8-4738-9acc-e4f7d1fb350e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:34.989567 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c4a86-5ad8-4738-9acc-e4f7d1fb350e None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:34.989843 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c4a86-5ad8-4738-9acc-e4f7d1fb350e None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:34.990113 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c4a86-5ad8-4738-9acc-e4f7d1fb350e None admin] PATH_INFO: `/v3/projects/faaaa47eae0a4384accb0c066d1638c5` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:34.991212 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784c4a86-5ad8-4738-9acc-e4f7d1fb350e None admin] RBAC: Authorizing `identity:get_project(project_id=faaaa47eae0a4384accb0c066d1638c5)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:34.992672 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784c4a86-5ad8-4738-9acc-e4f7d1fb350e None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:34.994281 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 593/1191] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 30 01:18:34 2022] GET /identity/v3/projects/faaaa47eae0a4384accb0c066d1638c5 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:18:35.003000 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c49c7d4-5eb9-4e36-b3a1-06f0193fd873 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:35.102868 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c49c7d4-5eb9-4e36-b3a1-06f0193fd873 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:35.136713 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a44b151-d250-42a7-914a-c1e1fc380e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:35.137358 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44b151-d250-42a7-914a-c1e1fc380e35 None admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:35.137638 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44b151-d250-42a7-914a-c1e1fc380e35 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:35.137915 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44b151-d250-42a7-914a-c1e1fc380e35 None admin] PATH_INFO: `/v3/projects/faaaa47eae0a4384accb0c066d1638c5/users/d995803f1a39478ab8861f7fa778b102/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:35.139809 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a44b151-d250-42a7-914a-c1e1fc380e35 None admin] RBAC: Authorizing `identity:create_grant(project_id=faaaa47eae0a4384accb0c066d1638c5, user_id=d995803f1a39478ab8861f7fa778b102, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:35.141261 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a44b151-d250-42a7-914a-c1e1fc380e35 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:35.153633 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 599/1192] 10.222.0.60 () {58 vars in 1439 bytes} [Tue Aug 30 01:18:34 2022] PUT /identity/v3/projects/faaaa47eae0a4384accb0c066d1638c5/users/d995803f1a39478ab8861f7fa778b102/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:18:37.017113 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755ad8c-09f0-4e1d-98b2-7fca7a44af94 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:37.017722 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755ad8c-09f0-4e1d-98b2-7fca7a44af94 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:37.017722 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755ad8c-09f0-4e1d-98b2-7fca7a44af94 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:37.019367 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 594/1193] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:18:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:18:37.026809 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4587155-a8d9-4668-854f-490af486145d None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:37.027388 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4587155-a8d9-4668-854f-490af486145d None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:37.027605 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4587155-a8d9-4668-854f-490af486145d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:37.047674 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-d4587155-a8d9-4668-854f-490af486145d None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:18:37.048846 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-d4587155-a8d9-4668-854f-490af486145d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:18:37.094414 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:37.115304 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 600/1194] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:18:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:18:37.384435 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a755ad8c-09f0-4e1d-98b2-7fca7a44af94 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:37.486608 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a755ad8c-09f0-4e1d-98b2-7fca7a44af94 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:37.519383 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee14c9b4-7cf1-4279-a7f0-bb68f4da6c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:37.520019 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee14c9b4-7cf1-4279-a7f0-bb68f4da6c9a None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:37.520292 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee14c9b4-7cf1-4279-a7f0-bb68f4da6c9a None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:37.520557 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee14c9b4-7cf1-4279-a7f0-bb68f4da6c9a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:37.530184 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee14c9b4-7cf1-4279-a7f0-bb68f4da6c9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:18:37.535682 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-ee14c9b4-7cf1-4279-a7f0-bb68f4da6c9a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:18:37.535682 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:18:37.535682 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:18:37.535682 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:18:37.535682 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:18:37.535682 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:18:37.535682 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:18:37.535682 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:18:37.535682 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:18:37.535682 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:18:37.535682 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:18:37.535682 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:18:37.535682 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:18:37.535682 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:18:37.535682 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:18:37.535682 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:18:37.536878 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:18:37.536878 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:18:37.536878 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:18:37.536878 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:18:37.536878 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:18:37.536878 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:18:37.536878 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:18:37.536878 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:18:37.536878 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:18:37.536878 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:18:37.536878 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:18:37.536878 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:18:37.536878 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:18:37.536878 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:18:37.536878 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:18:37.536878 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:18:37.537743 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:18:37.537743 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:18:37.537743 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:18:37.537743 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:18:37.537743 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:18:37.537743 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:18:37.537743 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:18:37.537743 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:18:37.537743 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:18:37.537743 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:18:37.537743 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:18:37.537743 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:18:37.537743 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 595/1195] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 30 01:18:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:18:37.542786 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4587155-a8d9-4668-854f-490af486145d None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:37.646590 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4587155-a8d9-4668-854f-490af486145d None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:37.680704 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db294d04-244b-4e78-9b9b-de3bd4a8ae93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:37.681302 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db294d04-244b-4e78-9b9b-de3bd4a8ae93 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:37.681578 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db294d04-244b-4e78-9b9b-de3bd4a8ae93 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:37.681846 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db294d04-244b-4e78-9b9b-de3bd4a8ae93 None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:37.682493 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db294d04-244b-4e78-9b9b-de3bd4a8ae93 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:18:37.682791 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db294d04-244b-4e78-9b9b-de3bd4a8ae93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:37.684197 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db294d04-244b-4e78-9b9b-de3bd4a8ae93 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:37.693841 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 601/1196] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 30 01:18:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:18:37.699811 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee14c9b4-7cf1-4279-a7f0-bb68f4da6c9a None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:37.739084 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:37.814600 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee14c9b4-7cf1-4279-a7f0-bb68f4da6c9a None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:37.852959 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19a38c3-47a5-4458-a5d8-a6537cb9f631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:37.853584 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a38c3-47a5-4458-a5d8-a6537cb9f631 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:37.853867 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a38c3-47a5-4458-a5d8-a6537cb9f631 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:37.854143 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a38c3-47a5-4458-a5d8-a6537cb9f631 None admin] PATH_INFO: `/v3/users/d995803f1a39478ab8861f7fa778b102` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:37.855463 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19a38c3-47a5-4458-a5d8-a6537cb9f631 None admin] RBAC: Authorizing `identity:get_user(user_id=d995803f1a39478ab8861f7fa778b102)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:37.856900 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19a38c3-47a5-4458-a5d8-a6537cb9f631 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:37.858491 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 596/1197] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 30 01:18:37 2022] GET /identity/v3/users/d995803f1a39478ab8861f7fa778b102 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:18:37.864468 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db294d04-244b-4e78-9b9b-de3bd4a8ae93 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:37.909019 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:37.976717 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db294d04-244b-4e78-9b9b-de3bd4a8ae93 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:38.012185 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c82a3-58aa-4c0b-8270-af490cd63538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:38.012783 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c82a3-58aa-4c0b-8270-af490cd63538 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:38.013059 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c82a3-58aa-4c0b-8270-af490cd63538 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:38.013390 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c82a3-58aa-4c0b-8270-af490cd63538 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:38.086724 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6c82a3-58aa-4c0b-8270-af490cd63538 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:38.088189 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6c82a3-58aa-4c0b-8270-af490cd63538 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:38.130093 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:38.188746 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 602/1198] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 30 01:18:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 01:18:38.194839 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19a38c3-47a5-4458-a5d8-a6537cb9f631 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:38.298739 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19a38c3-47a5-4458-a5d8-a6537cb9f631 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:38.300332 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:38.336658 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aef864-2964-4571-84b5-e6957aec920f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:38.337295 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aef864-2964-4571-84b5-e6957aec920f None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:38.337571 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aef864-2964-4571-84b5-e6957aec920f None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:38.337851 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aef864-2964-4571-84b5-e6957aec920f None admin] PATH_INFO: `/v3/projects/faaaa47eae0a4384accb0c066d1638c5` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:38.339001 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aef864-2964-4571-84b5-e6957aec920f None admin] RBAC: Authorizing `identity:get_project(project_id=faaaa47eae0a4384accb0c066d1638c5)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:38.341303 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aef864-2964-4571-84b5-e6957aec920f None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:38.342972 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 597/1199] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 30 01:18:38 2022] GET /identity/v3/projects/faaaa47eae0a4384accb0c066d1638c5 => generated 361 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:18:38.353347 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c82a3-58aa-4c0b-8270-af490cd63538 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:18:38.455414 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c82a3-58aa-4c0b-8270-af490cd63538 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:18:38.488811 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155337d9-ef9f-4baf-9a10-4d2af37309b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:18:38.489402 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155337d9-ef9f-4baf-9a10-4d2af37309b9 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:18:38.489675 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155337d9-ef9f-4baf-9a10-4d2af37309b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:18:38.489942 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155337d9-ef9f-4baf-9a10-4d2af37309b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:18:38.490657 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155337d9-ef9f-4baf-9a10-4d2af37309b9 None admin] RBAC: Adding query filter params (role.id=f6bc03b6972e420eb338ee7fd1443974, scope.project.id=faaaa47eae0a4384accb0c066d1638c5, user.id=d995803f1a39478ab8861f7fa778b102) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:18:38.490956 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155337d9-ef9f-4baf-9a10-4d2af37309b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:18:38.492402 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155337d9-ef9f-4baf-9a10-4d2af37309b9 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:18:38.497986 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 603/1200] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 30 01:18:38 2022] GET /identity/v3/role_assignments?user.id=d995803f1a39478ab8861f7fa778b102&scope.project.id=faaaa47eae0a4384accb0c066d1638c5&role.id=f6bc03b6972e420eb338ee7fd1443974 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:18:48.332230 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=15 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:48.495381 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=97 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:33.885231 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe931a1-09c2-4ec1-83ed-1c79bc823ae6 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:33.885231 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe931a1-09c2-4ec1-83ed-1c79bc823ae6 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:33.885231 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe931a1-09c2-4ec1-83ed-1c79bc823ae6 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:33.885231 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 598/1201] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:19:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:19:33.894255 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759b5e9-a2de-4557-9a62-4a933f5489e5 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:33.894729 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759b5e9-a2de-4557-9a62-4a933f5489e5 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:33.895089 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759b5e9-a2de-4557-9a62-4a933f5489e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:33.917585 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-b759b5e9-a2de-4557-9a62-4a933f5489e5 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:19:33.919134 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-b759b5e9-a2de-4557-9a62-4a933f5489e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:34.017864 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 604/1202] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:19:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:19:34.300428 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe931a1-09c2-4ec1-83ed-1c79bc823ae6 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:34.434070 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe931a1-09c2-4ec1-83ed-1c79bc823ae6 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:34.484050 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de03067c-5888-4a4b-9c6b-4fd2cb1bf68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:34.485009 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de03067c-5888-4a4b-9c6b-4fd2cb1bf68a None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:34.485534 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de03067c-5888-4a4b-9c6b-4fd2cb1bf68a None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:34.485995 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de03067c-5888-4a4b-9c6b-4fd2cb1bf68a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:34.501665 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de03067c-5888-4a4b-9c6b-4fd2cb1bf68a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:34.503323 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de03067c-5888-4a4b-9c6b-4fd2cb1bf68a None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:34.520199 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-de03067c-5888-4a4b-9c6b-4fd2cb1bf68a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:19:34.520199 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:19:34.520199 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:19:34.520199 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:19:34.520199 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:19:34.520199 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:19:34.520199 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:19:34.520199 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:19:34.520199 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:19:34.520199 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:19:34.520199 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:19:34.520199 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:19:34.520199 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:19:34.520199 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:19:34.520199 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:19:34.520199 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:19:34.521490 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:19:34.521490 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:19:34.521490 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:19:34.521490 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:19:34.521490 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:19:34.521490 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:19:34.521490 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:19:34.521490 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:19:34.521490 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:19:34.521490 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:19:34.521490 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:19:34.521490 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:19:34.521490 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:19:34.521490 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:19:34.521490 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:19:34.521490 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:19:34.521490 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:19:34.523220 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:19:34.523220 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:19:34.523220 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:19:34.523220 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 599/1203] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:19:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:19:34.527935 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b759b5e9-a2de-4557-9a62-4a933f5489e5 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:34.687654 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b759b5e9-a2de-4557-9a62-4a933f5489e5 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:34.722203 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:34.732422 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f56929-0de2-4e1d-b4d6-5a9d9ac3f424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:34.733060 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f56929-0de2-4e1d-b4d6-5a9d9ac3f424 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:34.733329 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f56929-0de2-4e1d-b4d6-5a9d9ac3f424 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:34.733603 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f56929-0de2-4e1d-b4d6-5a9d9ac3f424 None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:34.734350 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f56929-0de2-4e1d-b4d6-5a9d9ac3f424 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:19:34.734661 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f56929-0de2-4e1d-b4d6-5a9d9ac3f424 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:34.736080 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f56929-0de2-4e1d-b4d6-5a9d9ac3f424 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:34.749884 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 605/1204] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:19:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:19:34.755916 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de03067c-5888-4a4b-9c6b-4fd2cb1bf68a None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:34.824166 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:34.892225 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de03067c-5888-4a4b-9c6b-4fd2cb1bf68a None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:34.932858 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aae1a4-47dc-4290-a615-fc63bf05305c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:34.933545 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aae1a4-47dc-4290-a615-fc63bf05305c None admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:34.933833 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aae1a4-47dc-4290-a615-fc63bf05305c None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:34.934112 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aae1a4-47dc-4290-a615-fc63bf05305c None admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:34.934882 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aae1a4-47dc-4290-a615-fc63bf05305c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:34.937099 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aae1a4-47dc-4290-a615-fc63bf05305c None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:34.973657 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 600/1205] 10.222.0.60 () {60 vars in 1132 bytes} [Tue Aug 30 01:19:34 2022] POST /identity/v3/users => generated 251 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:19:37.123522 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd4a67-a653-42fe-a966-46c272ed91f6 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:37.124138 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd4a67-a653-42fe-a966-46c272ed91f6 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:37.124138 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd4a67-a653-42fe-a966-46c272ed91f6 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:37.125567 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 606/1206] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:19:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:19:37.130492 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e1bd3-8e0d-4406-bc5d-edd963f4ca51 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:37.130905 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e1bd3-8e0d-4406-bc5d-edd963f4ca51 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:37.131103 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e1bd3-8e0d-4406-bc5d-edd963f4ca51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:37.149794 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-6b4e1bd3-8e0d-4406-bc5d-edd963f4ca51 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:19:37.151233 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-6b4e1bd3-8e0d-4406-bc5d-edd963f4ca51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:37.227221 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 601/1207] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:19:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:19:37.523937 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcd4a67-a653-42fe-a966-46c272ed91f6 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:37.673974 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcd4a67-a653-42fe-a966-46c272ed91f6 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:37.716596 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0130c-6c2e-473c-b2e4-3ff23ec3d2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:37.717853 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0130c-6c2e-473c-b2e4-3ff23ec3d2fa None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:37.718162 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0130c-6c2e-473c-b2e4-3ff23ec3d2fa None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:37.718465 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0130c-6c2e-473c-b2e4-3ff23ec3d2fa None admin] PATH_INFO: `/v3/roles/service` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:37.731131 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd0130c-6c2e-473c-b2e4-3ff23ec3d2fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:19:37.737223 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-8fd0130c-6c2e-473c-b2e4-3ff23ec3d2fa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 01:19:37.737223 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:19:37.737223 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:19:37.737223 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:19:37.737223 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:19:37.737223 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:19:37.737223 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:19:37.737223 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:19:37.737223 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:19:37.737223 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:19:37.737223 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:19:37.737223 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:19:37.737223 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:19:37.737223 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:19:37.737223 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:19:37.737223 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:19:37.738217 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:19:37.738217 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:19:37.738217 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:19:37.738217 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:19:37.738217 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:19:37.738217 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:19:37.738217 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:19:37.738217 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:19:37.738217 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:19:37.738217 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:19:37.738217 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:19:37.738217 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:19:37.738217 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:19:37.738217 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:19:37.738217 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:19:37.738217 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:19:37.740620 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:19:37.740620 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:19:37.740620 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:19:37.740620 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:19:37.740620 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:19:37.740620 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:19:37.740620 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:19:37.740620 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:19:37.740620 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:19:37.740620 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:19:37.740620 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 01:19:37.740620 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:19:37.740620 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 607/1208] 10.222.0.60 () {56 vars in 1102 bytes} [Tue Aug 30 01:19:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:19:37.744398 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e1bd3-8e0d-4406-bc5d-edd963f4ca51 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:37.787560 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:37.862813 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e1bd3-8e0d-4406-bc5d-edd963f4ca51 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:37.905254 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28450ad8-8d8d-4ff6-bfcf-8514ce79fd0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:37.905865 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28450ad8-8d8d-4ff6-bfcf-8514ce79fd0c None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:37.906308 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28450ad8-8d8d-4ff6-bfcf-8514ce79fd0c None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:37.906528 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28450ad8-8d8d-4ff6-bfcf-8514ce79fd0c None admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:37.907061 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28450ad8-8d8d-4ff6-bfcf-8514ce79fd0c None admin] RBAC: Adding query filter params (name=service) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:19:37.907362 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28450ad8-8d8d-4ff6-bfcf-8514ce79fd0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:37.909021 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28450ad8-8d8d-4ff6-bfcf-8514ce79fd0c None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:37.926687 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 602/1209] 10.222.0.60 () {56 vars in 1103 bytes} [Tue Aug 30 01:19:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:19:37.929539 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0130c-6c2e-473c-b2e4-3ff23ec3d2fa None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:38.017653 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:38.098817 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0130c-6c2e-473c-b2e4-3ff23ec3d2fa None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:38.142144 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9b2af-4564-4067-8298-8b0db21718de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:38.142864 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9b2af-4564-4067-8298-8b0db21718de None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:38.143214 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9b2af-4564-4067-8298-8b0db21718de None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:38.143600 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9b2af-4564-4067-8298-8b0db21718de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:38.157096 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a9b2af-4564-4067-8298-8b0db21718de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:38.158706 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a9b2af-4564-4067-8298-8b0db21718de None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:38.175075 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-69a9b2af-4564-4067-8298-8b0db21718de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:19:38.175075 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:19:38.175075 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:19:38.175075 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:19:38.175075 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:19:38.175075 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:19:38.175075 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:19:38.175075 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:19:38.175075 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:19:38.175075 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:19:38.175075 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:19:38.175075 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:19:38.175075 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:19:38.175075 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:19:38.175075 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:19:38.175075 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:19:38.176154 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:19:38.176154 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:19:38.176154 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:19:38.176154 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:19:38.176154 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:19:38.176154 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:19:38.176154 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:19:38.176154 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:19:38.176154 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:19:38.176154 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:19:38.176154 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:19:38.176154 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:19:38.176154 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:19:38.176154 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:19:38.176154 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:19:38.176154 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:19:38.176154 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:19:38.177105 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:19:38.177105 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:19:38.177105 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:19:38.177105 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 608/1210] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:19:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:19:38.182565 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28450ad8-8d8d-4ff6-bfcf-8514ce79fd0c None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:38.300852 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:38.304055 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28450ad8-8d8d-4ff6-bfcf-8514ce79fd0c None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:38.341496 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8699a0cf-61ed-435a-9dff-1adf562dbda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:38.342749 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8699a0cf-61ed-435a-9dff-1adf562dbda1 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:38.342907 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8699a0cf-61ed-435a-9dff-1adf562dbda1 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:38.343194 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8699a0cf-61ed-435a-9dff-1adf562dbda1 None admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:38.343871 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8699a0cf-61ed-435a-9dff-1adf562dbda1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:19:38.344172 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8699a0cf-61ed-435a-9dff-1adf562dbda1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:38.345547 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8699a0cf-61ed-435a-9dff-1adf562dbda1 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:38.359634 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 603/1211] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:19:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:19:38.365274 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9b2af-4564-4067-8298-8b0db21718de None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:38.487091 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9b2af-4564-4067-8298-8b0db21718de None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:38.488992 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:38.538442 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5897f-6014-4087-b631-928424da272b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:38.540167 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5897f-6014-4087-b631-928424da272b None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:38.540675 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5897f-6014-4087-b631-928424da272b None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:38.540792 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5897f-6014-4087-b631-928424da272b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:38.558156 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d5897f-6014-4087-b631-928424da272b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:38.559905 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d5897f-6014-4087-b631-928424da272b None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:38.573082 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-f3d5897f-6014-4087-b631-928424da272b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 01:19:38.573082 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:19:38.573082 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:19:38.573082 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:19:38.573082 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:19:38.573082 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:19:38.573082 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:19:38.573082 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:19:38.573082 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:19:38.573082 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:19:38.573082 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:19:38.573082 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:19:38.573082 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 01:19:38.573082 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 01:19:38.573082 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 01:19:38.573082 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 01:19:38.574257 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:19:38.574257 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:19:38.574257 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 01:19:38.574257 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:19:38.574257 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 01:19:38.574257 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:19:38.574257 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:19:38.574257 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:19:38.574257 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:19:38.574257 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:19:38.574257 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:19:38.574257 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:19:38.574257 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:19:38.574257 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:19:38.574257 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:19:38.574257 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:19:38.574257 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:19:38.574257 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:19:38.575649 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:19:38.575649 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:19:38.575649 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 01:19:38.575649 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 01:19:38.575649 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 01:19:38.575649 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 01:19:38.575649 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 01:19:38.575649 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 01:19:38.575649 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 01:19:38.575649 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:19:38.575649 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 609/1212] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:19:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:19:38.580734 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8699a0cf-61ed-435a-9dff-1adf562dbda1 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:38.716323 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8699a0cf-61ed-435a-9dff-1adf562dbda1 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:38.769322 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732f1498-a33c-4e06-bd0f-9fa5ed5ba451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:38.769945 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f1498-a33c-4e06-bd0f-9fa5ed5ba451 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:38.770226 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f1498-a33c-4e06-bd0f-9fa5ed5ba451 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:38.770491 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f1498-a33c-4e06-bd0f-9fa5ed5ba451 None admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:38.771233 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732f1498-a33c-4e06-bd0f-9fa5ed5ba451 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:19:38.771550 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732f1498-a33c-4e06-bd0f-9fa5ed5ba451 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:38.772996 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732f1498-a33c-4e06-bd0f-9fa5ed5ba451 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:38.807742 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 604/1213] 10.222.0.60 () {56 vars in 1143 bytes} [Tue Aug 30 01:19:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:19:38.808289 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5897f-6014-4087-b631-928424da272b None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:38.961938 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5897f-6014-4087-b631-928424da272b None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:39.007277 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd285083-4d33-49a0-9e8b-99f7e35a836e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:39.008050 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd285083-4d33-49a0-9e8b-99f7e35a836e None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:39.008457 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd285083-4d33-49a0-9e8b-99f7e35a836e None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:39.008825 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd285083-4d33-49a0-9e8b-99f7e35a836e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:39.042290 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:39.092694 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd285083-4d33-49a0-9e8b-99f7e35a836e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:39.094283 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd285083-4d33-49a0-9e8b-99f7e35a836e None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:39.225889 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 610/1214] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 30 01:19:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 01:19:39.231699 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732f1498-a33c-4e06-bd0f-9fa5ed5ba451 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:39.257091 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:39.363563 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732f1498-a33c-4e06-bd0f-9fa5ed5ba451 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:39.407132 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d5c38c-74bb-4f3e-85b3-88d940f7c7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:39.407813 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d5c38c-74bb-4f3e-85b3-88d940f7c7c2 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:39.408095 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d5c38c-74bb-4f3e-85b3-88d940f7c7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:39.408380 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d5c38c-74bb-4f3e-85b3-88d940f7c7c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:39.419258 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d5c38c-74bb-4f3e-85b3-88d940f7c7c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:39.421328 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d5c38c-74bb-4f3e-85b3-88d940f7c7c2 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:39.439369 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-c4d5c38c-74bb-4f3e-85b3-88d940f7c7c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:19:39.439369 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:19:39.439369 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:19:39.439369 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:19:39.439369 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:19:39.439369 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:19:39.439369 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:19:39.439369 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:19:39.439369 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:19:39.439369 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:19:39.439369 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:19:39.439369 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:19:39.439369 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:19:39.439369 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:19:39.439369 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:19:39.439369 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:19:39.440744 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:19:39.440744 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:19:39.440744 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:19:39.440744 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:19:39.440744 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:19:39.440744 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:19:39.440744 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:19:39.440744 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:19:39.440744 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:19:39.440744 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:19:39.440744 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:19:39.440744 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:19:39.440744 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:19:39.440744 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:19:39.440744 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:19:39.440744 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:19:39.440744 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:19:39.441816 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:19:39.441816 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:19:39.441816 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:19:39.441816 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 605/1215] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:19:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:19:39.446291 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd285083-4d33-49a0-9e8b-99f7e35a836e None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:39.520185 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:39.567066 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd285083-4d33-49a0-9e8b-99f7e35a836e None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:39.618908 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cb7919-c7fe-4279-9f8d-38030bb2f3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:39.619517 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb7919-c7fe-4279-9f8d-38030bb2f3ca None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:39.619754 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb7919-c7fe-4279-9f8d-38030bb2f3ca None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:39.621046 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb7919-c7fe-4279-9f8d-38030bb2f3ca None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:39.621713 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cb7919-c7fe-4279-9f8d-38030bb2f3ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:19:39.622089 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cb7919-c7fe-4279-9f8d-38030bb2f3ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:39.624006 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cb7919-c7fe-4279-9f8d-38030bb2f3ca None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:39.643616 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 611/1216] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:19:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:19:39.644699 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d5c38c-74bb-4f3e-85b3-88d940f7c7c2 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:39.735465 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:39.772110 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d5c38c-74bb-4f3e-85b3-88d940f7c7c2 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:39.809514 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba615ec-a9c2-4fc9-bdc6-d92b2c0a876e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:39.810138 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba615ec-a9c2-4fc9-bdc6-d92b2c0a876e None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:39.810423 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba615ec-a9c2-4fc9-bdc6-d92b2c0a876e None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:39.810678 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba615ec-a9c2-4fc9-bdc6-d92b2c0a876e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:39.817806 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba615ec-a9c2-4fc9-bdc6-d92b2c0a876e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:39.819240 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba615ec-a9c2-4fc9-bdc6-d92b2c0a876e None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:39.832424 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-1ba615ec-a9c2-4fc9-bdc6-d92b2c0a876e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:19:39.832424 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:19:39.832424 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:19:39.832424 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:19:39.832424 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:19:39.832424 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:19:39.832424 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:19:39.832424 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:19:39.832424 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:19:39.832424 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:19:39.832424 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:19:39.832424 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:19:39.832424 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 01:19:39.832424 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 01:19:39.832424 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 01:19:39.833478 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 01:19:39.833478 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:19:39.833478 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:19:39.833478 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:19:39.833478 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:19:39.833478 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:19:39.833478 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:19:39.833478 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:19:39.833478 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:19:39.833478 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:19:39.833478 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:19:39.833478 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:19:39.833478 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:19:39.833478 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:19:39.833478 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:19:39.833478 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:19:39.833478 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:19:39.834532 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 01:19:39.834532 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 01:19:39.834532 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 01:19:39.834532 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 01:19:39.834532 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 01:19:39.834532 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 01:19:39.834532 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:19:39.834532 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:19:39.834532 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 606/1217] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 30 01:19:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:19:39.841696 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cb7919-c7fe-4279-9f8d-38030bb2f3ca None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:39.954861 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cb7919-c7fe-4279-9f8d-38030bb2f3ca None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:39.978679 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:39.992671 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1d0f14-44cb-458b-87b9-a5cabced5cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:39.993295 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d0f14-44cb-458b-87b9-a5cabced5cbe None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:39.993606 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d0f14-44cb-458b-87b9-a5cabced5cbe None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:39.993839 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d0f14-44cb-458b-87b9-a5cabced5cbe None admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:39.994545 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1d0f14-44cb-458b-87b9-a5cabced5cbe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:19:39.994867 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1d0f14-44cb-458b-87b9-a5cabced5cbe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:39.996327 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1d0f14-44cb-458b-87b9-a5cabced5cbe None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:40.015911 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 612/1218] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 30 01:19:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:19:40.017433 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba615ec-a9c2-4fc9-bdc6-d92b2c0a876e None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:40.131341 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba615ec-a9c2-4fc9-bdc6-d92b2c0a876e None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:40.163393 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:40.169975 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bacc9c5-21f3-4e5a-a60a-2af696dcf2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:40.171199 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bacc9c5-21f3-4e5a-a60a-2af696dcf2fc None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:40.171504 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bacc9c5-21f3-4e5a-a60a-2af696dcf2fc None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:40.171780 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bacc9c5-21f3-4e5a-a60a-2af696dcf2fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:40.172531 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bacc9c5-21f3-4e5a-a60a-2af696dcf2fc None admin] RBAC: Adding query filter params (role.id=01439ffbf0dd41caadd0cc40b3176062, scope.project.id=b050b2dad22a4a06875072e44c8c9824, user.id=e8dbb4742c3944b9ad389e9628b5a047) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:19:40.172842 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bacc9c5-21f3-4e5a-a60a-2af696dcf2fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:40.174290 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bacc9c5-21f3-4e5a-a60a-2af696dcf2fc None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:40.180352 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 607/1219] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 30 01:19:40 2022] GET /identity/v3/role_assignments?user.id=e8dbb4742c3944b9ad389e9628b5a047&scope.project.id=b050b2dad22a4a06875072e44c8c9824&role.id=01439ffbf0dd41caadd0cc40b3176062 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:19:42.101738 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8565b-c026-4799-808a-b795efd747d2 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:42.102285 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8565b-c026-4799-808a-b795efd747d2 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:42.102285 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8565b-c026-4799-808a-b795efd747d2 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:42.103654 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 613/1220] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:19:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:19:42.109894 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e105807-17ee-464e-94d5-a374267ff809 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:42.110489 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e105807-17ee-464e-94d5-a374267ff809 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:42.110787 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e105807-17ee-464e-94d5-a374267ff809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:42.128788 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-8e105807-17ee-464e-94d5-a374267ff809 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:19:42.129973 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-8e105807-17ee-464e-94d5-a374267ff809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:42.203486 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 608/1221] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:19:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:19:42.502199 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8565b-c026-4799-808a-b795efd747d2 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:42.625495 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8565b-c026-4799-808a-b795efd747d2 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:42.662055 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c6ff89-8507-418b-b4e0-bca73f2b7fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:42.662715 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6ff89-8507-418b-b4e0-bca73f2b7fff None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:42.663014 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6ff89-8507-418b-b4e0-bca73f2b7fff None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:42.663312 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6ff89-8507-418b-b4e0-bca73f2b7fff None admin] PATH_INFO: `/v3/roles/service` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:42.674800 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c6ff89-8507-418b-b4e0-bca73f2b7fff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:19:42.680465 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-98c6ff89-8507-418b-b4e0-bca73f2b7fff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 01:19:42.680465 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:19:42.680465 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:19:42.680465 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:19:42.680465 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:19:42.680465 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:19:42.680465 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:19:42.680465 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:19:42.680465 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:19:42.680465 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:19:42.680465 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:19:42.680465 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:19:42.680465 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:19:42.680465 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:19:42.680465 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:19:42.680465 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:19:42.681551 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:19:42.681551 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:19:42.681551 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:19:42.681551 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:19:42.681551 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:19:42.681551 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:19:42.681551 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:19:42.681551 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:19:42.681551 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:19:42.681551 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:19:42.681551 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:19:42.681551 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:19:42.681551 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:19:42.681551 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:19:42.681551 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:19:42.681551 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:19:42.682439 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:19:42.682439 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:19:42.682439 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:19:42.682439 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:19:42.682439 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:19:42.682439 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:19:42.682439 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:19:42.682439 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:19:42.682439 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:19:42.682439 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:19:42.682439 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 01:19:42.682439 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:19:42.682439 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 614/1222] 10.222.0.60 () {56 vars in 1102 bytes} [Tue Aug 30 01:19:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:19:42.688499 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e105807-17ee-464e-94d5-a374267ff809 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:42.792437 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e105807-17ee-464e-94d5-a374267ff809 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:42.818677 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:42.832161 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550561b3-a498-4b54-a7d9-0f2454300d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:42.832860 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550561b3-a498-4b54-a7d9-0f2454300d57 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:42.833219 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550561b3-a498-4b54-a7d9-0f2454300d57 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:42.833524 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550561b3-a498-4b54-a7d9-0f2454300d57 None admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:42.834205 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550561b3-a498-4b54-a7d9-0f2454300d57 None admin] RBAC: Adding query filter params (name=service) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:19:42.834553 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550561b3-a498-4b54-a7d9-0f2454300d57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:42.836107 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550561b3-a498-4b54-a7d9-0f2454300d57 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:42.846389 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 609/1223] 10.222.0.60 () {56 vars in 1103 bytes} [Tue Aug 30 01:19:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:19:42.852336 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c6ff89-8507-418b-b4e0-bca73f2b7fff None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:42.900456 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:42.961279 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c6ff89-8507-418b-b4e0-bca73f2b7fff None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:43.003189 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0272e75-e835-4cf9-a4b5-41eff2870336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:43.003866 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0272e75-e835-4cf9-a4b5-41eff2870336 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:43.004149 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0272e75-e835-4cf9-a4b5-41eff2870336 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:43.004422 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0272e75-e835-4cf9-a4b5-41eff2870336 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:43.015911 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0272e75-e835-4cf9-a4b5-41eff2870336 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:43.017468 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0272e75-e835-4cf9-a4b5-41eff2870336 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:43.034578 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-d0272e75-e835-4cf9-a4b5-41eff2870336 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:19:43.034578 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:19:43.034578 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:19:43.034578 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:19:43.034578 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:19:43.034578 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:19:43.034578 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:19:43.034578 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:19:43.034578 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:19:43.034578 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:19:43.034578 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:19:43.034578 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:19:43.034578 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:19:43.034578 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:19:43.034578 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:19:43.034578 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:19:43.035928 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:19:43.035928 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:19:43.035928 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:19:43.035928 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:19:43.035928 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:19:43.035928 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:19:43.035928 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:19:43.035928 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:19:43.035928 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:19:43.035928 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:19:43.035928 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:19:43.035928 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:19:43.035928 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:19:43.035928 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:19:43.035928 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:19:43.035928 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:19:43.035928 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:19:43.037098 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:19:43.037098 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:19:43.037098 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:19:43.037098 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 615/1224] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:19:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:19:43.041811 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550561b3-a498-4b54-a7d9-0f2454300d57 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:43.158156 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550561b3-a498-4b54-a7d9-0f2454300d57 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:43.204419 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff682fe-e513-4bc8-8a1c-d48e5d6a3b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:43.205774 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff682fe-e513-4bc8-8a1c-d48e5d6a3b61 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:43.206133 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff682fe-e513-4bc8-8a1c-d48e5d6a3b61 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:43.206482 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff682fe-e513-4bc8-8a1c-d48e5d6a3b61 None admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:43.207479 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff682fe-e513-4bc8-8a1c-d48e5d6a3b61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:19:43.207799 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff682fe-e513-4bc8-8a1c-d48e5d6a3b61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:43.210749 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff682fe-e513-4bc8-8a1c-d48e5d6a3b61 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:43.226309 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 610/1225] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:19:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:19:43.233339 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0272e75-e835-4cf9-a4b5-41eff2870336 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:43.361237 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:43.369304 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0272e75-e835-4cf9-a4b5-41eff2870336 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:43.412991 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035cb78b-079f-409c-abc8-f8c4fc2a3eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:43.413555 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035cb78b-079f-409c-abc8-f8c4fc2a3eca None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:43.413831 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035cb78b-079f-409c-abc8-f8c4fc2a3eca None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:43.414100 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035cb78b-079f-409c-abc8-f8c4fc2a3eca None admin] PATH_INFO: `/v3/users/placement` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:43.423318 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035cb78b-079f-409c-abc8-f8c4fc2a3eca None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:43.425148 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035cb78b-079f-409c-abc8-f8c4fc2a3eca None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:43.439150 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-035cb78b-079f-409c-abc8-f8c4fc2a3eca None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 01:19:43.439150 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:19:43.439150 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:19:43.439150 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:19:43.439150 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:19:43.439150 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:19:43.439150 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:19:43.439150 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:19:43.439150 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:19:43.439150 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:19:43.439150 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:19:43.439150 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:19:43.439150 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 01:19:43.439150 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 01:19:43.439150 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 01:19:43.439150 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 01:19:43.440405 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:19:43.440405 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:19:43.440405 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 01:19:43.440405 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:19:43.440405 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 01:19:43.440405 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:19:43.440405 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:19:43.440405 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:19:43.440405 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:19:43.440405 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:19:43.440405 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:19:43.440405 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:19:43.440405 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:19:43.440405 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:19:43.440405 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:19:43.440405 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:19:43.440405 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:19:43.440405 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:19:43.441494 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:19:43.441494 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:19:43.441494 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 01:19:43.441494 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 01:19:43.441494 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 01:19:43.441494 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 01:19:43.441494 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 01:19:43.441494 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 01:19:43.441494 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 01:19:43.441494 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:19:43.441494 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 616/1226] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:19:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:19:43.447755 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff682fe-e513-4bc8-8a1c-d48e5d6a3b61 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:43.504284 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:43.563906 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff682fe-e513-4bc8-8a1c-d48e5d6a3b61 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:43.624468 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196fd0b3-0445-42c8-8314-f1fdd4da7c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:43.625086 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196fd0b3-0445-42c8-8314-f1fdd4da7c02 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:43.625371 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196fd0b3-0445-42c8-8314-f1fdd4da7c02 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:43.625642 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196fd0b3-0445-42c8-8314-f1fdd4da7c02 None admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:43.626383 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196fd0b3-0445-42c8-8314-f1fdd4da7c02 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:19:43.626688 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196fd0b3-0445-42c8-8314-f1fdd4da7c02 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:43.628191 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196fd0b3-0445-42c8-8314-f1fdd4da7c02 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:43.654425 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 611/1227] 10.222.0.60 () {56 vars in 1143 bytes} [Tue Aug 30 01:19:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:19:43.660764 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035cb78b-079f-409c-abc8-f8c4fc2a3eca None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:43.786972 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035cb78b-079f-409c-abc8-f8c4fc2a3eca None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:43.822873 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d294ecaf-84c8-40d1-b04f-bc4031f352be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:43.823582 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294ecaf-84c8-40d1-b04f-bc4031f352be None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:43.823871 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294ecaf-84c8-40d1-b04f-bc4031f352be None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:43.824099 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294ecaf-84c8-40d1-b04f-bc4031f352be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:43.838358 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d294ecaf-84c8-40d1-b04f-bc4031f352be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:43.840088 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d294ecaf-84c8-40d1-b04f-bc4031f352be None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:43.856136 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-d294ecaf-84c8-40d1-b04f-bc4031f352be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:19:43.856136 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:19:43.856136 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:19:43.856136 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:19:43.856136 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:19:43.856136 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:19:43.856136 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:19:43.856136 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:19:43.856136 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:19:43.856136 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:19:43.856136 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:19:43.856136 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:19:43.856136 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:19:43.856136 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:19:43.856136 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:19:43.856136 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:19:43.857204 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:19:43.857204 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:19:43.857204 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:19:43.857204 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:19:43.857204 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:19:43.857204 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:19:43.857204 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:19:43.857204 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:19:43.857204 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:19:43.857204 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:19:43.857204 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:19:43.857204 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:19:43.857204 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:19:43.857204 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:19:43.857204 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:19:43.857204 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:19:43.857204 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:19:43.858168 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:19:43.858168 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:19:43.858168 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:19:43.858168 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 617/1228] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:19:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:19:43.863739 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196fd0b3-0445-42c8-8314-f1fdd4da7c02 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:43.975122 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196fd0b3-0445-42c8-8314-f1fdd4da7c02 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:43.977453 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:44.013937 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36ced2-1a7e-4a2a-8789-ac9dca56265b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:44.014568 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36ced2-1a7e-4a2a-8789-ac9dca56265b None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:44.014844 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36ced2-1a7e-4a2a-8789-ac9dca56265b None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:44.015121 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36ced2-1a7e-4a2a-8789-ac9dca56265b None admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:44.015929 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e36ced2-1a7e-4a2a-8789-ac9dca56265b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:19:44.016167 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e36ced2-1a7e-4a2a-8789-ac9dca56265b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:44.017576 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e36ced2-1a7e-4a2a-8789-ac9dca56265b None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:44.035099 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 612/1229] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:19:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:19:44.036326 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d294ecaf-84c8-40d1-b04f-bc4031f352be None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:44.046365 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:44.141406 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d294ecaf-84c8-40d1-b04f-bc4031f352be None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:44.176407 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1601bc1-36cf-4e0d-960a-f9a12662c49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:44.177026 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1601bc1-36cf-4e0d-960a-f9a12662c49f None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:44.177305 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1601bc1-36cf-4e0d-960a-f9a12662c49f None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:44.177574 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1601bc1-36cf-4e0d-960a-f9a12662c49f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:44.184292 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1601bc1-36cf-4e0d-960a-f9a12662c49f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:44.186372 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1601bc1-36cf-4e0d-960a-f9a12662c49f None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:44.197916 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-d1601bc1-36cf-4e0d-960a-f9a12662c49f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:19:44.197916 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:19:44.197916 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:19:44.197916 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:19:44.197916 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:19:44.197916 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:19:44.197916 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:19:44.197916 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:19:44.197916 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:19:44.197916 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:19:44.197916 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:19:44.197916 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:19:44.197916 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 01:19:44.197916 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 01:19:44.197916 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 01:19:44.198889 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 01:19:44.198889 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:19:44.198889 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:19:44.198889 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:19:44.198889 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:19:44.198889 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:19:44.198889 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:19:44.198889 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:19:44.198889 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:19:44.198889 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:19:44.198889 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:19:44.198889 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:19:44.198889 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:19:44.198889 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:19:44.198889 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:19:44.198889 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:19:44.198889 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:19:44.199871 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 01:19:44.199871 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 01:19:44.199871 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 01:19:44.199871 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 01:19:44.199871 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 01:19:44.199871 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 01:19:44.199871 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:19:44.199871 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:19:44.199871 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 618/1230] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 30 01:19:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:19:44.205683 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36ced2-1a7e-4a2a-8789-ac9dca56265b None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:44.322600 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36ced2-1a7e-4a2a-8789-ac9dca56265b None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:44.360882 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b4411-bf62-4552-9228-d6afacfe5c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:44.361361 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b4411-bf62-4552-9228-d6afacfe5c81 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:44.361644 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b4411-bf62-4552-9228-d6afacfe5c81 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:44.361919 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b4411-bf62-4552-9228-d6afacfe5c81 None admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:44.362661 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73b4411-bf62-4552-9228-d6afacfe5c81 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:19:44.363112 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73b4411-bf62-4552-9228-d6afacfe5c81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:44.364712 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73b4411-bf62-4552-9228-d6afacfe5c81 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:44.380617 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 613/1231] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 30 01:19:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:19:44.389675 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1601bc1-36cf-4e0d-960a-f9a12662c49f None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:44.465005 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:44.504554 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1601bc1-36cf-4e0d-960a-f9a12662c49f None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:44.541330 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe75ec-5769-4cab-a346-be95b4fcb9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:44.542606 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe75ec-5769-4cab-a346-be95b4fcb9bb None admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:44.542919 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe75ec-5769-4cab-a346-be95b4fcb9bb None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:44.543212 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe75ec-5769-4cab-a346-be95b4fcb9bb None admin] PATH_INFO: `/v3/projects/b050b2dad22a4a06875072e44c8c9824/users/e8dbb4742c3944b9ad389e9628b5a047/roles/01439ffbf0dd41caadd0cc40b3176062` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:44.559139 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbe75ec-5769-4cab-a346-be95b4fcb9bb None admin] RBAC: Authorizing `identity:create_grant(project_id=b050b2dad22a4a06875072e44c8c9824, user_id=e8dbb4742c3944b9ad389e9628b5a047, role_id=01439ffbf0dd41caadd0cc40b3176062)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:44.560625 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbe75ec-5769-4cab-a346-be95b4fcb9bb None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:44.574438 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 619/1232] 10.222.0.60 () {58 vars in 1439 bytes} [Tue Aug 30 01:19:44 2022] PUT /identity/v3/projects/b050b2dad22a4a06875072e44c8c9824/users/e8dbb4742c3944b9ad389e9628b5a047/roles/01439ffbf0dd41caadd0cc40b3176062 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:19:46.543619 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4ff03-e4a8-4ffe-9baf-7dea33eca643 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:46.544199 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4ff03-e4a8-4ffe-9baf-7dea33eca643 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:46.544199 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4ff03-e4a8-4ffe-9baf-7dea33eca643 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:46.546175 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 614/1233] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:19:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:19:46.551923 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa357fbe-b52a-466b-b9fc-12a0813188c2 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:46.552342 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa357fbe-b52a-466b-b9fc-12a0813188c2 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:46.552537 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa357fbe-b52a-466b-b9fc-12a0813188c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:46.572702 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-fa357fbe-b52a-466b-b9fc-12a0813188c2 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:19:46.573899 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-fa357fbe-b52a-466b-b9fc-12a0813188c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:46.644696 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 620/1234] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:19:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:19:46.911079 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d4ff03-e4a8-4ffe-9baf-7dea33eca643 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:46.937392 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:47.021571 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d4ff03-e4a8-4ffe-9baf-7dea33eca643 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:47.060075 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16acece-50ff-405d-8222-bbafd0d40b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:47.060706 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16acece-50ff-405d-8222-bbafd0d40b3a None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:47.060964 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16acece-50ff-405d-8222-bbafd0d40b3a None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:47.061241 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16acece-50ff-405d-8222-bbafd0d40b3a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:47.073227 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16acece-50ff-405d-8222-bbafd0d40b3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:19:47.079528 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-a16acece-50ff-405d-8222-bbafd0d40b3a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 01:19:47.079528 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:19:47.079528 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:19:47.079528 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:19:47.079528 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:19:47.079528 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:19:47.079528 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:19:47.079528 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:19:47.079528 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:19:47.079528 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:19:47.079528 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:19:47.079528 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:19:47.079528 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:19:47.079528 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:19:47.079528 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:19:47.079528 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:19:47.080892 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:19:47.080892 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:19:47.080892 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:19:47.080892 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:19:47.080892 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:19:47.080892 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:19:47.080892 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:19:47.080892 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:19:47.080892 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:19:47.080892 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:19:47.080892 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:19:47.080892 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:19:47.080892 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:19:47.080892 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:19:47.080892 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:19:47.080892 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:19:47.082038 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:19:47.082038 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:19:47.082038 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:19:47.082038 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:19:47.082038 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:19:47.082038 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:19:47.082038 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:19:47.082038 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:19:47.082038 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:19:47.082038 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:19:47.082038 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 01:19:47.082038 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:19:47.082038 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 615/1235] 10.222.0.60 () {56 vars in 1102 bytes} [Tue Aug 30 01:19:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:19:47.087129 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa357fbe-b52a-466b-b9fc-12a0813188c2 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:47.143427 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:47.206025 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa357fbe-b52a-466b-b9fc-12a0813188c2 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:47.240781 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5ecfa-12e5-4e6b-ba8b-27fc245173da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:47.241492 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5ecfa-12e5-4e6b-ba8b-27fc245173da None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:47.241857 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5ecfa-12e5-4e6b-ba8b-27fc245173da None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:47.242143 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5ecfa-12e5-4e6b-ba8b-27fc245173da None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:47.242939 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b5ecfa-12e5-4e6b-ba8b-27fc245173da None admin] RBAC: Adding query filter params (name=service) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:19:47.243179 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b5ecfa-12e5-4e6b-ba8b-27fc245173da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:47.244776 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b5ecfa-12e5-4e6b-ba8b-27fc245173da None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:47.254213 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 621/1236] 10.222.0.60 () {56 vars in 1103 bytes} [Tue Aug 30 01:19:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:19:47.260196 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16acece-50ff-405d-8222-bbafd0d40b3a None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:47.354528 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:47.373037 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16acece-50ff-405d-8222-bbafd0d40b3a None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:47.415179 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641fc66a-23c0-41a1-a84d-93ddbe789cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:47.415933 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641fc66a-23c0-41a1-a84d-93ddbe789cf4 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:47.416167 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641fc66a-23c0-41a1-a84d-93ddbe789cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:47.416512 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641fc66a-23c0-41a1-a84d-93ddbe789cf4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:47.427974 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641fc66a-23c0-41a1-a84d-93ddbe789cf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:47.429512 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641fc66a-23c0-41a1-a84d-93ddbe789cf4 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:47.444902 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-641fc66a-23c0-41a1-a84d-93ddbe789cf4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:19:47.444902 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:19:47.444902 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:19:47.444902 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:19:47.444902 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:19:47.444902 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:19:47.444902 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:19:47.444902 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:19:47.444902 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:19:47.444902 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:19:47.444902 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:19:47.444902 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:19:47.444902 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:19:47.444902 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:19:47.444902 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:19:47.444902 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:19:47.446520 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:19:47.446520 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:19:47.446520 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:19:47.446520 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:19:47.446520 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:19:47.446520 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:19:47.446520 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:19:47.446520 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:19:47.446520 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:19:47.446520 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:19:47.446520 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:19:47.446520 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:19:47.446520 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:19:47.446520 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:19:47.446520 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:19:47.446520 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:19:47.446520 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:19:47.447903 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:19:47.447903 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:19:47.447903 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:19:47.447903 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 616/1237] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:19:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:19:47.452343 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5ecfa-12e5-4e6b-ba8b-27fc245173da None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:47.565211 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5ecfa-12e5-4e6b-ba8b-27fc245173da None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:47.574738 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:47.604703 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb3af71-477a-4f9b-b5bd-8553eacd7f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:47.604703 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb3af71-477a-4f9b-b5bd-8553eacd7f8a None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:47.604703 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb3af71-477a-4f9b-b5bd-8553eacd7f8a None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:47.604703 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb3af71-477a-4f9b-b5bd-8553eacd7f8a None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:47.605836 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb3af71-477a-4f9b-b5bd-8553eacd7f8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:19:47.606011 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb3af71-477a-4f9b-b5bd-8553eacd7f8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:47.607629 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb3af71-477a-4f9b-b5bd-8553eacd7f8a None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:47.623615 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 622/1238] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:19:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:19:47.629547 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641fc66a-23c0-41a1-a84d-93ddbe789cf4 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:47.749275 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641fc66a-23c0-41a1-a84d-93ddbe789cf4 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:47.784885 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29ff3a5-ead3-45e8-aed8-b6001d8df0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:47.785538 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29ff3a5-ead3-45e8-aed8-b6001d8df0d2 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:47.785831 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29ff3a5-ead3-45e8-aed8-b6001d8df0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:47.786133 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29ff3a5-ead3-45e8-aed8-b6001d8df0d2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:47.789341 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:47.795122 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29ff3a5-ead3-45e8-aed8-b6001d8df0d2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:47.796704 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29ff3a5-ead3-45e8-aed8-b6001d8df0d2 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:47.808243 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-a29ff3a5-ead3-45e8-aed8-b6001d8df0d2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 01:19:47.808243 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:19:47.808243 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:19:47.808243 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:19:47.808243 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:19:47.808243 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:19:47.808243 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:19:47.808243 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:19:47.808243 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:19:47.808243 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:19:47.808243 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:19:47.808243 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:19:47.808243 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 01:19:47.808243 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 01:19:47.808243 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 01:19:47.808243 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 01:19:47.809465 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:19:47.809465 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:19:47.809465 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 01:19:47.809465 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:19:47.809465 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 01:19:47.809465 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:19:47.809465 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:19:47.809465 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:19:47.809465 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:19:47.809465 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:19:47.809465 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:19:47.809465 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:19:47.809465 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:19:47.809465 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:19:47.809465 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:19:47.809465 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:19:47.809465 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:19:47.809465 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:19:47.810632 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:19:47.810632 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:19:47.810632 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 01:19:47.810632 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 01:19:47.810632 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 01:19:47.810632 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 01:19:47.810632 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 01:19:47.810632 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 01:19:47.810632 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 01:19:47.810632 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:19:47.810632 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 617/1239] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:19:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:19:47.815520 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb3af71-477a-4f9b-b5bd-8553eacd7f8a None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:47.958464 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb3af71-477a-4f9b-b5bd-8553eacd7f8a None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:48.000648 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ce32c-2d8c-43eb-9753-be3dc654e4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:48.001340 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ce32c-2d8c-43eb-9753-be3dc654e4c8 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:48.001795 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ce32c-2d8c-43eb-9753-be3dc654e4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:48.002094 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ce32c-2d8c-43eb-9753-be3dc654e4c8 None admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:48.002958 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1ce32c-2d8c-43eb-9753-be3dc654e4c8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:19:48.003319 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1ce32c-2d8c-43eb-9753-be3dc654e4c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:48.004851 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1ce32c-2d8c-43eb-9753-be3dc654e4c8 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:48.027664 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 623/1240] 10.222.0.60 () {56 vars in 1143 bytes} [Tue Aug 30 01:19:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:19:48.034714 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29ff3a5-ead3-45e8-aed8-b6001d8df0d2 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:48.155011 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29ff3a5-ead3-45e8-aed8-b6001d8df0d2 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:48.190352 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0540791f-8277-42c3-85ff-72fc960e2496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:48.190962 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540791f-8277-42c3-85ff-72fc960e2496 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:48.191281 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540791f-8277-42c3-85ff-72fc960e2496 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:48.191641 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540791f-8277-42c3-85ff-72fc960e2496 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:48.266429 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:48.274350 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0540791f-8277-42c3-85ff-72fc960e2496 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:48.276030 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0540791f-8277-42c3-85ff-72fc960e2496 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:48.403371 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 618/1241] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 30 01:19:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 01:19:48.412947 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ce32c-2d8c-43eb-9753-be3dc654e4c8 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:48.443098 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:48.548842 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ce32c-2d8c-43eb-9753-be3dc654e4c8 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:48.597568 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8014b3-f430-4556-bb17-cc8df2f2f6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:48.598209 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8014b3-f430-4556-bb17-cc8df2f2f6d9 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:48.598482 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8014b3-f430-4556-bb17-cc8df2f2f6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:48.598740 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8014b3-f430-4556-bb17-cc8df2f2f6d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:48.610906 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8014b3-f430-4556-bb17-cc8df2f2f6d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:48.614969 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8014b3-f430-4556-bb17-cc8df2f2f6d9 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:48.631445 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-dd8014b3-f430-4556-bb17-cc8df2f2f6d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:19:48.631445 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:19:48.631445 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:19:48.631445 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:19:48.631445 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:19:48.631445 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:19:48.631445 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:19:48.631445 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:19:48.631445 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:19:48.631445 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:19:48.631445 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:19:48.631445 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:19:48.631445 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:19:48.631445 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:19:48.631445 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:19:48.631445 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:19:48.632693 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:19:48.632693 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:19:48.632693 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:19:48.632693 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:19:48.632693 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:19:48.632693 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:19:48.632693 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:19:48.632693 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:19:48.632693 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:19:48.632693 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:19:48.632693 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:19:48.632693 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:19:48.632693 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:19:48.632693 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:19:48.632693 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:19:48.632693 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:19:48.632693 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:19:48.633846 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:19:48.633846 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:19:48.633846 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:19:48.633846 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 624/1242] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:19:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:19:48.640727 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0540791f-8277-42c3-85ff-72fc960e2496 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:48.759764 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:48.766633 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0540791f-8277-42c3-85ff-72fc960e2496 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:48.811700 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0540a3-ce2f-4271-b5d9-20225c54e81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:48.812353 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0540a3-ce2f-4271-b5d9-20225c54e81a None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:48.812628 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0540a3-ce2f-4271-b5d9-20225c54e81a None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:48.812899 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0540a3-ce2f-4271-b5d9-20225c54e81a None admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:48.813546 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0540a3-ce2f-4271-b5d9-20225c54e81a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:19:48.813895 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0540a3-ce2f-4271-b5d9-20225c54e81a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:48.817598 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0540a3-ce2f-4271-b5d9-20225c54e81a None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:48.829843 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 619/1243] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:19:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:19:48.836556 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8014b3-f430-4556-bb17-cc8df2f2f6d9 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:48.931877 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:48.961926 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8014b3-f430-4556-bb17-cc8df2f2f6d9 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:49.023561 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c573db8-fc48-4896-9aee-099d52bb25ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:49.024136 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c573db8-fc48-4896-9aee-099d52bb25ad None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:49.024412 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c573db8-fc48-4896-9aee-099d52bb25ad None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:49.024804 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c573db8-fc48-4896-9aee-099d52bb25ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:49.034272 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c573db8-fc48-4896-9aee-099d52bb25ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:49.036111 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c573db8-fc48-4896-9aee-099d52bb25ad None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:49.052342 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-4c573db8-fc48-4896-9aee-099d52bb25ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:19:49.052342 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:19:49.052342 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:19:49.052342 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:19:49.052342 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:19:49.052342 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:19:49.052342 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:19:49.052342 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:19:49.052342 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:19:49.052342 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:19:49.052342 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:19:49.052342 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:19:49.052342 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 01:19:49.052342 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 01:19:49.052342 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 01:19:49.054279 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 01:19:49.054279 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:19:49.054279 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:19:49.054279 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:19:49.054279 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:19:49.054279 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:19:49.054279 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:19:49.054279 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:19:49.054279 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:19:49.054279 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:19:49.054279 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:19:49.054279 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:19:49.054279 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:19:49.054279 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:19:49.054279 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:19:49.054279 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:19:49.054279 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:19:49.056149 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 01:19:49.056149 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 01:19:49.056149 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 01:19:49.056149 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 01:19:49.056149 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 01:19:49.056149 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 01:19:49.056149 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:19:49.056149 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:19:49.056149 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 625/1244] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 30 01:19:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:19:49.059882 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0540a3-ce2f-4271-b5d9-20225c54e81a None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:49.181000 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0540a3-ce2f-4271-b5d9-20225c54e81a None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:49.217964 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b51444-3cbc-4730-8264-f3a5c054756d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:49.218583 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b51444-3cbc-4730-8264-f3a5c054756d None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:49.218877 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b51444-3cbc-4730-8264-f3a5c054756d None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:49.219225 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b51444-3cbc-4730-8264-f3a5c054756d None admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:49.219932 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b51444-3cbc-4730-8264-f3a5c054756d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:19:49.220246 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b51444-3cbc-4730-8264-f3a5c054756d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:49.221768 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b51444-3cbc-4730-8264-f3a5c054756d None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:49.238121 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 620/1245] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 30 01:19:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:19:49.247659 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c573db8-fc48-4896-9aee-099d52bb25ad None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:49.361182 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c573db8-fc48-4896-9aee-099d52bb25ad None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:49.397915 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab9fc29-94c6-4b3f-900a-9f400df3ae5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:49.398510 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9fc29-94c6-4b3f-900a-9f400df3ae5b None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:49.398786 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9fc29-94c6-4b3f-900a-9f400df3ae5b None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:49.399053 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9fc29-94c6-4b3f-900a-9f400df3ae5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:49.399947 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab9fc29-94c6-4b3f-900a-9f400df3ae5b None admin] RBAC: Adding query filter params (role.id=01439ffbf0dd41caadd0cc40b3176062, scope.project.id=b050b2dad22a4a06875072e44c8c9824, user.id=e8dbb4742c3944b9ad389e9628b5a047) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:19:49.400242 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab9fc29-94c6-4b3f-900a-9f400df3ae5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:49.401780 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab9fc29-94c6-4b3f-900a-9f400df3ae5b None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:49.409245 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 626/1246] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 30 01:19:49 2022] GET /identity/v3/role_assignments?user.id=e8dbb4742c3944b9ad389e9628b5a047&scope.project.id=b050b2dad22a4a06875072e44c8c9824&role.id=01439ffbf0dd41caadd0cc40b3176062 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:19:51.605942 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040aba0-5ea7-4221-8986-53a19c38e504 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:51.606393 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040aba0-5ea7-4221-8986-53a19c38e504 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:51.606502 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040aba0-5ea7-4221-8986-53a19c38e504 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:51.611479 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 621/1247] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:19:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:19:51.614649 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4f89e-ec09-41a3-8407-8af4717784a9 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:51.615301 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4f89e-ec09-41a3-8407-8af4717784a9 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:51.615301 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4f89e-ec09-41a3-8407-8af4717784a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:51.622105 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:51.637706 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-42a4f89e-ec09-41a3-8407-8af4717784a9 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:19:51.639649 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-42a4f89e-ec09-41a3-8407-8af4717784a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:51.719507 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 627/1248] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:19:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:19:52.034919 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7040aba0-5ea7-4221-8986-53a19c38e504 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:52.055843 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:52.176931 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7040aba0-5ea7-4221-8986-53a19c38e504 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:52.215633 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c27e9-b33e-49f3-ab91-49acdb63545b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:52.216264 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c27e9-b33e-49f3-ab91-49acdb63545b None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:52.216546 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c27e9-b33e-49f3-ab91-49acdb63545b None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:52.216833 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c27e9-b33e-49f3-ab91-49acdb63545b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:52.229781 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50c27e9-b33e-49f3-ab91-49acdb63545b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:19:52.235838 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-e50c27e9-b33e-49f3-ab91-49acdb63545b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:19:52.235838 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:19:52.235838 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:19:52.235838 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:19:52.235838 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:19:52.235838 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:19:52.235838 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:19:52.235838 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:19:52.235838 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:19:52.235838 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:19:52.235838 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:19:52.235838 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:19:52.235838 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:19:52.235838 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:19:52.235838 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:19:52.235838 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:19:52.237013 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:19:52.237013 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:19:52.237013 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:19:52.237013 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:19:52.237013 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:19:52.237013 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:19:52.237013 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:19:52.237013 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:19:52.237013 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:19:52.237013 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:19:52.237013 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:19:52.237013 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:19:52.237013 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:19:52.237013 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:19:52.237013 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:19:52.237013 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:19:52.238046 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:19:52.238046 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:19:52.238046 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:19:52.238046 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:19:52.238046 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:19:52.238046 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:19:52.238046 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:19:52.238046 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:19:52.238046 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:19:52.238046 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:19:52.238046 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:19:52.238046 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:19:52.238046 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 622/1249] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 30 01:19:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:19:52.243747 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a4f89e-ec09-41a3-8407-8af4717784a9 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:52.350449 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a4f89e-ec09-41a3-8407-8af4717784a9 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:52.383863 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:52.391189 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829005ad-be82-4e17-b4de-27024e399124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:52.391919 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829005ad-be82-4e17-b4de-27024e399124 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:52.392342 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829005ad-be82-4e17-b4de-27024e399124 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:52.392714 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829005ad-be82-4e17-b4de-27024e399124 None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:52.393677 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829005ad-be82-4e17-b4de-27024e399124 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:19:52.394206 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829005ad-be82-4e17-b4de-27024e399124 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:52.396811 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829005ad-be82-4e17-b4de-27024e399124 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:52.411754 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 628/1250] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 30 01:19:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:19:52.412937 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c27e9-b33e-49f3-ab91-49acdb63545b None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:52.499201 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:52.522831 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c27e9-b33e-49f3-ab91-49acdb63545b None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:52.562727 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021be785-4aaa-4cc6-bde9-4cc87302e8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:52.563477 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021be785-4aaa-4cc6-bde9-4cc87302e8aa None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:52.563769 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021be785-4aaa-4cc6-bde9-4cc87302e8aa None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:52.564042 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021be785-4aaa-4cc6-bde9-4cc87302e8aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:52.575754 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021be785-4aaa-4cc6-bde9-4cc87302e8aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:52.577239 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021be785-4aaa-4cc6-bde9-4cc87302e8aa None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:52.595678 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-021be785-4aaa-4cc6-bde9-4cc87302e8aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:19:52.595678 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:19:52.595678 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:19:52.595678 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:19:52.595678 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:19:52.595678 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:19:52.595678 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:19:52.595678 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:19:52.595678 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:19:52.595678 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:19:52.595678 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:19:52.595678 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:19:52.595678 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:19:52.595678 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:19:52.595678 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:19:52.595678 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:19:52.597065 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:19:52.597065 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:19:52.597065 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:19:52.597065 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:19:52.597065 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:19:52.597065 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:19:52.597065 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:19:52.597065 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:19:52.597065 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:19:52.597065 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:19:52.597065 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:19:52.597065 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:19:52.597065 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:19:52.597065 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:19:52.597065 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:19:52.597065 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:19:52.597065 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:19:52.598222 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:19:52.598222 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:19:52.598222 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:19:52.598646 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 623/1251] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:19:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 01:19:52.604101 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829005ad-be82-4e17-b4de-27024e399124 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:52.725115 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829005ad-be82-4e17-b4de-27024e399124 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:52.762350 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f12184-e343-4b49-b20d-7096022ce9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:52.762956 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f12184-e343-4b49-b20d-7096022ce9b6 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:52.763233 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f12184-e343-4b49-b20d-7096022ce9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:52.763676 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f12184-e343-4b49-b20d-7096022ce9b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:52.764170 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f12184-e343-4b49-b20d-7096022ce9b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:19:52.764468 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f12184-e343-4b49-b20d-7096022ce9b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:52.765956 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f12184-e343-4b49-b20d-7096022ce9b6 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:52.778499 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 629/1252] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:19:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:19:52.786521 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021be785-4aaa-4cc6-bde9-4cc87302e8aa None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:52.904100 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021be785-4aaa-4cc6-bde9-4cc87302e8aa None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:52.937143 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:52.945734 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e364d-f849-42f8-b6f4-a76c764f7fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:52.946362 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e364d-f849-42f8-b6f4-a76c764f7fa6 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:52.946686 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e364d-f849-42f8-b6f4-a76c764f7fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:52.946979 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e364d-f849-42f8-b6f4-a76c764f7fa6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:52.956061 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527e364d-f849-42f8-b6f4-a76c764f7fa6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:52.957611 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527e364d-f849-42f8-b6f4-a76c764f7fa6 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:52.971201 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-527e364d-f849-42f8-b6f4-a76c764f7fa6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 01:19:52.971201 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:19:52.971201 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:19:52.971201 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:19:52.971201 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:19:52.971201 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:19:52.971201 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:19:52.971201 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:19:52.971201 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:19:52.971201 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:19:52.971201 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:19:52.971201 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:19:52.971201 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 01:19:52.971201 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 01:19:52.971201 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 01:19:52.971201 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 01:19:52.973193 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:19:52.973193 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:19:52.973193 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 01:19:52.973193 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:19:52.973193 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 01:19:52.973193 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:19:52.973193 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:19:52.973193 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:19:52.973193 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:19:52.973193 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:19:52.973193 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:19:52.973193 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:19:52.973193 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:19:52.973193 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:19:52.973193 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:19:52.973193 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:19:52.973193 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:19:52.973193 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:19:52.974737 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:19:52.974737 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:19:52.974737 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 01:19:52.974737 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 01:19:52.974737 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 01:19:52.974737 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 01:19:52.974737 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 01:19:52.974737 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 01:19:52.974737 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 01:19:52.974737 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:19:52.974737 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 624/1253] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:19:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:19:52.979137 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f12184-e343-4b49-b20d-7096022ce9b6 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:53.046186 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:53.097120 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f12184-e343-4b49-b20d-7096022ce9b6 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:53.133610 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dcb652-fe38-49f4-a01d-d4710e61aebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:53.134228 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dcb652-fe38-49f4-a01d-d4710e61aebd None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:53.134508 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dcb652-fe38-49f4-a01d-d4710e61aebd None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:53.134779 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dcb652-fe38-49f4-a01d-d4710e61aebd None admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:53.135537 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dcb652-fe38-49f4-a01d-d4710e61aebd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:19:53.135844 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dcb652-fe38-49f4-a01d-d4710e61aebd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:53.137270 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dcb652-fe38-49f4-a01d-d4710e61aebd None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:53.157578 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 630/1254] 10.222.0.60 () {56 vars in 1143 bytes} [Tue Aug 30 01:19:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:19:53.164306 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e364d-f849-42f8-b6f4-a76c764f7fa6 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:53.277544 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e364d-f849-42f8-b6f4-a76c764f7fa6 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:53.311457 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f154bd-d449-4eeb-911f-510e61388f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:53.312071 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f154bd-d449-4eeb-911f-510e61388f97 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:53.312353 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f154bd-d449-4eeb-911f-510e61388f97 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:53.312626 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f154bd-d449-4eeb-911f-510e61388f97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:53.369280 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:53.383115 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f154bd-d449-4eeb-911f-510e61388f97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:53.384607 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f154bd-d449-4eeb-911f-510e61388f97 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:53.490056 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 625/1255] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 30 01:19:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 01:19:53.495990 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dcb652-fe38-49f4-a01d-d4710e61aebd None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:53.613262 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dcb652-fe38-49f4-a01d-d4710e61aebd None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:53.627782 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:53.652186 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe072197-2358-4257-93a8-f582679defb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:53.652886 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe072197-2358-4257-93a8-f582679defb2 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:53.653248 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe072197-2358-4257-93a8-f582679defb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:53.653437 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe072197-2358-4257-93a8-f582679defb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:53.664515 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe072197-2358-4257-93a8-f582679defb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:53.666249 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe072197-2358-4257-93a8-f582679defb2 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:53.686411 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-fe072197-2358-4257-93a8-f582679defb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:19:53.686411 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:19:53.686411 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:19:53.686411 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:19:53.686411 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:19:53.686411 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:19:53.686411 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:19:53.686411 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:19:53.686411 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:19:53.686411 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:19:53.686411 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:19:53.686411 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:19:53.686411 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:19:53.686411 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:19:53.686411 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:19:53.686411 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:19:53.687662 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:19:53.687662 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:19:53.687662 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:19:53.687662 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:19:53.687662 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:19:53.687662 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:19:53.687662 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:19:53.687662 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:19:53.687662 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:19:53.687662 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:19:53.687662 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:19:53.687662 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:19:53.687662 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:19:53.687662 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:19:53.687662 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:19:53.687662 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:19:53.687662 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:19:53.688931 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:19:53.688931 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:19:53.688931 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:19:53.688931 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 631/1256] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:19:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:19:53.693597 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f154bd-d449-4eeb-911f-510e61388f97 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:53.793539 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:53.805896 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f154bd-d449-4eeb-911f-510e61388f97 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:53.843901 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7211f3e9-6b08-48d4-a1de-f27133e8f8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:53.844827 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211f3e9-6b08-48d4-a1de-f27133e8f8ac None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:53.845194 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211f3e9-6b08-48d4-a1de-f27133e8f8ac None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:53.845557 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211f3e9-6b08-48d4-a1de-f27133e8f8ac None admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:53.846287 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7211f3e9-6b08-48d4-a1de-f27133e8f8ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:19:53.846590 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7211f3e9-6b08-48d4-a1de-f27133e8f8ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:53.848106 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7211f3e9-6b08-48d4-a1de-f27133e8f8ac None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:53.865776 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 626/1257] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:19:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:19:53.867113 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe072197-2358-4257-93a8-f582679defb2 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:53.983376 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe072197-2358-4257-93a8-f582679defb2 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:54.027509 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24b375d-456e-440c-95cd-da5a88e8f084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:54.028159 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b375d-456e-440c-95cd-da5a88e8f084 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:54.028560 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b375d-456e-440c-95cd-da5a88e8f084 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:54.028848 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b375d-456e-440c-95cd-da5a88e8f084 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:54.038512 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24b375d-456e-440c-95cd-da5a88e8f084 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:54.040025 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24b375d-456e-440c-95cd-da5a88e8f084 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:54.054090 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-a24b375d-456e-440c-95cd-da5a88e8f084 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:19:54.054090 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:19:54.054090 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:19:54.054090 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:19:54.054090 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:19:54.054090 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:19:54.054090 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:19:54.054090 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:19:54.054090 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:19:54.054090 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:19:54.054090 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:19:54.054090 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:19:54.054090 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 01:19:54.054090 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 01:19:54.054090 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 01:19:54.059635 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 01:19:54.059635 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:19:54.059635 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:19:54.059635 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:19:54.059635 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:19:54.059635 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:19:54.059635 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:19:54.059635 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:19:54.059635 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:19:54.059635 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:19:54.059635 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:19:54.059635 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:19:54.059635 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:19:54.059635 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:19:54.059635 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:19:54.059635 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:19:54.059635 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:19:54.061363 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 01:19:54.061363 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 01:19:54.061363 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 01:19:54.061363 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 01:19:54.061363 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 01:19:54.061363 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 01:19:54.061363 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:19:54.061363 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:19:54.061363 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 632/1258] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 30 01:19:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:19:54.061997 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7211f3e9-6b08-48d4-a1de-f27133e8f8ac None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:54.183260 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7211f3e9-6b08-48d4-a1de-f27133e8f8ac None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:54.219773 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a28ee45-c0b4-4c46-a021-35e019550ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:54.220408 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28ee45-c0b4-4c46-a021-35e019550ced None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:54.220701 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28ee45-c0b4-4c46-a021-35e019550ced None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:54.220998 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28ee45-c0b4-4c46-a021-35e019550ced None admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:54.221719 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a28ee45-c0b4-4c46-a021-35e019550ced None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:19:54.222026 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a28ee45-c0b4-4c46-a021-35e019550ced None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:54.223505 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a28ee45-c0b4-4c46-a021-35e019550ced None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:54.236316 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 627/1259] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 30 01:19:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:19:54.242571 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24b375d-456e-440c-95cd-da5a88e8f084 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:54.269716 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:54.363968 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24b375d-456e-440c-95cd-da5a88e8f084 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:54.405077 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df26836-478d-420b-8e7e-8461ae627a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:54.405697 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df26836-478d-420b-8e7e-8461ae627a36 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:54.405974 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df26836-478d-420b-8e7e-8461ae627a36 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:54.406242 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df26836-478d-420b-8e7e-8461ae627a36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:54.406987 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df26836-478d-420b-8e7e-8461ae627a36 None admin] RBAC: Adding query filter params (role.id=f6bc03b6972e420eb338ee7fd1443974, scope.project.id=b050b2dad22a4a06875072e44c8c9824, user.id=e8dbb4742c3944b9ad389e9628b5a047) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:19:54.407292 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df26836-478d-420b-8e7e-8461ae627a36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:54.408778 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df26836-478d-420b-8e7e-8461ae627a36 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:54.414748 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 633/1260] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 30 01:19:54 2022] GET /identity/v3/role_assignments?user.id=e8dbb4742c3944b9ad389e9628b5a047&scope.project.id=b050b2dad22a4a06875072e44c8c9824&role.id=f6bc03b6972e420eb338ee7fd1443974 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:19:56.336591 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb665f8-fbfd-4c6e-9319-c531172250d9 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:56.337118 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb665f8-fbfd-4c6e-9319-c531172250d9 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:56.337118 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb665f8-fbfd-4c6e-9319-c531172250d9 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:56.338454 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 628/1261] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:19:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:19:56.344199 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a27c4-daf6-4293-a354-2433cf72a40a None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:56.344620 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a27c4-daf6-4293-a354-2433cf72a40a None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:56.344743 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a27c4-daf6-4293-a354-2433cf72a40a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:56.362947 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-0e5a27c4-daf6-4293-a354-2433cf72a40a None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:19:56.364159 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-0e5a27c4-daf6-4293-a354-2433cf72a40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:19:56.428973 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 634/1262] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:19:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:19:56.695970 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb665f8-fbfd-4c6e-9319-c531172250d9 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:56.707256 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:56.797396 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb665f8-fbfd-4c6e-9319-c531172250d9 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:56.836218 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff6c25-915a-45a2-8351-73cc306db6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:56.837066 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff6c25-915a-45a2-8351-73cc306db6a7 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:56.837295 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff6c25-915a-45a2-8351-73cc306db6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:56.837670 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff6c25-915a-45a2-8351-73cc306db6a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:56.856691 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eff6c25-915a-45a2-8351-73cc306db6a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:19:56.863067 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-1eff6c25-915a-45a2-8351-73cc306db6a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:19:56.863067 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:19:56.863067 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:19:56.863067 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:19:56.863067 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:19:56.863067 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:19:56.863067 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:19:56.863067 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:19:56.863067 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:19:56.863067 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:19:56.863067 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:19:56.863067 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:19:56.863067 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:19:56.863067 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:19:56.863067 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:19:56.863067 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:19:56.864375 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:19:56.864375 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:19:56.864375 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:19:56.864375 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:19:56.864375 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:19:56.864375 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:19:56.864375 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:19:56.864375 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:19:56.864375 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:19:56.864375 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:19:56.864375 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:19:56.864375 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:19:56.864375 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:19:56.864375 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:19:56.864375 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:19:56.864375 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:19:56.865299 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:19:56.865299 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:19:56.865299 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:19:56.865299 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:19:56.865299 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:19:56.865299 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:19:56.865299 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:19:56.865299 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:19:56.865299 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:19:56.865299 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:19:56.865299 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:19:56.865299 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:19:56.865299 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 629/1263] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 30 01:19:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:19:56.871289 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a27c4-daf6-4293-a354-2433cf72a40a None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:56.893191 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:56.980302 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a27c4-daf6-4293-a354-2433cf72a40a None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:57.016156 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b57e56c-79b4-48d8-90bd-4fd21f295cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:57.016756 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57e56c-79b4-48d8-90bd-4fd21f295cbb None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:57.017035 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57e56c-79b4-48d8-90bd-4fd21f295cbb None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:57.017307 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57e56c-79b4-48d8-90bd-4fd21f295cbb None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:57.017967 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b57e56c-79b4-48d8-90bd-4fd21f295cbb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:19:57.018269 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b57e56c-79b4-48d8-90bd-4fd21f295cbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:57.019772 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b57e56c-79b4-48d8-90bd-4fd21f295cbb None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:57.027837 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 635/1264] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 30 01:19:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:19:57.034206 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff6c25-915a-45a2-8351-73cc306db6a7 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:57.099547 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:57.132017 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff6c25-915a-45a2-8351-73cc306db6a7 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:57.164561 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39464eb7-eab4-45b6-b215-b1525093aa58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:57.165167 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39464eb7-eab4-45b6-b215-b1525093aa58 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:57.165439 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39464eb7-eab4-45b6-b215-b1525093aa58 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:57.165702 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39464eb7-eab4-45b6-b215-b1525093aa58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:57.175327 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39464eb7-eab4-45b6-b215-b1525093aa58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:57.176774 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39464eb7-eab4-45b6-b215-b1525093aa58 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:57.191244 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-39464eb7-eab4-45b6-b215-b1525093aa58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:19:57.191244 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:19:57.191244 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:19:57.191244 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:19:57.191244 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:19:57.191244 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:19:57.191244 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:19:57.191244 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:19:57.191244 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:19:57.191244 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:19:57.191244 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:19:57.191244 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:19:57.191244 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:19:57.191244 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:19:57.191244 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:19:57.191244 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:19:57.192441 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:19:57.192441 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:19:57.192441 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:19:57.192441 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:19:57.192441 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:19:57.192441 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:19:57.192441 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:19:57.192441 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:19:57.192441 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:19:57.192441 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:19:57.192441 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:19:57.192441 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:19:57.192441 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:19:57.192441 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:19:57.192441 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:19:57.192441 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:19:57.192441 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:19:57.193357 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:19:57.193357 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:19:57.193357 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:19:57.193357 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 630/1265] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:19:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:19:57.198318 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b57e56c-79b4-48d8-90bd-4fd21f295cbb None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:57.277340 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:57.295804 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b57e56c-79b4-48d8-90bd-4fd21f295cbb None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:57.332306 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c5e44-ecb7-4a38-b5bb-5b0ad393e004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:57.332902 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c5e44-ecb7-4a38-b5bb-5b0ad393e004 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:57.333180 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c5e44-ecb7-4a38-b5bb-5b0ad393e004 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:57.333452 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c5e44-ecb7-4a38-b5bb-5b0ad393e004 None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:57.334086 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c5e44-ecb7-4a38-b5bb-5b0ad393e004 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:19:57.334387 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c5e44-ecb7-4a38-b5bb-5b0ad393e004 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:57.335810 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c5e44-ecb7-4a38-b5bb-5b0ad393e004 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:57.347450 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 636/1266] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:19:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:19:57.353075 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39464eb7-eab4-45b6-b215-b1525093aa58 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:57.450401 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39464eb7-eab4-45b6-b215-b1525093aa58 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:57.471324 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:57.485183 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab71344-15ee-4d77-9baf-5abc105715f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:57.485804 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab71344-15ee-4d77-9baf-5abc105715f6 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:57.486079 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab71344-15ee-4d77-9baf-5abc105715f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:57.486348 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab71344-15ee-4d77-9baf-5abc105715f6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:57.493529 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab71344-15ee-4d77-9baf-5abc105715f6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:57.494968 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab71344-15ee-4d77-9baf-5abc105715f6 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:57.505818 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-eab71344-15ee-4d77-9baf-5abc105715f6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 01:19:57.505818 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:19:57.505818 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:19:57.505818 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:19:57.505818 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:19:57.505818 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:19:57.505818 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:19:57.505818 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:19:57.505818 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:19:57.505818 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:19:57.505818 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:19:57.505818 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:19:57.505818 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 01:19:57.505818 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 01:19:57.505818 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 01:19:57.505818 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 01:19:57.506917 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:19:57.506917 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:19:57.506917 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 01:19:57.506917 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:19:57.506917 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 01:19:57.506917 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:19:57.506917 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:19:57.506917 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:19:57.506917 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:19:57.506917 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:19:57.506917 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:19:57.506917 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:19:57.506917 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:19:57.506917 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:19:57.506917 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:19:57.506917 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:19:57.506917 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:19:57.506917 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:19:57.507933 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:19:57.507933 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:19:57.507933 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 01:19:57.507933 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 01:19:57.507933 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 01:19:57.507933 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 01:19:57.507933 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 01:19:57.507933 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 01:19:57.507933 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 01:19:57.507933 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:19:57.507933 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 631/1267] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:19:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:19:57.512915 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c5e44-ecb7-4a38-b5bb-5b0ad393e004 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:57.612025 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c5e44-ecb7-4a38-b5bb-5b0ad393e004 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:57.645965 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4108d45-c238-464b-9c19-52e6f872e39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:57.646564 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4108d45-c238-464b-9c19-52e6f872e39d None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:57.646843 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4108d45-c238-464b-9c19-52e6f872e39d None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:57.647115 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4108d45-c238-464b-9c19-52e6f872e39d None admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:57.647868 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4108d45-c238-464b-9c19-52e6f872e39d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:19:57.648171 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4108d45-c238-464b-9c19-52e6f872e39d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:57.649597 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4108d45-c238-464b-9c19-52e6f872e39d None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:57.658779 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:57.667534 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 637/1268] 10.222.0.60 () {56 vars in 1143 bytes} [Tue Aug 30 01:19:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:19:57.674244 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab71344-15ee-4d77-9baf-5abc105715f6 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:57.776189 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab71344-15ee-4d77-9baf-5abc105715f6 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:57.812841 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc0557-7ab0-40ac-9cba-78b39b4b7b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:57.813866 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc0557-7ab0-40ac-9cba-78b39b4b7b64 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:57.814363 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc0557-7ab0-40ac-9cba-78b39b4b7b64 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:57.814852 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc0557-7ab0-40ac-9cba-78b39b4b7b64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:57.827331 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc0557-7ab0-40ac-9cba-78b39b4b7b64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:57.829025 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc0557-7ab0-40ac-9cba-78b39b4b7b64 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:57.845850 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-6bfc0557-7ab0-40ac-9cba-78b39b4b7b64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:19:57.845850 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:19:57.845850 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:19:57.845850 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:19:57.845850 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:19:57.845850 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:19:57.845850 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:19:57.845850 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:19:57.845850 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:19:57.845850 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:19:57.845850 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:19:57.845850 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:19:57.845850 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:19:57.845850 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:19:57.845850 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:19:57.845850 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:19:57.846870 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:19:57.846870 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:19:57.846870 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:19:57.846870 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:19:57.846870 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:19:57.846870 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:19:57.846870 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:19:57.846870 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:19:57.846870 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:19:57.846870 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:19:57.846870 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:19:57.846870 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:19:57.846870 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:19:57.846870 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:19:57.846870 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:19:57.846870 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:19:57.846870 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:19:57.847817 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:19:57.847817 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:19:57.847817 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:19:57.847817 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 632/1269] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:19:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:19:57.854732 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4108d45-c238-464b-9c19-52e6f872e39d None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:57.958916 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4108d45-c238-464b-9c19-52e6f872e39d None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:57.993771 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d45385-3c2d-4b96-88b9-fd44cf9f7de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:57.994367 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d45385-3c2d-4b96-88b9-fd44cf9f7de4 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:57.994638 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d45385-3c2d-4b96-88b9-fd44cf9f7de4 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:57.994903 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d45385-3c2d-4b96-88b9-fd44cf9f7de4 None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:57.995552 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d45385-3c2d-4b96-88b9-fd44cf9f7de4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:19:57.995852 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d45385-3c2d-4b96-88b9-fd44cf9f7de4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:57.997207 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d45385-3c2d-4b96-88b9-fd44cf9f7de4 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:58.008892 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 638/1270] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:19:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:19:58.015303 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc0557-7ab0-40ac-9cba-78b39b4b7b64 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:58.047283 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:58.115228 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc0557-7ab0-40ac-9cba-78b39b4b7b64 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:58.150541 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b9d5b2-c76a-41d0-8473-7cb4c6d46b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:58.151153 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9d5b2-c76a-41d0-8473-7cb4c6d46b01 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:58.151448 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9d5b2-c76a-41d0-8473-7cb4c6d46b01 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:58.151730 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9d5b2-c76a-41d0-8473-7cb4c6d46b01 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:58.159076 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b9d5b2-c76a-41d0-8473-7cb4c6d46b01 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:58.160545 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b9d5b2-c76a-41d0-8473-7cb4c6d46b01 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:58.174074 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-d5b9d5b2-c76a-41d0-8473-7cb4c6d46b01 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:19:58.174074 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:19:58.174074 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:19:58.174074 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:19:58.174074 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:19:58.174074 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:19:58.174074 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:19:58.174074 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:19:58.174074 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:19:58.174074 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:19:58.174074 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:19:58.174074 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:19:58.174074 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 01:19:58.174074 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 01:19:58.174074 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 01:19:58.175141 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 01:19:58.175141 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:19:58.175141 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:19:58.175141 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:19:58.175141 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:19:58.175141 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:19:58.175141 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:19:58.175141 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:19:58.175141 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:19:58.175141 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:19:58.175141 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:19:58.175141 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:19:58.175141 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:19:58.175141 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:19:58.175141 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:19:58.175141 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:19:58.175141 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:19:58.176707 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 01:19:58.176707 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 01:19:58.176707 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 01:19:58.176707 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 01:19:58.176707 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 01:19:58.176707 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 01:19:58.176707 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:19:58.176707 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:19:58.179799 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 633/1271] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 30 01:19:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:19:58.183384 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d45385-3c2d-4b96-88b9-fd44cf9f7de4 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:58.240616 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:58.282090 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d45385-3c2d-4b96-88b9-fd44cf9f7de4 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:58.315200 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17d5e0-ca5f-4d75-bde7-b8d16c01c0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:58.315771 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17d5e0-ca5f-4d75-bde7-b8d16c01c0fd None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:58.316059 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17d5e0-ca5f-4d75-bde7-b8d16c01c0fd None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:58.316330 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17d5e0-ca5f-4d75-bde7-b8d16c01c0fd None admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:58.317014 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b17d5e0-ca5f-4d75-bde7-b8d16c01c0fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:19:58.317319 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b17d5e0-ca5f-4d75-bde7-b8d16c01c0fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:58.318741 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b17d5e0-ca5f-4d75-bde7-b8d16c01c0fd None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:58.330868 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 639/1272] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 30 01:19:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:19:58.337059 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b9d5b2-c76a-41d0-8473-7cb4c6d46b01 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:19:58.425935 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:58.434661 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b9d5b2-c76a-41d0-8473-7cb4c6d46b01 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:19:58.468027 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea10894-a535-4524-8365-45ebd88562a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:19:58.468668 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea10894-a535-4524-8365-45ebd88562a8 None admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:19:58.468948 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea10894-a535-4524-8365-45ebd88562a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:19:58.469292 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea10894-a535-4524-8365-45ebd88562a8 None admin] PATH_INFO: `/v3/projects/b050b2dad22a4a06875072e44c8c9824/users/e8dbb4742c3944b9ad389e9628b5a047/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:19:58.471106 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea10894-a535-4524-8365-45ebd88562a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=b050b2dad22a4a06875072e44c8c9824, user_id=e8dbb4742c3944b9ad389e9628b5a047, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:19:58.472561 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea10894-a535-4524-8365-45ebd88562a8 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:19:58.484743 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 634/1273] 10.222.0.60 () {58 vars in 1439 bytes} [Tue Aug 30 01:19:58 2022] PUT /identity/v3/projects/b050b2dad22a4a06875072e44c8c9824/users/e8dbb4742c3944b9ad389e9628b5a047/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:20:00.396515 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db934ec-53ba-4fa1-ae91-6c6e70546d23 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:00.397116 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db934ec-53ba-4fa1-ae91-6c6e70546d23 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:00.397116 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db934ec-53ba-4fa1-ae91-6c6e70546d23 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:00.398387 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 640/1274] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:20:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:20:00.403528 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105bd682-e6fa-4c0e-bf56-da1f7dc2b9a5 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:00.403974 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105bd682-e6fa-4c0e-bf56-da1f7dc2b9a5 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:00.404074 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105bd682-e6fa-4c0e-bf56-da1f7dc2b9a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:00.422367 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-105bd682-e6fa-4c0e-bf56-da1f7dc2b9a5 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:00.423584 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-105bd682-e6fa-4c0e-bf56-da1f7dc2b9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:00.488280 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 635/1275] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:20:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:20:00.756415 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db934ec-53ba-4fa1-ae91-6c6e70546d23 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:00.867358 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db934ec-53ba-4fa1-ae91-6c6e70546d23 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:00.885653 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:00.904070 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d7294-0868-4d48-9d20-7647ea47e550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:00.905204 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d7294-0868-4d48-9d20-7647ea47e550 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:00.905521 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d7294-0868-4d48-9d20-7647ea47e550 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:00.905795 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d7294-0868-4d48-9d20-7647ea47e550 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:00.916547 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d7294-0868-4d48-9d20-7647ea47e550 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 01:20:00.926954 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-292d7294-0868-4d48-9d20-7647ea47e550 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:20:00.926954 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:20:00.926954 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:20:00.926954 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:20:00.926954 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:20:00.926954 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:20:00.926954 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:20:00.926954 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:20:00.926954 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:20:00.926954 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:20:00.926954 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:20:00.926954 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:20:00.926954 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 01:20:00.926954 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 01:20:00.926954 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 01:20:00.926954 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 01:20:00.928167 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 01:20:00.928167 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 01:20:00.928167 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 01:20:00.928167 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 01:20:00.928167 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:20:00.928167 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:20:00.928167 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:20:00.928167 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:20:00.928167 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:20:00.928167 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:20:00.928167 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:20:00.928167 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:20:00.928167 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:20:00.928167 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:20:00.928167 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:20:00.928167 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:20:00.929586 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:20:00.929586 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:20:00.929586 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:20:00.929586 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:20:00.929586 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 01:20:00.929586 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 01:20:00.929586 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 01:20:00.929586 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 01:20:00.929586 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 01:20:00.929586 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 01:20:00.929586 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 01:20:00.929586 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:20:00.929586 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 641/1276] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 30 01:20:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:20:00.934967 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105bd682-e6fa-4c0e-bf56-da1f7dc2b9a5 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:01.012471 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:01.030783 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105bd682-e6fa-4c0e-bf56-da1f7dc2b9a5 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:01.063496 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0addb431-26ad-4c76-bb26-197c3ff1c6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:01.064084 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0addb431-26ad-4c76-bb26-197c3ff1c6f2 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:01.064360 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0addb431-26ad-4c76-bb26-197c3ff1c6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:01.064632 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0addb431-26ad-4c76-bb26-197c3ff1c6f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:01.065287 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0addb431-26ad-4c76-bb26-197c3ff1c6f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:20:01.065589 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0addb431-26ad-4c76-bb26-197c3ff1c6f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:01.066965 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0addb431-26ad-4c76-bb26-197c3ff1c6f2 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:01.074727 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 636/1277] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 30 01:20:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:20:01.080526 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d7294-0868-4d48-9d20-7647ea47e550 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:01.177364 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d7294-0868-4d48-9d20-7647ea47e550 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:01.210141 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0dc079-5a03-4408-b5c2-45b36822c9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:01.210758 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0dc079-5a03-4408-b5c2-45b36822c9c7 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:01.211044 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0dc079-5a03-4408-b5c2-45b36822c9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:01.211320 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0dc079-5a03-4408-b5c2-45b36822c9c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:01.221953 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0dc079-5a03-4408-b5c2-45b36822c9c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:01.223398 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0dc079-5a03-4408-b5c2-45b36822c9c7 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:01.237548 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-dc0dc079-5a03-4408-b5c2-45b36822c9c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:20:01.237548 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:20:01.237548 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:20:01.237548 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:20:01.237548 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:20:01.237548 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:20:01.237548 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:20:01.237548 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:20:01.237548 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:20:01.237548 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:20:01.237548 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:20:01.237548 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:20:01.237548 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:20:01.237548 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:20:01.237548 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:20:01.237548 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:20:01.238699 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:20:01.238699 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:20:01.238699 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:20:01.238699 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:20:01.238699 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:20:01.238699 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:20:01.238699 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:20:01.238699 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:20:01.238699 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:20:01.238699 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:20:01.238699 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:20:01.238699 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:20:01.238699 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:20:01.238699 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:20:01.238699 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:20:01.238699 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:20:01.238699 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:20:01.239702 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:20:01.239702 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:20:01.239702 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:20:01.239702 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 642/1278] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:20:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:20:01.244529 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0addb431-26ad-4c76-bb26-197c3ff1c6f2 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:01.341206 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0addb431-26ad-4c76-bb26-197c3ff1c6f2 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:01.373071 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e1734-f59c-4b20-84b2-7330312a2703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:01.373657 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e1734-f59c-4b20-84b2-7330312a2703 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:01.373930 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e1734-f59c-4b20-84b2-7330312a2703 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:01.374196 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e1734-f59c-4b20-84b2-7330312a2703 None admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:01.374816 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421e1734-f59c-4b20-84b2-7330312a2703 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:20:01.375113 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421e1734-f59c-4b20-84b2-7330312a2703 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:01.376577 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421e1734-f59c-4b20-84b2-7330312a2703 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:01.387871 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 637/1279] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:20:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:20:01.394009 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0dc079-5a03-4408-b5c2-45b36822c9c7 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:01.424618 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:01.492264 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0dc079-5a03-4408-b5c2-45b36822c9c7 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:01.526179 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f82f7-96ad-4953-ba85-e722e0f1eec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:01.526794 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f82f7-96ad-4953-ba85-e722e0f1eec1 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:01.527065 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f82f7-96ad-4953-ba85-e722e0f1eec1 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:01.527329 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f82f7-96ad-4953-ba85-e722e0f1eec1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:01.536167 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1f82f7-96ad-4953-ba85-e722e0f1eec1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:01.537605 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1f82f7-96ad-4953-ba85-e722e0f1eec1 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:01.548490 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-0b1f82f7-96ad-4953-ba85-e722e0f1eec1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 01:20:01.548490 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:20:01.548490 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:20:01.548490 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:20:01.548490 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:20:01.548490 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:20:01.548490 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:20:01.548490 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:20:01.548490 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:20:01.548490 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:20:01.548490 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:20:01.548490 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:20:01.548490 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 01:20:01.548490 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 01:20:01.548490 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 01:20:01.548490 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 01:20:01.549688 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:20:01.549688 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:20:01.549688 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 01:20:01.549688 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:20:01.549688 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 01:20:01.549688 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 01:20:01.549688 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:20:01.549688 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:20:01.549688 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:20:01.549688 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:20:01.549688 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:20:01.549688 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:20:01.549688 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:20:01.549688 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:20:01.549688 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:20:01.549688 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:20:01.549688 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:20:01.549688 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:20:01.551069 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:20:01.551069 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:20:01.551069 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 01:20:01.551069 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 01:20:01.551069 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 01:20:01.551069 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 01:20:01.551069 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 01:20:01.551069 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 01:20:01.551069 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 01:20:01.551069 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:20:01.551069 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 643/1280] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:20:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:20:01.555410 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e1734-f59c-4b20-84b2-7330312a2703 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:01.559156 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:01.656140 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e1734-f59c-4b20-84b2-7330312a2703 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:01.689076 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90949005-3d71-4d91-8863-ddcabf706906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:01.689671 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90949005-3d71-4d91-8863-ddcabf706906 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:01.689952 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90949005-3d71-4d91-8863-ddcabf706906 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:01.690225 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90949005-3d71-4d91-8863-ddcabf706906 None admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:01.690942 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90949005-3d71-4d91-8863-ddcabf706906 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:20:01.691247 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90949005-3d71-4d91-8863-ddcabf706906 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:01.692711 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90949005-3d71-4d91-8863-ddcabf706906 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:01.709668 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 638/1281] 10.222.0.60 () {56 vars in 1143 bytes} [Tue Aug 30 01:20:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:20:01.715694 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f82f7-96ad-4953-ba85-e722e0f1eec1 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:01.807131 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:01.817502 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f82f7-96ad-4953-ba85-e722e0f1eec1 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:01.856469 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f38a052-8b5d-41c0-8d5b-54569436dded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:01.857019 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f38a052-8b5d-41c0-8d5b-54569436dded None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:01.857293 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f38a052-8b5d-41c0-8d5b-54569436dded None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:01.857558 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f38a052-8b5d-41c0-8d5b-54569436dded None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:01.928148 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f38a052-8b5d-41c0-8d5b-54569436dded None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:01.929589 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f38a052-8b5d-41c0-8d5b-54569436dded None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:02.015251 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:02.025768 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 644/1282] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 30 01:20:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 01:20:02.031710 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90949005-3d71-4d91-8863-ddcabf706906 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:02.091419 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:02.130617 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90949005-3d71-4d91-8863-ddcabf706906 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:02.168976 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5fb5e2-4505-463a-b94d-0bf3cf450bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:02.169603 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5fb5e2-4505-463a-b94d-0bf3cf450bc7 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:02.169883 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5fb5e2-4505-463a-b94d-0bf3cf450bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:02.170666 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5fb5e2-4505-463a-b94d-0bf3cf450bc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:02.180564 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5fb5e2-4505-463a-b94d-0bf3cf450bc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:02.181999 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5fb5e2-4505-463a-b94d-0bf3cf450bc7 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:02.196903 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-8b5fb5e2-4505-463a-b94d-0bf3cf450bc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:20:02.196903 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:20:02.196903 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:20:02.196903 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:20:02.196903 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:20:02.196903 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:20:02.196903 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:20:02.196903 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:20:02.196903 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:20:02.196903 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:20:02.196903 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:20:02.196903 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:20:02.196903 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 01:20:02.196903 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 01:20:02.196903 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 01:20:02.196903 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 01:20:02.198070 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:20:02.198070 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:20:02.198070 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:20:02.198070 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:20:02.198070 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:20:02.198070 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:20:02.198070 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:20:02.198070 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:20:02.198070 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:20:02.198070 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:20:02.198070 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:20:02.198070 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:20:02.198070 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:20:02.198070 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:20:02.198070 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:20:02.198070 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:20:02.198070 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 01:20:02.199352 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 01:20:02.199352 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 01:20:02.199352 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:20:02.199352 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 639/1283] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:20:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:20:02.204124 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f38a052-8b5d-41c0-8d5b-54569436dded None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:02.300701 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f38a052-8b5d-41c0-8d5b-54569436dded None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:02.333027 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb13d5cf-a08e-4edc-88b5-eb707c874bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:02.333622 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13d5cf-a08e-4edc-88b5-eb707c874bfe None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:02.333902 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13d5cf-a08e-4edc-88b5-eb707c874bfe None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:02.334174 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13d5cf-a08e-4edc-88b5-eb707c874bfe None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:02.334807 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb13d5cf-a08e-4edc-88b5-eb707c874bfe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:20:02.335106 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb13d5cf-a08e-4edc-88b5-eb707c874bfe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:02.336515 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb13d5cf-a08e-4edc-88b5-eb707c874bfe None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:02.348237 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 645/1284] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 30 01:20:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:20:02.353967 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5fb5e2-4505-463a-b94d-0bf3cf450bc7 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:02.451559 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5fb5e2-4505-463a-b94d-0bf3cf450bc7 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:02.464269 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:02.485570 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b58b4-e93f-4f75-8b58-3f97c28254f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:02.486204 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b58b4-e93f-4f75-8b58-3f97c28254f6 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:02.486484 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b58b4-e93f-4f75-8b58-3f97c28254f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:02.486758 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b58b4-e93f-4f75-8b58-3f97c28254f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:02.493296 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7b58b4-e93f-4f75-8b58-3f97c28254f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:02.494715 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7b58b4-e93f-4f75-8b58-3f97c28254f6 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:02.505643 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application [None req-5f7b58b4-e93f-4f75-8b58-3f97c28254f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:20:02.505643 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:20:02.505643 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:20:02.505643 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:20:02.505643 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:20:02.505643 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:20:02.505643 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:20:02.505643 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:20:02.505643 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:20:02.505643 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:20:02.505643 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:20:02.505643 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:20:02.505643 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 01:20:02.505643 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 01:20:02.505643 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 01:20:02.506557 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 01:20:02.506557 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:20:02.506557 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:20:02.506557 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:20:02.506557 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:20:02.506557 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:20:02.506557 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:20:02.506557 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:20:02.506557 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application with Lock( Aug 30 01:20:02.506557 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:20:02.506557 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:20:02.506557 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:20:02.506557 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:20:02.506557 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:20:02.506557 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:20:02.506557 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:20:02.506557 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:20:02.507575 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 01:20:02.507575 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 01:20:02.507575 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 01:20:02.507575 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 01:20:02.507575 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 01:20:02.507575 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 01:20:02.507575 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 01:20:02.507575 dv-cinder-819668-6-smb devstack@keystone.service[81447]: ERROR keystone.server.flask.application Aug 30 01:20:02.507575 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 640/1285] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 30 01:20:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:20:02.512615 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb13d5cf-a08e-4edc-88b5-eb707c874bfe None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:02.560964 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:02.610663 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb13d5cf-a08e-4edc-88b5-eb707c874bfe None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:02.644810 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99bda1e-136e-48de-a81b-ce8cece1416a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:02.645411 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99bda1e-136e-48de-a81b-ce8cece1416a None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:02.645685 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99bda1e-136e-48de-a81b-ce8cece1416a None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:02.645954 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99bda1e-136e-48de-a81b-ce8cece1416a None admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:02.646637 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99bda1e-136e-48de-a81b-ce8cece1416a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:20:02.646939 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99bda1e-136e-48de-a81b-ce8cece1416a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:02.648391 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99bda1e-136e-48de-a81b-ce8cece1416a None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:02.660501 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 646/1286] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 30 01:20:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:20:02.666591 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b58b4-e93f-4f75-8b58-3f97c28254f6 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:02.765274 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b58b4-e93f-4f75-8b58-3f97c28254f6 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:02.798319 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb73c2a-cb7e-4619-be32-676365754c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:02.798911 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb73c2a-cb7e-4619-be32-676365754c99 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:02.799185 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb73c2a-cb7e-4619-be32-676365754c99 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:02.799476 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb73c2a-cb7e-4619-be32-676365754c99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:02.800276 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb73c2a-cb7e-4619-be32-676365754c99 None admin] RBAC: Adding query filter params (role.id=f6bc03b6972e420eb338ee7fd1443974, scope.project.id=b050b2dad22a4a06875072e44c8c9824, user.id=e8dbb4742c3944b9ad389e9628b5a047) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:20:02.800579 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb73c2a-cb7e-4619-be32-676365754c99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:02.801993 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb73c2a-cb7e-4619-be32-676365754c99 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:02.807594 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 641/1287] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 30 01:20:02 2022] GET /identity/v3/role_assignments?user.id=e8dbb4742c3944b9ad389e9628b5a047&scope.project.id=b050b2dad22a4a06875072e44c8c9824&role.id=f6bc03b6972e420eb338ee7fd1443974 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:20:04.730510 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf1528-80dd-4c99-931d-4954bad2dc15 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:04.731032 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf1528-80dd-4c99-931d-4954bad2dc15 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:04.731121 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf1528-80dd-4c99-931d-4954bad2dc15 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:04.732423 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 647/1288] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:20:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:20:04.737441 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76f245-48a5-44f0-8113-cb09c5651065 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:04.737879 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76f245-48a5-44f0-8113-cb09c5651065 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:04.737972 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76f245-48a5-44f0-8113-cb09c5651065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:04.756205 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-fa76f245-48a5-44f0-8113-cb09c5651065 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:04.757416 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-fa76f245-48a5-44f0-8113-cb09c5651065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:04.793008 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:04.831538 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 642/1289] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:20:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:20:05.119192 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf1528-80dd-4c99-931d-4954bad2dc15 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:05.223417 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf1528-80dd-4c99-931d-4954bad2dc15 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:05.235082 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:05.258433 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ec763-9340-4661-86c6-2414ea73d3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:05.259051 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ec763-9340-4661-86c6-2414ea73d3d9 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:05.259332 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ec763-9340-4661-86c6-2414ea73d3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:05.259641 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ec763-9340-4661-86c6-2414ea73d3d9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:05.260219 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ec763-9340-4661-86c6-2414ea73d3d9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:05.261589 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ec763-9340-4661-86c6-2414ea73d3d9 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:05.270288 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-279ec763-9340-4661-86c6-2414ea73d3d9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 01:20:05.270288 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:20:05.270288 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 01:20:05.270288 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 01:20:05.270288 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 01:20:05.270288 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 01:20:05.270288 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 01:20:05.270288 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:20:05.270288 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 01:20:05.270288 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:20:05.270288 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 01:20:05.270288 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:20:05.270288 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:20:05.270288 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:20:05.270288 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:20:05.270288 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:20:05.270288 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:20:05.271646 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:20:05.271646 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:20:05.271646 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:20:05.271646 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:20:05.271646 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:20:05.271646 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:20:05.271646 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 01:20:05.271646 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 01:20:05.271646 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 01:20:05.271646 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 01:20:05.271646 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:20:05.271646 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:20:05.271646 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:20:05.271646 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:20:05.271646 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:20:05.271646 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:20:05.272607 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:20:05.272607 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:20:05.272607 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:20:05.272607 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:20:05.272607 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:20:05.272607 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:20:05.272607 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:20:05.272607 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:20:05.272607 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:20:05.272607 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:20:05.272607 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 01:20:05.272607 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:20:05.272607 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 01:20:05.272607 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:20:05.272607 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 648/1290] 10.222.0.60 () {56 vars in 1117 bytes} [Tue Aug 30 01:20:05 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:20:05.277285 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa76f245-48a5-44f0-8113-cb09c5651065 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:05.374992 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa76f245-48a5-44f0-8113-cb09c5651065 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:05.407905 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a08f43-d017-4ed4-8411-bc78442e3eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:05.408496 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a08f43-d017-4ed4-8411-bc78442e3eef None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:05.408775 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a08f43-d017-4ed4-8411-bc78442e3eef None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:05.409046 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a08f43-d017-4ed4-8411-bc78442e3eef None admin] PATH_INFO: `/v3/services` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:05.409670 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a08f43-d017-4ed4-8411-bc78442e3eef None admin] RBAC: Adding query filter params (name=placement) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:20:05.409970 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a08f43-d017-4ed4-8411-bc78442e3eef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:05.411364 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a08f43-d017-4ed4-8411-bc78442e3eef None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:05.416028 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 643/1291] 10.222.0.60 () {56 vars in 1116 bytes} [Tue Aug 30 01:20:05 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:20:05.422357 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ec763-9340-4661-86c6-2414ea73d3d9 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:05.519085 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ec763-9340-4661-86c6-2414ea73d3d9 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:05.551872 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b31c25-d79b-4573-8a65-a24be5a0846e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:05.552461 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b31c25-d79b-4573-8a65-a24be5a0846e None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:05.552738 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b31c25-d79b-4573-8a65-a24be5a0846e None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:05.553010 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b31c25-d79b-4573-8a65-a24be5a0846e None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:05.553631 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b31c25-d79b-4573-8a65-a24be5a0846e None admin] RBAC: Adding query filter params (type=placement) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:20:05.553929 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b31c25-d79b-4573-8a65-a24be5a0846e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:05.555293 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b31c25-d79b-4573-8a65-a24be5a0846e None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:05.559563 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 649/1292] 10.222.0.60 () {56 vars in 1116 bytes} [Tue Aug 30 01:20:05 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:20:07.433347 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05bcc74-07c4-42b6-a71d-415360c05e0d None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:07.433915 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05bcc74-07c4-42b6-a71d-415360c05e0d None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:07.433915 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05bcc74-07c4-42b6-a71d-415360c05e0d None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:07.435267 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 644/1293] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:20:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:20:07.440341 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f85cb6-6692-4e47-9420-52844d043ba5 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:07.440789 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f85cb6-6692-4e47-9420-52844d043ba5 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:07.440893 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f85cb6-6692-4e47-9420-52844d043ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:07.458940 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-88f85cb6-6692-4e47-9420-52844d043ba5 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:07.460134 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-88f85cb6-6692-4e47-9420-52844d043ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:07.488931 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:07.525062 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 650/1294] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:20:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:20:07.795414 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05bcc74-07c4-42b6-a71d-415360c05e0d None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:07.827049 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:07.908086 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05bcc74-07c4-42b6-a71d-415360c05e0d None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:07.942153 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38111f0-448c-4815-9cc1-d29b8822bd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:07.942748 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38111f0-448c-4815-9cc1-d29b8822bd8c None admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:07.943022 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38111f0-448c-4815-9cc1-d29b8822bd8c None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:07.943288 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38111f0-448c-4815-9cc1-d29b8822bd8c None admin] PATH_INFO: `/v3/services` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:07.943957 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38111f0-448c-4815-9cc1-d29b8822bd8c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:07.945302 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38111f0-448c-4815-9cc1-d29b8822bd8c None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:07.959253 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 645/1295] 10.222.0.60 () {60 vars in 1141 bytes} [Tue Aug 30 01:20:07 2022] POST /identity/v3/services => generated 246 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:20:09.859201 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef4942-295b-459c-88f0-4b74a4d9adc3 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:09.859748 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef4942-295b-459c-88f0-4b74a4d9adc3 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:09.859748 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef4942-295b-459c-88f0-4b74a4d9adc3 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:09.861005 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 651/1296] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:20:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:20:09.866102 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47460656-f559-48fd-a9fb-a3f7a4d58f8e None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:09.866507 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47460656-f559-48fd-a9fb-a3f7a4d58f8e None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:09.866644 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47460656-f559-48fd-a9fb-a3f7a4d58f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:09.884309 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-47460656-f559-48fd-a9fb-a3f7a4d58f8e None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:09.885478 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-47460656-f559-48fd-a9fb-a3f7a4d58f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:09.955161 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 646/1297] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:20:09 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:20:10.221057 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef4942-295b-459c-88f0-4b74a4d9adc3 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:10.324379 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef4942-295b-459c-88f0-4b74a4d9adc3 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:10.359217 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9378df2-7bf0-4eb0-83f2-e30f1ab1e119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:10.359922 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9378df2-7bf0-4eb0-83f2-e30f1ab1e119 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:10.360146 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9378df2-7bf0-4eb0-83f2-e30f1ab1e119 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:10.360416 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9378df2-7bf0-4eb0-83f2-e30f1ab1e119 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:10.360994 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9378df2-7bf0-4eb0-83f2-e30f1ab1e119 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:10.362371 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9378df2-7bf0-4eb0-83f2-e30f1ab1e119 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:10.371002 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-e9378df2-7bf0-4eb0-83f2-e30f1ab1e119 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 01:20:10.371002 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:20:10.371002 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 01:20:10.371002 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 01:20:10.371002 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 01:20:10.371002 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 01:20:10.371002 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 01:20:10.371002 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:20:10.371002 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 01:20:10.371002 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:20:10.371002 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 01:20:10.371002 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:20:10.371002 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:20:10.371002 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:20:10.371002 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:20:10.371002 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:20:10.371002 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:20:10.372237 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:20:10.372237 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:20:10.372237 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:20:10.372237 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:20:10.372237 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:20:10.372237 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:20:10.372237 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 01:20:10.372237 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 01:20:10.372237 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 01:20:10.372237 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 01:20:10.372237 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:20:10.372237 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:20:10.372237 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:20:10.372237 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:20:10.372237 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:20:10.372237 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:20:10.373318 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:20:10.373318 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:20:10.373318 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:20:10.373318 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:20:10.373318 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:20:10.373318 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:20:10.373318 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:20:10.373318 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:20:10.373318 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:20:10.373318 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:20:10.373318 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 01:20:10.373318 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:20:10.373318 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 01:20:10.373318 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:20:10.373318 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 652/1298] 10.222.0.60 () {56 vars in 1117 bytes} [Tue Aug 30 01:20:10 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:20:10.378230 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47460656-f559-48fd-a9fb-a3f7a4d58f8e None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:10.396624 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:10.475888 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47460656-f559-48fd-a9fb-a3f7a4d58f8e None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:10.508883 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0196e8fd-36c6-4c80-838e-c00323869e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:10.509489 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196e8fd-36c6-4c80-838e-c00323869e06 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:10.509764 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196e8fd-36c6-4c80-838e-c00323869e06 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:10.510033 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196e8fd-36c6-4c80-838e-c00323869e06 None admin] PATH_INFO: `/v3/services` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:10.510660 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0196e8fd-36c6-4c80-838e-c00323869e06 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:20:10.510959 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0196e8fd-36c6-4c80-838e-c00323869e06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:10.512346 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0196e8fd-36c6-4c80-838e-c00323869e06 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:10.517866 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 647/1299] 10.222.0.60 () {56 vars in 1116 bytes} [Tue Aug 30 01:20:10 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:20:10.523880 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9378df2-7bf0-4eb0-83f2-e30f1ab1e119 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:10.559124 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:10.629273 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9378df2-7bf0-4eb0-83f2-e30f1ab1e119 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:10.661470 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972738cb-1511-4758-899d-9839f1493463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:10.662062 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972738cb-1511-4758-899d-9839f1493463 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:10.662335 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972738cb-1511-4758-899d-9839f1493463 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:10.662603 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972738cb-1511-4758-899d-9839f1493463 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:10.663289 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972738cb-1511-4758-899d-9839f1493463 None admin] RBAC: Adding query filter params (interface=public, service_id=d93f85877057451c9abce300d39b5b65, region_id=RegionOne) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:20:10.663617 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972738cb-1511-4758-899d-9839f1493463 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:10.664986 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972738cb-1511-4758-899d-9839f1493463 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:10.669790 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 653/1300] 10.222.0.60 () {56 vars in 1251 bytes} [Tue Aug 30 01:20:10 2022] GET /identity/v3/endpoints?service_id=d93f85877057451c9abce300d39b5b65&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:20:10.675574 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0196e8fd-36c6-4c80-838e-c00323869e06 None admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:10.757702 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:10.776004 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0196e8fd-36c6-4c80-838e-c00323869e06 None admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:10.808139 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d928f1-b069-4c73-acb8-56849f417918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:10.808744 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d928f1-b069-4c73-acb8-56849f417918 None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:10.809025 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d928f1-b069-4c73-acb8-56849f417918 None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:10.809300 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d928f1-b069-4c73-acb8-56849f417918 None admin] PATH_INFO: `/v3/services` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:10.809901 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d928f1-b069-4c73-acb8-56849f417918 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:10.811911 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d928f1-b069-4c73-acb8-56849f417918 None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:10.819489 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 648/1301] 10.222.0.60 () {56 vars in 1087 bytes} [Tue Aug 30 01:20:10 2022] GET /identity/v3/services => generated 2191 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:20:12.710458 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb70143-2dc2-4bf6-9e07-abd41df8e919 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:12.710976 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb70143-2dc2-4bf6-9e07-abd41df8e919 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:12.710976 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb70143-2dc2-4bf6-9e07-abd41df8e919 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:12.712335 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 654/1302] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:20:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:20:12.718155 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae0fe75-0378-4fd0-a332-b21ed61f89c0 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:12.718554 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae0fe75-0378-4fd0-a332-b21ed61f89c0 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:12.718706 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae0fe75-0378-4fd0-a332-b21ed61f89c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:12.737108 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-2ae0fe75-0378-4fd0-a332-b21ed61f89c0 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:20:12.738296 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-2ae0fe75-0378-4fd0-a332-b21ed61f89c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:20:12.803706 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 649/1303] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:20:12 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 01:20:13.072757 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb70143-2dc2-4bf6-9e07-abd41df8e919 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:13.165212 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:13.172971 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb70143-2dc2-4bf6-9e07-abd41df8e919 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:13.209115 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f483c52-81af-4dbf-b652-9e454adbe027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:13.211069 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f483c52-81af-4dbf-b652-9e454adbe027 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:13.211381 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f483c52-81af-4dbf-b652-9e454adbe027 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:13.211688 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f483c52-81af-4dbf-b652-9e454adbe027 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:13.212284 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f483c52-81af-4dbf-b652-9e454adbe027 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:13.214413 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f483c52-81af-4dbf-b652-9e454adbe027 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:13.226639 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-9f483c52-81af-4dbf-b652-9e454adbe027 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 01:20:13.226639 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:20:13.226639 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 01:20:13.226639 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 01:20:13.226639 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 01:20:13.226639 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 01:20:13.226639 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 01:20:13.226639 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:20:13.226639 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 01:20:13.226639 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:20:13.226639 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 01:20:13.226639 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:20:13.226639 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 01:20:13.226639 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 01:20:13.226639 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 01:20:13.226639 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 01:20:13.226639 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 01:20:13.227886 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 01:20:13.227886 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 01:20:13.227886 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 01:20:13.227886 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 01:20:13.227886 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 01:20:13.227886 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 01:20:13.227886 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 01:20:13.227886 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 01:20:13.227886 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 01:20:13.227886 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 01:20:13.227886 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 01:20:13.227886 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 01:20:13.227886 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 01:20:13.227886 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 01:20:13.227886 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 01:20:13.227886 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 01:20:13.228909 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 01:20:13.228909 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Aug 30 01:20:13.228909 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 01:20:13.228909 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Aug 30 01:20:13.228909 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 01:20:13.228909 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 01:20:13.228909 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 01:20:13.228909 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Aug 30 01:20:13.228909 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 01:20:13.228909 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Aug 30 01:20:13.228909 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 01:20:13.228909 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 01:20:13.228909 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 01:20:13.228909 dv-cinder-819668-6-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Aug 30 01:20:13.228909 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 655/1304] 10.222.0.60 () {56 vars in 1117 bytes} [Tue Aug 30 01:20:13 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 01:20:13.233967 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae0fe75-0378-4fd0-a332-b21ed61f89c0 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:13.307101 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:13.329875 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae0fe75-0378-4fd0-a332-b21ed61f89c0 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:13.363516 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971011f1-b29c-4aac-b8b6-cc684a95d78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:13.364115 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971011f1-b29c-4aac-b8b6-cc684a95d78e None admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:13.364396 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971011f1-b29c-4aac-b8b6-cc684a95d78e None admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:13.364671 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971011f1-b29c-4aac-b8b6-cc684a95d78e None admin] PATH_INFO: `/v3/services` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:13.365296 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971011f1-b29c-4aac-b8b6-cc684a95d78e None admin] RBAC: Adding query filter params (name=placement) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:20:13.365597 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971011f1-b29c-4aac-b8b6-cc684a95d78e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:13.366968 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971011f1-b29c-4aac-b8b6-cc684a95d78e None admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:13.371951 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 650/1305] 10.222.0.60 () {56 vars in 1116 bytes} [Tue Aug 30 01:20:13 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:20:13.377751 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f483c52-81af-4dbf-b652-9e454adbe027 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:20:13.483455 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f483c52-81af-4dbf-b652-9e454adbe027 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:20:13.517663 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a98d6b-91e2-45bd-aa03-9f2bbf6f3264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:20:13.518256 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a98d6b-91e2-45bd-aa03-9f2bbf6f3264 None admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:20:13.518535 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a98d6b-91e2-45bd-aa03-9f2bbf6f3264 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:20:13.518804 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a98d6b-91e2-45bd-aa03-9f2bbf6f3264 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:20:13.519489 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a98d6b-91e2-45bd-aa03-9f2bbf6f3264 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:20:13.520857 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a98d6b-91e2-45bd-aa03-9f2bbf6f3264 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:20:13.544335 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 656/1306] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:20:13 2022] POST /identity/v3/endpoints => generated 331 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:20:23.372093 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=30 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:23.536526 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:17.223386 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222fe972-3bf8-4e32-9e2b-8daa14186bba None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:17.223973 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222fe972-3bf8-4e32-9e2b-8daa14186bba None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:17.223973 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222fe972-3bf8-4e32-9e2b-8daa14186bba None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:17.225442 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 651/1307] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:21:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:21:17.230837 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49ac48-f960-487c-9d8d-7127202cc547 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:17.231332 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49ac48-f960-487c-9d8d-7127202cc547 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:17.231458 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49ac48-f960-487c-9d8d-7127202cc547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:17.306745 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-3d49ac48-f960-487c-9d8d-7127202cc547 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:21:17.307977 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-3d49ac48-f960-487c-9d8d-7127202cc547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:17.428069 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 657/1308] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:21:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:21:17.715648 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65bf27d-4474-4dc9-82cf-028bf934e187 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:17.716101 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65bf27d-4474-4dc9-82cf-028bf934e187 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:17.716520 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65bf27d-4474-4dc9-82cf-028bf934e187 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:17.718020 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 652/1309] 10.222.0.60 () {54 vars in 965 bytes} [Tue Aug 30 01:21:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:21:17.725923 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0c4cdc-6f29-4411-b7e4-40337d269280 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:17.726382 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0c4cdc-6f29-4411-b7e4-40337d269280 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:17.726795 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0c4cdc-6f29-4411-b7e4-40337d269280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:17.892328 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-6d0c4cdc-6f29-4411-b7e4-40337d269280 None None] MFA Rules not processed for user `61e48e00a0c34949a4fffae8c372304e`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:21:17.896019 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-6d0c4cdc-6f29-4411-b7e4-40337d269280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:17.952998 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:18.051009 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 658/1310] 10.222.0.60 () {58 vars in 1062 bytes} [Tue Aug 30 01:21:17 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:21:18.059841 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65bf27d-4474-4dc9-82cf-028bf934e187 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:18.061694 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-b65bf27d-4474-4dc9-82cf-028bf934e187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:18.188102 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65bf27d-4474-4dc9-82cf-028bf934e187 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:18.287659 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac30d95e-a735-41cc-bc04-80d290a065b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:18.288980 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30d95e-a735-41cc-bc04-80d290a065b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:18.289552 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30d95e-a735-41cc-bc04-80d290a065b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:18.289986 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30d95e-a735-41cc-bc04-80d290a065b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:18.291831 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-ac30d95e-a735-41cc-bc04-80d290a065b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:18.361048 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:18.432716 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac30d95e-a735-41cc-bc04-80d290a065b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:18.434752 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac30d95e-a735-41cc-bc04-80d290a065b8 service neutron] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:18.455721 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 653/1311] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:21:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:21:20.746095 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae05751-35b6-4ffe-9d4c-76aa8e9d7e53 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:20.746702 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae05751-35b6-4ffe-9d4c-76aa8e9d7e53 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:20.746702 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae05751-35b6-4ffe-9d4c-76aa8e9d7e53 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:20.748125 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 659/1312] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:21:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:21:20.754389 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9692485-16db-4304-9a29-758d392eba6c None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:20.754939 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9692485-16db-4304-9a29-758d392eba6c None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:20.754939 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9692485-16db-4304-9a29-758d392eba6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:20.845277 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-d9692485-16db-4304-9a29-758d392eba6c None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:21:20.846498 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-d9692485-16db-4304-9a29-758d392eba6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:20.943491 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 654/1313] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:21:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:21:21.233716 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae05751-35b6-4ffe-9d4c-76aa8e9d7e53 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:21.235230 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-fae05751-35b6-4ffe-9d4c-76aa8e9d7e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:21.340484 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae05751-35b6-4ffe-9d4c-76aa8e9d7e53 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:21.409747 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:21.412369 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d912772-5d05-41bf-b7ee-91c4beb731a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:21.412983 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d912772-5d05-41bf-b7ee-91c4beb731a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:21.413455 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d912772-5d05-41bf-b7ee-91c4beb731a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:21.413896 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d912772-5d05-41bf-b7ee-91c4beb731a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:21.415762 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-9d912772-5d05-41bf-b7ee-91c4beb731a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:21.521926 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d912772-5d05-41bf-b7ee-91c4beb731a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:21.523354 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d912772-5d05-41bf-b7ee-91c4beb731a6 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:21.540713 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 660/1314] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:21:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:21:23.753153 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d7f6c5-5819-47f5-a0fc-07a8f063aa06 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:23.753718 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d7f6c5-5819-47f5-a0fc-07a8f063aa06 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:23.753718 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d7f6c5-5819-47f5-a0fc-07a8f063aa06 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:23.755030 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 655/1315] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:21:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:21:23.760261 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf511f0-d155-4d30-9f34-c7ff524651ee None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:23.760642 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf511f0-d155-4d30-9f34-c7ff524651ee None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:23.760813 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf511f0-d155-4d30-9f34-c7ff524651ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:23.826118 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-ddf511f0-d155-4d30-9f34-c7ff524651ee None None] MFA Rules not processed for user `40d2c2b96e7d483aba514a9499f4459d`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:21:23.827327 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-ddf511f0-d155-4d30-9f34-c7ff524651ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:23.879125 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:23.922569 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 661/1316] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:21:23 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:21:24.217575 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f8904-2d7a-4cdd-8ccb-33c99b2043dd None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:24.217849 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f8904-2d7a-4cdd-8ccb-33c99b2043dd None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:24.218121 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f8904-2d7a-4cdd-8ccb-33c99b2043dd None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:24.219513 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 656/1317] 10.222.0.60 () {54 vars in 965 bytes} [Tue Aug 30 01:21:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:21:24.225472 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275401f8-8a91-45d1-a4af-fee46c7d13f7 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:24.225766 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275401f8-8a91-45d1-a4af-fee46c7d13f7 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:24.226068 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275401f8-8a91-45d1-a4af-fee46c7d13f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:24.300715 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-275401f8-8a91-45d1-a4af-fee46c7d13f7 None None] MFA Rules not processed for user `61e48e00a0c34949a4fffae8c372304e`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:21:24.301917 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-275401f8-8a91-45d1-a4af-fee46c7d13f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:24.377483 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 662/1318] 10.222.0.60 () {58 vars in 1062 bytes} [Tue Aug 30 01:21:24 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:21:24.386379 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f8904-2d7a-4cdd-8ccb-33c99b2043dd None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:24.388483 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-e79f8904-2d7a-4cdd-8ccb-33c99b2043dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:24.398037 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:24.491455 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f8904-2d7a-4cdd-8ccb-33c99b2043dd None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:24.563546 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d717d-cc4c-4b28-9e7c-5811ce9f3afd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:24.564152 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d717d-cc4c-4b28-9e7c-5811ce9f3afd service neutron] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:24.564432 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d717d-cc4c-4b28-9e7c-5811ce9f3afd service neutron] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:24.564706 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d717d-cc4c-4b28-9e7c-5811ce9f3afd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:24.566299 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-716d717d-cc4c-4b28-9e7c-5811ce9f3afd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:24.630401 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:24.677658 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d717d-cc4c-4b28-9e7c-5811ce9f3afd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:24.678734 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d717d-cc4c-4b28-9e7c-5811ce9f3afd service neutron] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:24.697174 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 657/1319] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:21:24 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:21:27.541613 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbba2d3-edad-46ee-953a-c0c9c65b2757 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:27.542255 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbba2d3-edad-46ee-953a-c0c9c65b2757 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:27.542255 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbba2d3-edad-46ee-953a-c0c9c65b2757 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:27.544053 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 663/1320] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:21:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:21:27.549243 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef9a04-9dec-46b4-88d2-198595341f2d None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:27.549618 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef9a04-9dec-46b4-88d2-198595341f2d None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:27.549797 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef9a04-9dec-46b4-88d2-198595341f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:27.615813 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-e0ef9a04-9dec-46b4-88d2-198595341f2d None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:21:27.617025 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-e0ef9a04-9dec-46b4-88d2-198595341f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:27.711929 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 658/1321] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:21:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:21:27.994125 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbba2d3-edad-46ee-953a-c0c9c65b2757 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:27.995674 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-5cbba2d3-edad-46ee-953a-c0c9c65b2757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:28.045528 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:28.099194 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbba2d3-edad-46ee-953a-c0c9c65b2757 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:28.170365 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483db722-b362-42aa-8989-34aa291348e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:28.170970 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483db722-b362-42aa-8989-34aa291348e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:28.171246 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483db722-b362-42aa-8989-34aa291348e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:28.171541 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483db722-b362-42aa-8989-34aa291348e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:28.173134 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-483db722-b362-42aa-8989-34aa291348e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:28.267023 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:28.280219 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483db722-b362-42aa-8989-34aa291348e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:28.281657 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483db722-b362-42aa-8989-34aa291348e9 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:28.299538 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 664/1322] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:21:27 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:21:30.917313 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d9cb2-4aaf-4268-8bcf-fde6d968b0ba None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:30.918485 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d9cb2-4aaf-4268-8bcf-fde6d968b0ba None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:30.918485 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d9cb2-4aaf-4268-8bcf-fde6d968b0ba None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:30.919812 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 659/1323] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:21:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:21:30.924875 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b0bb2-61d9-4fb9-b1a9-f8f40ee43157 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:30.925263 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b0bb2-61d9-4fb9-b1a9-f8f40ee43157 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:30.925435 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b0bb2-61d9-4fb9-b1a9-f8f40ee43157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:30.991716 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-393b0bb2-61d9-4fb9-b1a9-f8f40ee43157 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:21:30.992917 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-393b0bb2-61d9-4fb9-b1a9-f8f40ee43157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:31.087740 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 665/1324] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:21:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:21:31.372583 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d9cb2-4aaf-4268-8bcf-fde6d968b0ba None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:31.374113 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-f40d9cb2-4aaf-4268-8bcf-fde6d968b0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:31.394377 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:31.488660 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d9cb2-4aaf-4268-8bcf-fde6d968b0ba None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:31.562433 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56061f57-298b-4394-832e-5f9aad10b865 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:31.562942 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56061f57-298b-4394-832e-5f9aad10b865 service neutron] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:31.563219 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56061f57-298b-4394-832e-5f9aad10b865 service neutron] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:31.563517 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56061f57-298b-4394-832e-5f9aad10b865 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:31.565120 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-56061f57-298b-4394-832e-5f9aad10b865 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:31.641206 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:31.679979 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56061f57-298b-4394-832e-5f9aad10b865 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:31.681426 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56061f57-298b-4394-832e-5f9aad10b865 service neutron] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:31.700885 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 660/1325] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:21:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:21:33.662928 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac038b14-20f5-4f45-b0f4-c026d2e2f7df None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:33.663512 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac038b14-20f5-4f45-b0f4-c026d2e2f7df None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:33.663512 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac038b14-20f5-4f45-b0f4-c026d2e2f7df None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:33.664724 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 666/1326] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:21:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:21:33.670204 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3664ea-ffee-4c3b-bddc-1bdc4fd05d28 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:33.670641 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3664ea-ffee-4c3b-bddc-1bdc4fd05d28 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:33.670760 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3664ea-ffee-4c3b-bddc-1bdc4fd05d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:33.737124 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-7e3664ea-ffee-4c3b-bddc-1bdc4fd05d28 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:21:33.738333 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-7e3664ea-ffee-4c3b-bddc-1bdc4fd05d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:33.835031 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 661/1327] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:21:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:21:34.120456 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac038b14-20f5-4f45-b0f4-c026d2e2f7df None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:34.122535 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-ac038b14-20f5-4f45-b0f4-c026d2e2f7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:34.192316 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:34.239530 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac038b14-20f5-4f45-b0f4-c026d2e2f7df None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:34.315585 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9491970c-4b05-4c5e-bf47-954f9bb66b02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:34.316190 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9491970c-4b05-4c5e-bf47-954f9bb66b02 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:34.316465 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9491970c-4b05-4c5e-bf47-954f9bb66b02 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:34.316729 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9491970c-4b05-4c5e-bf47-954f9bb66b02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:34.318304 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-9491970c-4b05-4c5e-bf47-954f9bb66b02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:34.426422 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:34.429222 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9491970c-4b05-4c5e-bf47-954f9bb66b02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:34.431042 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9491970c-4b05-4c5e-bf47-954f9bb66b02 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:34.449910 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 667/1328] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:21:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:21:36.444271 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1eddd-39bb-4aff-8d31-f1b7c34945a1 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:36.444862 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1eddd-39bb-4aff-8d31-f1b7c34945a1 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:36.444862 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1eddd-39bb-4aff-8d31-f1b7c34945a1 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:36.446194 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 662/1329] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:21:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:21:36.452786 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6f518-9cd7-43ff-aeb8-db8b276bc776 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:36.453331 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6f518-9cd7-43ff-aeb8-db8b276bc776 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:36.453331 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6f518-9cd7-43ff-aeb8-db8b276bc776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:36.519224 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-95e6f518-9cd7-43ff-aeb8-db8b276bc776 None None] MFA Rules not processed for user `40d2c2b96e7d483aba514a9499f4459d`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:21:36.520460 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-95e6f518-9cd7-43ff-aeb8-db8b276bc776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:36.626022 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 668/1330] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:21:36 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:21:36.910777 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1eddd-39bb-4aff-8d31-f1b7c34945a1 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:36.912348 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-22f1eddd-39bb-4aff-8d31-f1b7c34945a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:36.948314 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:37.021459 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1eddd-39bb-4aff-8d31-f1b7c34945a1 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:37.095552 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e4fa08-0dbf-4c8d-b39f-3fdbe01d5184 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:37.096085 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e4fa08-0dbf-4c8d-b39f-3fdbe01d5184 service neutron] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:37.096364 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e4fa08-0dbf-4c8d-b39f-3fdbe01d5184 service neutron] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:37.096635 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e4fa08-0dbf-4c8d-b39f-3fdbe01d5184 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:37.098236 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-e4e4fa08-0dbf-4c8d-b39f-3fdbe01d5184 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:37.178042 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:37.212651 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e4fa08-0dbf-4c8d-b39f-3fdbe01d5184 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:37.214098 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e4fa08-0dbf-4c8d-b39f-3fdbe01d5184 service neutron] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:37.234405 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 663/1331] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:21:36 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:21:39.382481 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8a5c3-241e-4d88-969e-ac7c418c6472 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:39.383000 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8a5c3-241e-4d88-969e-ac7c418c6472 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:39.383000 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8a5c3-241e-4d88-969e-ac7c418c6472 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:39.384378 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 669/1332] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:21:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:21:39.390637 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd5d645-c447-4116-8d39-0c3b3e39aa00 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:39.391072 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd5d645-c447-4116-8d39-0c3b3e39aa00 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:39.391179 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd5d645-c447-4116-8d39-0c3b3e39aa00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:39.456383 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-fcd5d645-c447-4116-8d39-0c3b3e39aa00 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:21:39.457606 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-fcd5d645-c447-4116-8d39-0c3b3e39aa00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:39.551548 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 664/1333] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:21:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:21:39.834903 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c8a5c3-241e-4d88-969e-ac7c418c6472 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:39.836495 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-73c8a5c3-241e-4d88-969e-ac7c418c6472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:39.905401 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:39.941602 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c8a5c3-241e-4d88-969e-ac7c418c6472 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:40.014839 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a62912-bba3-4db1-89ab-afd8ccb971d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:40.015455 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a62912-bba3-4db1-89ab-afd8ccb971d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:40.015743 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a62912-bba3-4db1-89ab-afd8ccb971d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:40.016012 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a62912-bba3-4db1-89ab-afd8ccb971d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:40.017580 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-a0a62912-bba3-4db1-89ab-afd8ccb971d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:40.125437 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a62912-bba3-4db1-89ab-afd8ccb971d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:40.126810 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a62912-bba3-4db1-89ab-afd8ccb971d4 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:40.137176 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:40.145519 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 670/1334] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:21:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:21:42.162797 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8b221-e552-481f-8c17-c1e2cb11b691 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:42.163340 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8b221-e552-481f-8c17-c1e2cb11b691 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:42.163340 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8b221-e552-481f-8c17-c1e2cb11b691 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:42.164733 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 665/1335] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:21:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:21:42.170533 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480526a-204f-4f4c-b623-a53b650d7df3 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:42.170972 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480526a-204f-4f4c-b623-a53b650d7df3 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:42.171077 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480526a-204f-4f4c-b623-a53b650d7df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:42.235760 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-7480526a-204f-4f4c-b623-a53b650d7df3 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:21:42.236949 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-7480526a-204f-4f4c-b623-a53b650d7df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:42.329364 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 671/1336] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:21:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:21:42.612748 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a8b221-e552-481f-8c17-c1e2cb11b691 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:42.614281 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-f7a8b221-e552-481f-8c17-c1e2cb11b691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:42.654386 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:42.718893 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a8b221-e552-481f-8c17-c1e2cb11b691 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:42.795057 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6628cff9-610b-499f-9893-92bb34bf22a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:42.795687 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628cff9-610b-499f-9893-92bb34bf22a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:42.795968 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628cff9-610b-499f-9893-92bb34bf22a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:42.796238 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628cff9-610b-499f-9893-92bb34bf22a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:42.797847 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-6628cff9-610b-499f-9893-92bb34bf22a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:42.887542 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:42.914469 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6628cff9-610b-499f-9893-92bb34bf22a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:42.915955 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6628cff9-610b-499f-9893-92bb34bf22a6 service neutron] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:42.935332 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 666/1337] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:21:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:21:45.156572 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c6451-cd43-4e3f-a65a-7f76cc2dd49b None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:45.157079 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c6451-cd43-4e3f-a65a-7f76cc2dd49b None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:45.157178 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c6451-cd43-4e3f-a65a-7f76cc2dd49b None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:45.158446 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 672/1338] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:21:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:21:45.163668 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf5cce4-6a8e-4aed-9f1f-da0ed3f8ac32 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:45.164087 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf5cce4-6a8e-4aed-9f1f-da0ed3f8ac32 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:45.164214 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf5cce4-6a8e-4aed-9f1f-da0ed3f8ac32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:45.228936 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-faf5cce4-6a8e-4aed-9f1f-da0ed3f8ac32 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:21:45.230817 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-faf5cce4-6a8e-4aed-9f1f-da0ed3f8ac32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:45.326216 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 667/1339] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:21:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:21:45.609869 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c6451-cd43-4e3f-a65a-7f76cc2dd49b None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:45.611388 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-755c6451-cd43-4e3f-a65a-7f76cc2dd49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:45.686297 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:45.713949 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c6451-cd43-4e3f-a65a-7f76cc2dd49b None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:45.786466 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ef63d4-0244-42f1-80eb-191aa76169ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:45.787066 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef63d4-0244-42f1-80eb-191aa76169ac service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:45.787348 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef63d4-0244-42f1-80eb-191aa76169ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:45.787651 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef63d4-0244-42f1-80eb-191aa76169ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:45.789238 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-57ef63d4-0244-42f1-80eb-191aa76169ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:45.910808 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ef63d4-0244-42f1-80eb-191aa76169ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:45.912288 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ef63d4-0244-42f1-80eb-191aa76169ac service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:45.929965 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 673/1340] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:21:45 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:21:49.770550 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c742fc4-4191-4298-b518-87fb4a9ccc23 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:49.771198 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c742fc4-4191-4298-b518-87fb4a9ccc23 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:49.771198 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c742fc4-4191-4298-b518-87fb4a9ccc23 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:49.772519 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 668/1341] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:21:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:21:49.777680 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde14452-142b-4aee-b9d4-52044cddaf3d None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:49.778114 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde14452-142b-4aee-b9d4-52044cddaf3d None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:49.778270 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde14452-142b-4aee-b9d4-52044cddaf3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:49.783726 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:49.847317 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-dde14452-142b-4aee-b9d4-52044cddaf3d None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:21:49.848586 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-dde14452-142b-4aee-b9d4-52044cddaf3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:49.945490 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 674/1342] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:21:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:21:50.225708 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c742fc4-4191-4298-b518-87fb4a9ccc23 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:50.227236 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-5c742fc4-4191-4298-b518-87fb4a9ccc23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:50.282688 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:50.337486 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c742fc4-4191-4298-b518-87fb4a9ccc23 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:50.410783 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848040ab-d426-4f3b-ac68-2446bd507125 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:50.411394 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848040ab-d426-4f3b-ac68-2446bd507125 service neutron] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:50.411702 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848040ab-d426-4f3b-ac68-2446bd507125 service neutron] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:50.411971 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848040ab-d426-4f3b-ac68-2446bd507125 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:50.413559 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-848040ab-d426-4f3b-ac68-2446bd507125 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:50.507486 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:50.524281 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848040ab-d426-4f3b-ac68-2446bd507125 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:50.525710 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848040ab-d426-4f3b-ac68-2446bd507125 service neutron] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:50.545368 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 669/1343] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:21:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:21:53.116969 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7648bc8-f79f-46a5-9a4a-99c97dd5c855 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:53.117573 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7648bc8-f79f-46a5-9a4a-99c97dd5c855 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:53.117573 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7648bc8-f79f-46a5-9a4a-99c97dd5c855 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:53.118873 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 675/1344] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:21:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:21:53.125229 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0fa88-563f-457d-98b6-459d26dc8123 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:53.125801 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0fa88-563f-457d-98b6-459d26dc8123 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:53.125801 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0fa88-563f-457d-98b6-459d26dc8123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:53.195071 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-e8c0fa88-563f-457d-98b6-459d26dc8123 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:21:53.196555 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-e8c0fa88-563f-457d-98b6-459d26dc8123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:53.293531 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 670/1345] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:21:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:21:53.579169 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7648bc8-f79f-46a5-9a4a-99c97dd5c855 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:53.580802 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-e7648bc8-f79f-46a5-9a4a-99c97dd5c855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:53.669917 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:53.688213 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7648bc8-f79f-46a5-9a4a-99c97dd5c855 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:53.764870 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5ff299-87ab-4ff7-8aa2-f7f6ddcd28c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:53.765494 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ff299-87ab-4ff7-8aa2-f7f6ddcd28c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:53.765774 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ff299-87ab-4ff7-8aa2-f7f6ddcd28c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:53.766044 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ff299-87ab-4ff7-8aa2-f7f6ddcd28c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:53.767773 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-0c5ff299-87ab-4ff7-8aa2-f7f6ddcd28c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:53.886985 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5ff299-87ab-4ff7-8aa2-f7f6ddcd28c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:53.888790 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5ff299-87ab-4ff7-8aa2-f7f6ddcd28c8 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:53.907599 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 676/1346] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:21:53 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:21:57.824955 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52adda-3eb6-4f3a-8e93-b09ed671a76b None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:57.825997 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52adda-3eb6-4f3a-8e93-b09ed671a76b None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:57.825997 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52adda-3eb6-4f3a-8e93-b09ed671a76b None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:57.826822 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 671/1347] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:21:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:21:57.832211 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d75162-f8ca-42ac-87a9-2916ca0b543c None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:57.832666 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d75162-f8ca-42ac-87a9-2916ca0b543c None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:57.832762 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d75162-f8ca-42ac-87a9-2916ca0b543c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:57.851377 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:57.909958 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-93d75162-f8ca-42ac-87a9-2916ca0b543c None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:21:57.911206 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-93d75162-f8ca-42ac-87a9-2916ca0b543c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:58.023797 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 677/1348] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:21:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:21:58.309415 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f52adda-3eb6-4f3a-8e93-b09ed671a76b None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:21:58.311073 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-7f52adda-3eb6-4f3a-8e93-b09ed671a76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:58.370282 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:58.424593 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f52adda-3eb6-4f3a-8e93-b09ed671a76b None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:21:58.500119 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f6c53-268c-4b78-8e10-5146a00f5ef2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:21:58.500723 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f6c53-268c-4b78-8e10-5146a00f5ef2 service neutron] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:21:58.500999 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f6c53-268c-4b78-8e10-5146a00f5ef2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:21:58.501267 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f6c53-268c-4b78-8e10-5146a00f5ef2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:21:58.502843 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-fc9f6c53-268c-4b78-8e10-5146a00f5ef2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:21:58.607757 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:58.611931 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9f6c53-268c-4b78-8e10-5146a00f5ef2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:21:58.613363 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9f6c53-268c-4b78-8e10-5146a00f5ef2 service neutron] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:21:58.631341 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 672/1349] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:21:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:22:03.566175 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba104d1a-01f9-46d3-a83c-9e9a9e15ea02 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:03.568719 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba104d1a-01f9-46d3-a83c-9e9a9e15ea02 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:03.568719 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba104d1a-01f9-46d3-a83c-9e9a9e15ea02 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:03.568719 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 678/1350] 10.222.0.60 () {54 vars in 921 bytes} [Tue Aug 30 01:22:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:22:03.579110 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f32e0f-5d71-4c52-8b99-4037ab672944 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:03.579110 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f32e0f-5d71-4c52-8b99-4037ab672944 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:03.579110 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f32e0f-5d71-4c52-8b99-4037ab672944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:03.671757 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-82f32e0f-5d71-4c52-8b99-4037ab672944 None None] MFA Rules not processed for user `e8dbb4742c3944b9ad389e9628b5a047`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:22:03.672881 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-82f32e0f-5d71-4c52-8b99-4037ab672944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:03.824300 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 673/1351] 10.222.0.60 () {58 vars in 1018 bytes} [Tue Aug 30 01:22:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:22:07.996496 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d67b64-9e16-4083-8c95-2e8a9fdff69d None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:07.997431 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d67b64-9e16-4083-8c95-2e8a9fdff69d None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:07.997859 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d67b64-9e16-4083-8c95-2e8a9fdff69d None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:07.999295 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 679/1352] 10.222.0.60 () {54 vars in 921 bytes} [Tue Aug 30 01:22:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:22:08.005391 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ed745-f9c8-4460-b9f2-9a1c49817b1a None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:08.005931 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ed745-f9c8-4460-b9f2-9a1c49817b1a None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:08.006600 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ed745-f9c8-4460-b9f2-9a1c49817b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:08.023987 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=59 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:08.070860 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:08.097469 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-a50ed745-f9c8-4460-b9f2-9a1c49817b1a None None] MFA Rules not processed for user `e8dbb4742c3944b9ad389e9628b5a047`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:22:08.098895 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-a50ed745-f9c8-4460-b9f2-9a1c49817b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:08.211251 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 674/1353] 10.222.0.60 () {58 vars in 1018 bytes} [Tue Aug 30 01:22:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:22:09.628778 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db978a83-13a4-440a-80a6-cb7e3e03f260 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:09.629304 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db978a83-13a4-440a-80a6-cb7e3e03f260 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:09.629304 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db978a83-13a4-440a-80a6-cb7e3e03f260 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:09.630594 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 680/1354] 10.222.0.60 () {54 vars in 921 bytes} [Tue Aug 30 01:22:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:22:09.635833 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8732f32-f013-4a81-a104-d44a3c331fc4 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:09.636239 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8732f32-f013-4a81-a104-d44a3c331fc4 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:09.636391 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8732f32-f013-4a81-a104-d44a3c331fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:09.712122 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-d8732f32-f013-4a81-a104-d44a3c331fc4 None None] MFA Rules not processed for user `e8dbb4742c3944b9ad389e9628b5a047`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:22:09.713317 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-d8732f32-f013-4a81-a104-d44a3c331fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:09.757185 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:09.825190 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 675/1355] 10.222.0.60 () {58 vars in 1018 bytes} [Tue Aug 30 01:22:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:22:13.175580 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba12990-4456-4f2f-a2a0-be6381f6e8c3 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:13.175580 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba12990-4456-4f2f-a2a0-be6381f6e8c3 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:13.176128 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba12990-4456-4f2f-a2a0-be6381f6e8c3 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:13.177333 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 681/1356] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:22:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:22:13.186547 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f960ff-3e12-45df-8066-98b4ce0ac6b9 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:13.186935 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f960ff-3e12-45df-8066-98b4ce0ac6b9 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:13.187115 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f960ff-3e12-45df-8066-98b4ce0ac6b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:13.275700 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-47f960ff-3e12-45df-8066-98b4ce0ac6b9 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:22:13.277975 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-47f960ff-3e12-45df-8066-98b4ce0ac6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:13.393603 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 676/1357] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:22:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:22:13.703324 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0321c8ad-6e9a-418b-980e-cc63216c37c0 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:13.703896 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0321c8ad-6e9a-418b-980e-cc63216c37c0 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:13.704387 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0321c8ad-6e9a-418b-980e-cc63216c37c0 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:13.706232 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 682/1358] 10.222.0.60 () {54 vars in 962 bytes} [Tue Aug 30 01:22:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:22:13.715872 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf24c0-00e1-4794-bf78-c2fc757d9728 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:13.716248 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf24c0-00e1-4794-bf78-c2fc757d9728 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:13.716596 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf24c0-00e1-4794-bf78-c2fc757d9728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:13.741815 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:13.817867 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-2daf24c0-00e1-4794-bf78-c2fc757d9728 None None] MFA Rules not processed for user `8889145228a24fb6bd539a11925e62f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:22:13.819192 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-2daf24c0-00e1-4794-bf78-c2fc757d9728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:13.957696 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 677/1359] 10.222.0.60 () {58 vars in 1059 bytes} [Tue Aug 30 01:22:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:22:13.966959 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0321c8ad-6e9a-418b-980e-cc63216c37c0 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:22:13.968484 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-0321c8ad-6e9a-418b-980e-cc63216c37c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:14.123947 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0321c8ad-6e9a-418b-980e-cc63216c37c0 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:22:14.204681 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:14.248798 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493707a1-cab2-452e-9c46-4655e7365e03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8889145228a24fb6bd539a11925e62f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:22:14.249309 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493707a1-cab2-452e-9c46-4655e7365e03 service nova] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:14.249584 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493707a1-cab2-452e-9c46-4655e7365e03 service nova] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:14.249850 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493707a1-cab2-452e-9c46-4655e7365e03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:14.251412 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-493707a1-cab2-452e-9c46-4655e7365e03 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:14.343970 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493707a1-cab2-452e-9c46-4655e7365e03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:22:14.345540 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493707a1-cab2-452e-9c46-4655e7365e03 service nova] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:22:14.369493 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 683/1360] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:22:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:22:16.518987 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8511eb4-062a-4e21-80f4-44c032cb8a9c None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:16.519541 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8511eb4-062a-4e21-80f4-44c032cb8a9c None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:16.519541 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8511eb4-062a-4e21-80f4-44c032cb8a9c None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:16.521015 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 678/1361] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:22:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:22:16.526020 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008fdca-fc5c-46ae-a711-b417884c3120 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:16.526967 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008fdca-fc5c-46ae-a711-b417884c3120 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:16.527453 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008fdca-fc5c-46ae-a711-b417884c3120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:16.599195 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-e008fdca-fc5c-46ae-a711-b417884c3120 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:22:16.599195 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-e008fdca-fc5c-46ae-a711-b417884c3120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:16.640317 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:16.711276 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 684/1362] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:22:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:22:17.012569 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8511eb4-062a-4e21-80f4-44c032cb8a9c None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:22:17.014302 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-b8511eb4-062a-4e21-80f4-44c032cb8a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:17.091325 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:17.179800 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8511eb4-062a-4e21-80f4-44c032cb8a9c None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:22:17.301262 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f81b99f-cbdc-4dad-a147-df909ebe0b6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8889145228a24fb6bd539a11925e62f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:22:17.301870 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81b99f-cbdc-4dad-a147-df909ebe0b6a service nova] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:17.302145 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81b99f-cbdc-4dad-a147-df909ebe0b6a service nova] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:17.302421 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81b99f-cbdc-4dad-a147-df909ebe0b6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:17.304145 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-1f81b99f-cbdc-4dad-a147-df909ebe0b6a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:17.336667 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:17.413644 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f81b99f-cbdc-4dad-a147-df909ebe0b6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:22:17.415245 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f81b99f-cbdc-4dad-a147-df909ebe0b6a service nova] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:22:17.436398 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 679/1363] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:22:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:22:19.693632 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d6751-7360-49e4-ba74-300dec038078 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:19.694154 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d6751-7360-49e4-ba74-300dec038078 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:19.694154 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d6751-7360-49e4-ba74-300dec038078 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:19.696152 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 685/1364] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:22:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:22:19.701348 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a423d-f791-4187-9042-b26b34451598 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:19.701809 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a423d-f791-4187-9042-b26b34451598 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:19.701927 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a423d-f791-4187-9042-b26b34451598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:19.769867 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-013a423d-f791-4187-9042-b26b34451598 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:22:19.771078 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-013a423d-f791-4187-9042-b26b34451598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:19.873582 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:19.884165 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 680/1365] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:22:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:22:20.168458 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39616257-35c5-4541-829c-ee5a089ab7e6 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:20.168794 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39616257-35c5-4541-829c-ee5a089ab7e6 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:20.169104 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39616257-35c5-4541-829c-ee5a089ab7e6 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:20.170487 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 686/1366] 10.222.0.60 () {54 vars in 962 bytes} [Tue Aug 30 01:22:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:22:20.176783 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06cb260-aaf9-4949-923f-e1b959e07d23 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:20.177333 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06cb260-aaf9-4949-923f-e1b959e07d23 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:20.177800 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06cb260-aaf9-4949-923f-e1b959e07d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:20.259014 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-a06cb260-aaf9-4949-923f-e1b959e07d23 None None] MFA Rules not processed for user `8889145228a24fb6bd539a11925e62f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:22:20.260969 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-a06cb260-aaf9-4949-923f-e1b959e07d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:20.508561 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 681/1367] 10.222.0.60 () {58 vars in 1059 bytes} [Tue Aug 30 01:22:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:22:20.517392 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39616257-35c5-4541-829c-ee5a089ab7e6 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:22:20.519229 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-39616257-35c5-4541-829c-ee5a089ab7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:20.689483 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39616257-35c5-4541-829c-ee5a089ab7e6 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:22:20.710560 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:20.812593 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff1411-f4fc-4b96-b3ef-a8c83c4e55c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8889145228a24fb6bd539a11925e62f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:22:20.813129 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff1411-f4fc-4b96-b3ef-a8c83c4e55c6 service nova] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:20.813396 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff1411-f4fc-4b96-b3ef-a8c83c4e55c6 service nova] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:20.813666 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff1411-f4fc-4b96-b3ef-a8c83c4e55c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:20.815244 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-69ff1411-f4fc-4b96-b3ef-a8c83c4e55c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:20.912106 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ff1411-f4fc-4b96-b3ef-a8c83c4e55c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:22:20.914241 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ff1411-f4fc-4b96-b3ef-a8c83c4e55c6 service nova] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:22:20.937142 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 687/1368] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:22:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:22:21.390265 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c075a-b546-40ea-99de-8915298a21ff None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:21.390814 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c075a-b546-40ea-99de-8915298a21ff None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:21.390814 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c075a-b546-40ea-99de-8915298a21ff None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:21.392307 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 682/1369] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:22:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:22:21.397422 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faaf527-d474-45ad-933b-20d10fdf4447 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:21.397719 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faaf527-d474-45ad-933b-20d10fdf4447 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:21.397982 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faaf527-d474-45ad-933b-20d10fdf4447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:21.436177 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:21.475824 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-6faaf527-d474-45ad-933b-20d10fdf4447 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:22:21.477028 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-6faaf527-d474-45ad-933b-20d10fdf4447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:21.586631 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 688/1370] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:22:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:22:22.173923 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98672a-83ed-463b-9d1d-5b082d9805a2 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:22.173923 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98672a-83ed-463b-9d1d-5b082d9805a2 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:22.173923 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98672a-83ed-463b-9d1d-5b082d9805a2 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:22.176331 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 683/1371] 10.222.0.60 () {54 vars in 964 bytes} [Tue Aug 30 01:22:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:22:22.179574 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a4e83-21b3-4aeb-a119-83aa5c051301 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:22.180075 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a4e83-21b3-4aeb-a119-83aa5c051301 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:22.180229 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a4e83-21b3-4aeb-a119-83aa5c051301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:22.258675 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-024a4e83-21b3-4aeb-a119-83aa5c051301 None None] MFA Rules not processed for user `e3040f72d52249f1b0e19e3a200bd16e`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:22:22.260567 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-024a4e83-21b3-4aeb-a119-83aa5c051301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:22.308629 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:22.341162 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 689/1372] 10.222.0.60 () {58 vars in 1061 bytes} [Tue Aug 30 01:22:22 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:22:22.348644 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a98672a-83ed-463b-9d1d-5b082d9805a2 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:22:22.350193 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-0a98672a-83ed-463b-9d1d-5b082d9805a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:22.401420 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:22.456657 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a98672a-83ed-463b-9d1d-5b082d9805a2 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:22:22.535851 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f9b64f-503f-4024-8bb9-dd157170ccf7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:22:22.536781 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9b64f-503f-4024-8bb9-dd157170ccf7 service cinder] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:22.537022 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9b64f-503f-4024-8bb9-dd157170ccf7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:22.537384 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9b64f-503f-4024-8bb9-dd157170ccf7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:22.539067 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-33f9b64f-503f-4024-8bb9-dd157170ccf7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:22.653991 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:22.669689 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f9b64f-503f-4024-8bb9-dd157170ccf7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:22:22.670477 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f9b64f-503f-4024-8bb9-dd157170ccf7 service cinder] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:22:22.691854 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 684/1373] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:22:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:22:22.945916 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d22f0-b123-4fed-a50c-ceb9745e2166 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:22.947479 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d22f0-b123-4fed-a50c-ceb9745e2166 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:22.947479 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d22f0-b123-4fed-a50c-ceb9745e2166 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:22.948127 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 690/1374] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:22:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:22:22.953580 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95cbbc-f16b-4cd0-b6d7-da74c867c40d None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:22.953937 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95cbbc-f16b-4cd0-b6d7-da74c867c40d None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:22.954282 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95cbbc-f16b-4cd0-b6d7-da74c867c40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:23.024155 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-6a95cbbc-f16b-4cd0-b6d7-da74c867c40d None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:22:23.025282 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-6a95cbbc-f16b-4cd0-b6d7-da74c867c40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:23.129350 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 685/1375] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:22:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:22:23.417153 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d22f0-b123-4fed-a50c-ceb9745e2166 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:22:23.419521 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-6b0d22f0-b123-4fed-a50c-ceb9745e2166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:23.566724 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d22f0-b123-4fed-a50c-ceb9745e2166 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:22:23.623153 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:23.685968 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f9cb0f-6a50-482a-8965-6c296eb29bb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8889145228a24fb6bd539a11925e62f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:22:23.686564 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9cb0f-6a50-482a-8965-6c296eb29bb8 service nova] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:23.686837 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9cb0f-6a50-482a-8965-6c296eb29bb8 service nova] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:23.687153 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9cb0f-6a50-482a-8965-6c296eb29bb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:23.688789 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-d1f9cb0f-6a50-482a-8965-6c296eb29bb8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:23.779844 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f9cb0f-6a50-482a-8965-6c296eb29bb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:22:23.781497 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f9cb0f-6a50-482a-8965-6c296eb29bb8 service nova] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:22:23.799812 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 691/1376] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:22:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:22:25.773115 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44fbfef-c581-4ff4-9e57-0ed70aa1efd3 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:25.773709 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44fbfef-c581-4ff4-9e57-0ed70aa1efd3 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:25.773709 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44fbfef-c581-4ff4-9e57-0ed70aa1efd3 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:25.775357 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 686/1377] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:22:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:22:25.782639 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b842cf-c14a-4b18-a464-e4509182051d None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:25.783684 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b842cf-c14a-4b18-a464-e4509182051d None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:25.784106 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b842cf-c14a-4b18-a464-e4509182051d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:25.858802 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-62b842cf-c14a-4b18-a464-e4509182051d None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:22:25.859915 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-62b842cf-c14a-4b18-a464-e4509182051d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:25.866377 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:25.964091 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 692/1378] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:22:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:22:26.264958 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44fbfef-c581-4ff4-9e57-0ed70aa1efd3 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:22:26.266507 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-c44fbfef-c581-4ff4-9e57-0ed70aa1efd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:26.341711 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:26.431155 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44fbfef-c581-4ff4-9e57-0ed70aa1efd3 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:22:26.560845 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6abc9ea-7883-4253-a910-a09248788f8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8889145228a24fb6bd539a11925e62f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:22:26.561459 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6abc9ea-7883-4253-a910-a09248788f8d service nova] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:26.561739 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6abc9ea-7883-4253-a910-a09248788f8d service nova] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:26.562015 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6abc9ea-7883-4253-a910-a09248788f8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:26.563637 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-b6abc9ea-7883-4253-a910-a09248788f8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:26.583743 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:26.668784 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6abc9ea-7883-4253-a910-a09248788f8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:22:26.670680 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6abc9ea-7883-4253-a910-a09248788f8d service nova] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:22:26.691045 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 687/1379] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:22:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:22:28.643863 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d06fa62-ab82-43a3-b7a4-66efa2c561d7 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:28.644435 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d06fa62-ab82-43a3-b7a4-66efa2c561d7 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:28.644435 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d06fa62-ab82-43a3-b7a4-66efa2c561d7 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:28.645912 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 693/1380] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:22:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:22:28.651193 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b4f5a-47b9-4372-bf42-0162b6a72934 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:28.651674 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b4f5a-47b9-4372-bf42-0162b6a72934 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:28.651757 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b4f5a-47b9-4372-bf42-0162b6a72934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:28.720774 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-c55b4f5a-47b9-4372-bf42-0162b6a72934 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:22:28.721980 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-c55b4f5a-47b9-4372-bf42-0162b6a72934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:28.822093 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:28.829853 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 688/1381] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:22:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:22:29.134897 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d06fa62-ab82-43a3-b7a4-66efa2c561d7 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:22:29.136463 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-5d06fa62-ab82-43a3-b7a4-66efa2c561d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:29.308206 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:29.322846 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d06fa62-ab82-43a3-b7a4-66efa2c561d7 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:22:29.452807 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab81a74a-5feb-4da1-a8b0-3d2d8bcf6910 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8889145228a24fb6bd539a11925e62f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:22:29.453409 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81a74a-5feb-4da1-a8b0-3d2d8bcf6910 service nova] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:29.453690 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81a74a-5feb-4da1-a8b0-3d2d8bcf6910 service nova] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:29.453960 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81a74a-5feb-4da1-a8b0-3d2d8bcf6910 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:29.455568 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-ab81a74a-5feb-4da1-a8b0-3d2d8bcf6910 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:29.558299 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab81a74a-5feb-4da1-a8b0-3d2d8bcf6910 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:22:29.559978 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab81a74a-5feb-4da1-a8b0-3d2d8bcf6910 service nova] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:22:29.571271 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:29.581498 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 694/1382] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:22:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:22:31.575381 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed7e3be-126a-4284-ac6b-7bcf562f400c None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:31.576042 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed7e3be-126a-4284-ac6b-7bcf562f400c None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:31.576042 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed7e3be-126a-4284-ac6b-7bcf562f400c None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:31.577218 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 689/1383] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:22:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:22:31.582434 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d92ff84-7270-4ad5-96da-f820e2c7fdff None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:31.582989 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d92ff84-7270-4ad5-96da-f820e2c7fdff None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:31.582989 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d92ff84-7270-4ad5-96da-f820e2c7fdff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:31.666963 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-1d92ff84-7270-4ad5-96da-f820e2c7fdff None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:22:31.668295 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-1d92ff84-7270-4ad5-96da-f820e2c7fdff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:31.783488 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 695/1384] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:22:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:22:32.070157 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed7e3be-126a-4284-ac6b-7bcf562f400c None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:22:32.072701 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-3ed7e3be-126a-4284-ac6b-7bcf562f400c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:32.230711 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed7e3be-126a-4284-ac6b-7bcf562f400c None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:22:32.299034 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:32.356278 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d9a67b-be0e-47c2-b4fc-da87eb908b73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8889145228a24fb6bd539a11925e62f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:22:32.356815 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d9a67b-be0e-47c2-b4fc-da87eb908b73 service nova] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:32.357099 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d9a67b-be0e-47c2-b4fc-da87eb908b73 service nova] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:32.357361 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d9a67b-be0e-47c2-b4fc-da87eb908b73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:32.358954 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-d7d9a67b-be0e-47c2-b4fc-da87eb908b73 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:32.454941 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d9a67b-be0e-47c2-b4fc-da87eb908b73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:22:32.456578 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d9a67b-be0e-47c2-b4fc-da87eb908b73 service nova] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:22:32.474988 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 690/1385] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:22:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:22:34.410367 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275ead5-af0c-4479-be8d-31e07e81bc48 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:34.411081 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275ead5-af0c-4479-be8d-31e07e81bc48 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:34.411081 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275ead5-af0c-4479-be8d-31e07e81bc48 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:34.412242 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 696/1386] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:22:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:22:34.417480 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e1daf-cdec-4e08-a11e-5ba0d8ddf79d None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:34.418111 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e1daf-cdec-4e08-a11e-5ba0d8ddf79d None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:34.418111 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e1daf-cdec-4e08-a11e-5ba0d8ddf79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:34.486381 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-7e2e1daf-cdec-4e08-a11e-5ba0d8ddf79d None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:22:34.487536 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-7e2e1daf-cdec-4e08-a11e-5ba0d8ddf79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:34.520644 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:34.609046 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 691/1387] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:22:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:22:34.898683 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e275ead5-af0c-4479-be8d-31e07e81bc48 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:22:34.900255 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-e275ead5-af0c-4479-be8d-31e07e81bc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:34.996656 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:35.099029 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e275ead5-af0c-4479-be8d-31e07e81bc48 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:22:35.247010 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c4289-d0ff-44b6-93b8-c09dd375b36d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8889145228a24fb6bd539a11925e62f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:22:35.247734 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c4289-d0ff-44b6-93b8-c09dd375b36d service nova] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:35.248072 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c4289-d0ff-44b6-93b8-c09dd375b36d service nova] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:35.248319 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c4289-d0ff-44b6-93b8-c09dd375b36d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:35.250019 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-be4c4289-d0ff-44b6-93b8-c09dd375b36d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:35.297433 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:35.352249 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4c4289-d0ff-44b6-93b8-c09dd375b36d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:22:35.354435 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4c4289-d0ff-44b6-93b8-c09dd375b36d service nova] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:22:35.372409 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 697/1388] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:22:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:22:37.404091 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e803d-5311-4735-92a2-47352d6734be None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:37.404937 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e803d-5311-4735-92a2-47352d6734be None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:37.405121 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e803d-5311-4735-92a2-47352d6734be None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:37.406592 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 692/1389] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:22:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:22:37.412729 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e625689-6032-4a71-becc-7e0afde94850 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:37.413197 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e625689-6032-4a71-becc-7e0afde94850 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:37.413302 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e625689-6032-4a71-becc-7e0afde94850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:37.485480 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-8e625689-6032-4a71-becc-7e0afde94850 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:22:37.486595 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-8e625689-6032-4a71-becc-7e0afde94850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:37.608702 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 698/1390] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:22:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:22:37.798540 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e2912-c83a-488a-bef6-e6bdebf27e21 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:37.798750 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e2912-c83a-488a-bef6-e6bdebf27e21 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:37.799001 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e2912-c83a-488a-bef6-e6bdebf27e21 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:37.800512 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 693/1391] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:22:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:22:37.805561 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca24c9-ffe0-4cb8-b174-8b47e0d3a01e None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:37.805848 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca24c9-ffe0-4cb8-b174-8b47e0d3a01e None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:37.806122 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca24c9-ffe0-4cb8-b174-8b47e0d3a01e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:37.823066 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:37.878000 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-5bca24c9-ffe0-4cb8-b174-8b47e0d3a01e None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:22:37.879222 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-5bca24c9-ffe0-4cb8-b174-8b47e0d3a01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:37.897807 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6e2912-c83a-488a-bef6-e6bdebf27e21 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:22:37.899328 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-fd6e2912-c83a-488a-bef6-e6bdebf27e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:37.984245 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 699/1392] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:22:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:22:38.046018 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6e2912-c83a-488a-bef6-e6bdebf27e21 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:22:38.061997 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:38.158056 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fba9ca-c178-4559-8f88-397c42c4265d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8889145228a24fb6bd539a11925e62f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:22:38.158668 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fba9ca-c178-4559-8f88-397c42c4265d service nova] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:38.158947 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fba9ca-c178-4559-8f88-397c42c4265d service nova] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:38.159215 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fba9ca-c178-4559-8f88-397c42c4265d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:38.160817 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-b1fba9ca-c178-4559-8f88-397c42c4265d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:38.250473 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fba9ca-c178-4559-8f88-397c42c4265d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:22:38.252104 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fba9ca-c178-4559-8f88-397c42c4265d service nova] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:22:38.273160 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 694/1393] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:22:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:22:38.285269 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8bcb9-0e6c-4b0e-8069-b37eae9d16fe None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:38.285634 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8bcb9-0e6c-4b0e-8069-b37eae9d16fe None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:38.285980 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8bcb9-0e6c-4b0e-8069-b37eae9d16fe None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:38.287513 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 700/1394] 10.222.0.60 () {54 vars in 967 bytes} [Tue Aug 30 01:22:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:22:38.293396 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b242ad8-0b5c-43ef-a070-bdb1fc6dfa55 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:38.293681 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b242ad8-0b5c-43ef-a070-bdb1fc6dfa55 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:38.293954 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b242ad8-0b5c-43ef-a070-bdb1fc6dfa55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:38.320373 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:38.379677 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-1b242ad8-0b5c-43ef-a070-bdb1fc6dfa55 None None] MFA Rules not processed for user `2de6decc90df4df58217d5eed9c5e190`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:22:38.380912 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-1b242ad8-0b5c-43ef-a070-bdb1fc6dfa55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:38.469064 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 695/1395] 10.222.0.60 () {58 vars in 1064 bytes} [Tue Aug 30 01:22:38 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:22:38.476606 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed8bcb9-0e6c-4b0e-8069-b37eae9d16fe None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:22:38.478109 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-3ed8bcb9-0e6c-4b0e-8069-b37eae9d16fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:38.579511 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:38.587004 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed8bcb9-0e6c-4b0e-8069-b37eae9d16fe None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:22:38.666873 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da524d-dabe-4dbd-8a21-8392ed1b07fa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2de6decc90df4df58217d5eed9c5e190', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:22:38.667514 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da524d-dabe-4dbd-8a21-8392ed1b07fa service glance] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:38.667798 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da524d-dabe-4dbd-8a21-8392ed1b07fa service glance] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:38.668070 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da524d-dabe-4dbd-8a21-8392ed1b07fa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:38.669660 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-58da524d-dabe-4dbd-8a21-8392ed1b07fa service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:38.783796 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da524d-dabe-4dbd-8a21-8392ed1b07fa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:22:38.785256 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da524d-dabe-4dbd-8a21-8392ed1b07fa service glance] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:22:38.807077 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 701/1396] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:22:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:22:39.585683 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ca7fe-a98d-43b6-8a9b-0f901d495c21 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:39.586472 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ca7fe-a98d-43b6-8a9b-0f901d495c21 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:39.586472 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ca7fe-a98d-43b6-8a9b-0f901d495c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:39.660668 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-164ca7fe-a98d-43b6-8a9b-0f901d495c21 None None] MFA Rules not processed for user `edc11f8a9c5843939ec230e63ca7fa3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:22:39.661875 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-164ca7fe-a98d-43b6-8a9b-0f901d495c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:39.726854 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:39.754667 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 696/1397] 10.222.0.60 () {58 vars in 1009 bytes} [Tue Aug 30 01:22:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:22:39.801390 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b587414-a239-4d29-9acc-588ad86beda6 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:39.801914 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b587414-a239-4d29-9acc-588ad86beda6 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:39.801914 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b587414-a239-4d29-9acc-588ad86beda6 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:39.803256 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 702/1398] 10.222.0.60 () {54 vars in 943 bytes} [Tue Aug 30 01:22:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:22:39.810752 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f9c943-3471-40de-9610-9deb2773e2e6 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:39.811032 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f9c943-3471-40de-9610-9deb2773e2e6 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:39.811331 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f9c943-3471-40de-9610-9deb2773e2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:39.907536 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-b1f9c943-3471-40de-9610-9deb2773e2e6 None None] MFA Rules not processed for user `1e7de1f31ef84d529bf2c53ce0f7e38b`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:22:39.908955 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-b1f9c943-3471-40de-9610-9deb2773e2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:40.031213 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 697/1399] 10.222.0.60 () {58 vars in 1040 bytes} [Tue Aug 30 01:22:39 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:22:40.040639 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b587414-a239-4d29-9acc-588ad86beda6 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:22:40.042797 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-7b587414-a239-4d29-9acc-588ad86beda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:40.067655 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:40.198004 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b587414-a239-4d29-9acc-588ad86beda6 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:22:40.281795 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee07be-91cb-452b-a5b8-569eef5cad14 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:40.282018 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee07be-91cb-452b-a5b8-569eef5cad14 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:40.282247 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee07be-91cb-452b-a5b8-569eef5cad14 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:40.283635 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 698/1400] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:22:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:22:40.289242 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb85a9-624e-4772-9077-f4297f8046fa None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:40.289916 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb85a9-624e-4772-9077-f4297f8046fa None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:40.289916 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb85a9-624e-4772-9077-f4297f8046fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:40.312866 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e54ad-0bd3-40e0-94e7-3bea61cd2ae1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7de1f31ef84d529bf2c53ce0f7e38b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:22:40.313471 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e54ad-0bd3-40e0-94e7-3bea61cd2ae1 service swift] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:40.313748 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e54ad-0bd3-40e0-94e7-3bea61cd2ae1 service swift] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:40.314017 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e54ad-0bd3-40e0-94e7-3bea61cd2ae1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:40.315735 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-1b3e54ad-0bd3-40e0-94e7-3bea61cd2ae1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:40.324199 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:40.338748 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:40.361210 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-f3cb85a9-624e-4772-9077-f4297f8046fa None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:22:40.362549 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-f3cb85a9-624e-4772-9077-f4297f8046fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:40.402606 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3e54ad-0bd3-40e0-94e7-3bea61cd2ae1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:22:40.404243 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3e54ad-0bd3-40e0-94e7-3bea61cd2ae1 service swift] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:22:40.412373 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 703/1401] 10.222.0.60 () {60 vars in 1384 bytes} [Tue Aug 30 01:22:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 01:22:40.468981 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 699/1402] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:22:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:22:40.766669 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e54ad-0bd3-40e0-94e7-3bea61cd2ae1 service swift] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:22:40.767921 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-1b3e54ad-0bd3-40e0-94e7-3bea61cd2ae1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:40.880557 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e54ad-0bd3-40e0-94e7-3bea61cd2ae1 service swift] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:22:40.947715 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:41.015524 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaaf0a9-4506-442b-a8e4-bf3c23658fef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8889145228a24fb6bd539a11925e62f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:22:41.016138 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaaf0a9-4506-442b-a8e4-bf3c23658fef service nova] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:41.016416 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaaf0a9-4506-442b-a8e4-bf3c23658fef service nova] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:41.016688 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaaf0a9-4506-442b-a8e4-bf3c23658fef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:41.018410 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-bfaaf0a9-4506-442b-a8e4-bf3c23658fef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:41.121922 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaaf0a9-4506-442b-a8e4-bf3c23658fef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:22:41.124152 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaaf0a9-4506-442b-a8e4-bf3c23658fef service nova] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:22:41.143088 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 704/1403] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:22:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:22:43.205522 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb9909a-0f8c-4766-802e-1a0a933b2211 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:43.206227 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb9909a-0f8c-4766-802e-1a0a933b2211 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:43.206500 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb9909a-0f8c-4766-802e-1a0a933b2211 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:43.208205 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 700/1404] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:22:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:22:43.213756 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f3905f-7142-4c54-9932-4dc6ee9dff27 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:43.213756 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f3905f-7142-4c54-9932-4dc6ee9dff27 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:43.215223 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f3905f-7142-4c54-9932-4dc6ee9dff27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:43.299569 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-31f3905f-7142-4c54-9932-4dc6ee9dff27 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:22:43.300787 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-31f3905f-7142-4c54-9932-4dc6ee9dff27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:43.317523 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:43.426856 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 705/1405] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:22:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:22:43.729436 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb9909a-0f8c-4766-802e-1a0a933b2211 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:22:43.730953 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-4cb9909a-0f8c-4766-802e-1a0a933b2211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:43.868063 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:43.911557 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb9909a-0f8c-4766-802e-1a0a933b2211 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:22:44.043320 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e8caaf-5d45-46d8-ad05-892a1ab64176 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8889145228a24fb6bd539a11925e62f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:22:44.043973 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e8caaf-5d45-46d8-ad05-892a1ab64176 service nova] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:44.044247 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e8caaf-5d45-46d8-ad05-892a1ab64176 service nova] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:44.044515 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e8caaf-5d45-46d8-ad05-892a1ab64176 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:44.046156 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-f8e8caaf-5d45-46d8-ad05-892a1ab64176 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:44.130720 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:44.148020 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e8caaf-5d45-46d8-ad05-892a1ab64176 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:22:44.149660 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e8caaf-5d45-46d8-ad05-892a1ab64176 service nova] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:22:44.169703 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 701/1406] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:22:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:22:46.148661 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12533a3a-49ec-45cd-9422-022dcd356dea None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:46.149215 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12533a3a-49ec-45cd-9422-022dcd356dea None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:46.149316 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12533a3a-49ec-45cd-9422-022dcd356dea None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:46.150624 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 706/1407] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:22:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:22:46.156009 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2217c-5513-4fe2-a6bc-0e1b04d1d2fb None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:46.156507 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2217c-5513-4fe2-a6bc-0e1b04d1d2fb None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:46.156743 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2217c-5513-4fe2-a6bc-0e1b04d1d2fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:46.226555 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-2ae2217c-5513-4fe2-a6bc-0e1b04d1d2fb None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:22:46.228543 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-2ae2217c-5513-4fe2-a6bc-0e1b04d1d2fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:46.351469 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 702/1408] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:22:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:22:46.633273 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12533a3a-49ec-45cd-9422-022dcd356dea None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:22:46.634871 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-12533a3a-49ec-45cd-9422-022dcd356dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:46.801189 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:46.803937 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12533a3a-49ec-45cd-9422-022dcd356dea None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:22:46.925595 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcb85d4-88fc-4fea-af3a-3fa333f2d15f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8889145228a24fb6bd539a11925e62f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:22:46.926194 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb85d4-88fc-4fea-af3a-3fa333f2d15f service nova] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:22:46.926469 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb85d4-88fc-4fea-af3a-3fa333f2d15f service nova] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:22:46.926733 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb85d4-88fc-4fea-af3a-3fa333f2d15f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:22:46.929600 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-2dcb85d4-88fc-4fea-af3a-3fa333f2d15f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:22:47.028153 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcb85d4-88fc-4fea-af3a-3fa333f2d15f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:22:47.029779 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcb85d4-88fc-4fea-af3a-3fa333f2d15f service nova] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:22:47.049876 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 707/1409] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:22:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:22:56.338180 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=76 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:57.047512 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:23:02.802155 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3cd14-aa43-4aae-a424-f80d545f26f4 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:02.802718 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3cd14-aa43-4aae-a424-f80d545f26f4 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:02.802718 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3cd14-aa43-4aae-a424-f80d545f26f4 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:02.804054 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 703/1410] 10.222.0.60 () {54 vars in 918 bytes} [Tue Aug 30 01:23:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:23:02.809388 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d93d0-807e-429f-8978-7a264779fe8d None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:02.809824 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d93d0-807e-429f-8978-7a264779fe8d None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:02.809932 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d93d0-807e-429f-8978-7a264779fe8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:02.885719 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-2f4d93d0-807e-429f-8978-7a264779fe8d None None] MFA Rules not processed for user `e8dbb4742c3944b9ad389e9628b5a047`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:23:02.886908 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-2f4d93d0-807e-429f-8978-7a264779fe8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:02.990696 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 708/1411] 10.222.0.60 () {58 vars in 1015 bytes} [Tue Aug 30 01:23:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:23:03.005115 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146757c-c7aa-43fa-b085-06b4fa425337 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:03.005402 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146757c-c7aa-43fa-b085-06b4fa425337 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:03.005673 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146757c-c7aa-43fa-b085-06b4fa425337 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:03.007017 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 704/1412] 10.222.0.60 () {54 vars in 918 bytes} [Tue Aug 30 01:23:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:23:03.012108 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a562c-e3f3-4925-8316-2c96cbf9ff1e None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:03.012394 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a562c-e3f3-4925-8316-2c96cbf9ff1e None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:03.012670 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a562c-e3f3-4925-8316-2c96cbf9ff1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:03.084492 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:23:03.087606 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-530a562c-e3f3-4925-8316-2c96cbf9ff1e None None] MFA Rules not processed for user `8889145228a24fb6bd539a11925e62f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:23:03.089311 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-530a562c-e3f3-4925-8316-2c96cbf9ff1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:03.203774 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 709/1413] 10.222.0.60 () {58 vars in 1015 bytes} [Tue Aug 30 01:23:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:23:05.588394 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72eb05-a618-40c3-9485-cef04d584a33 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:05.588959 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72eb05-a618-40c3-9485-cef04d584a33 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:05.588959 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72eb05-a618-40c3-9485-cef04d584a33 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:05.590522 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 705/1414] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 01:23:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:23:05.596410 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c911a03-b22b-488d-ac71-6148766329e2 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:05.596898 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c911a03-b22b-488d-ac71-6148766329e2 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:05.596989 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c911a03-b22b-488d-ac71-6148766329e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:05.664344 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-6c911a03-b22b-488d-ac71-6148766329e2 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:23:05.665609 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-6c911a03-b22b-488d-ac71-6148766329e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:05.720829 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:23:05.763241 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 710/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 01:23:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:23:06.053192 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f72eb05-a618-40c3-9485-cef04d584a33 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:23:06.054766 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-2f72eb05-a618-40c3-9485-cef04d584a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:06.200013 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f72eb05-a618-40c3-9485-cef04d584a33 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:23:06.272163 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:23:06.312539 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d65185-79bf-4898-a280-09278ffd56fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8889145228a24fb6bd539a11925e62f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:23:06.313070 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d65185-79bf-4898-a280-09278ffd56fb service nova] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:06.313346 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d65185-79bf-4898-a280-09278ffd56fb service nova] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:06.313615 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d65185-79bf-4898-a280-09278ffd56fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:06.315201 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-a1d65185-79bf-4898-a280-09278ffd56fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:06.402937 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d65185-79bf-4898-a280-09278ffd56fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:23:06.404553 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d65185-79bf-4898-a280-09278ffd56fb service nova] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:23:06.422683 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 706/1416] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:23:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:23:07.316457 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942c177-54cf-418f-a82e-d36154c92ada None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:07.317016 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942c177-54cf-418f-a82e-d36154c92ada None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:07.317016 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942c177-54cf-418f-a82e-d36154c92ada None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:07.318411 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 711/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 01:23:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:23:07.323800 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e794a-f9ce-4442-883b-4c39ac7f608d None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:07.324263 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e794a-f9ce-4442-883b-4c39ac7f608d None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:07.324363 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e794a-f9ce-4442-883b-4c39ac7f608d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:07.401447 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-9e2e794a-f9ce-4442-883b-4c39ac7f608d None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:23:07.402647 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-9e2e794a-f9ce-4442-883b-4c39ac7f608d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:07.429384 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:23:07.507090 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 707/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 01:23:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:23:07.665041 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9942c177-54cf-418f-a82e-d36154c92ada None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:23:07.666547 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-9942c177-54cf-418f-a82e-d36154c92ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:07.811732 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9942c177-54cf-418f-a82e-d36154c92ada None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:23:07.851787 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:23:07.925050 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb88451-8750-45e9-b05f-4763a68414fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8889145228a24fb6bd539a11925e62f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:23:07.925655 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb88451-8750-45e9-b05f-4763a68414fc service nova] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:07.925937 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb88451-8750-45e9-b05f-4763a68414fc service nova] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:07.926207 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb88451-8750-45e9-b05f-4763a68414fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:07.927833 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-8cb88451-8750-45e9-b05f-4763a68414fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:08.016585 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb88451-8750-45e9-b05f-4763a68414fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:23:08.018181 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb88451-8750-45e9-b05f-4763a68414fc service nova] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:23:08.035767 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 712/1419] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:23:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:23:08.921955 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4778f1d7-6969-418c-8fee-f58236dd0dcf None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:08.922517 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4778f1d7-6969-418c-8fee-f58236dd0dcf None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:08.922517 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4778f1d7-6969-418c-8fee-f58236dd0dcf None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:08.923914 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 708/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 01:23:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:23:08.928867 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc22f4-89b3-4a3d-9d9b-4418deee19a1 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:08.929299 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc22f4-89b3-4a3d-9d9b-4418deee19a1 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:08.929416 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc22f4-89b3-4a3d-9d9b-4418deee19a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:08.983231 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:23:09.004796 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-b8fc22f4-89b3-4a3d-9d9b-4418deee19a1 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:23:09.006010 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-b8fc22f4-89b3-4a3d-9d9b-4418deee19a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:09.101897 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 713/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 01:23:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:23:09.256116 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4778f1d7-6969-418c-8fee-f58236dd0dcf None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:23:09.257627 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-4778f1d7-6969-418c-8fee-f58236dd0dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:09.411446 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4778f1d7-6969-418c-8fee-f58236dd0dcf None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:23:09.424682 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:23:09.532915 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc27ba04-b6ff-4a61-baee-25c6e117991e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8889145228a24fb6bd539a11925e62f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:23:09.533414 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27ba04-b6ff-4a61-baee-25c6e117991e service nova] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:09.533695 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27ba04-b6ff-4a61-baee-25c6e117991e service nova] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:09.533960 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27ba04-b6ff-4a61-baee-25c6e117991e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:09.535598 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-bc27ba04-b6ff-4a61-baee-25c6e117991e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:09.625995 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc27ba04-b6ff-4a61-baee-25c6e117991e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:23:09.627639 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc27ba04-b6ff-4a61-baee-25c6e117991e service nova] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:23:09.650132 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 709/1422] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:23:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:23:10.506043 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f13eee-b0bb-4717-8cdf-8e64e313679f None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:10.506637 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f13eee-b0bb-4717-8cdf-8e64e313679f None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:10.506637 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f13eee-b0bb-4717-8cdf-8e64e313679f None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:10.507934 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 714/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 01:23:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:23:10.513415 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acebff4a-ab74-42e8-97b7-8468fa3d123f None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:10.513814 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acebff4a-ab74-42e8-97b7-8468fa3d123f None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:10.514000 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acebff4a-ab74-42e8-97b7-8468fa3d123f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:10.534427 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:23:10.590180 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-acebff4a-ab74-42e8-97b7-8468fa3d123f None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:23:10.591380 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-acebff4a-ab74-42e8-97b7-8468fa3d123f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:10.688541 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 710/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 01:23:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:23:10.840695 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f13eee-b0bb-4717-8cdf-8e64e313679f None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:23:10.841869 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-35f13eee-b0bb-4717-8cdf-8e64e313679f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:10.952252 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:23:10.988977 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f13eee-b0bb-4717-8cdf-8e64e313679f None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:23:11.100424 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927b1a0b-71ef-424e-bfd6-9d1a937adcaa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8889145228a24fb6bd539a11925e62f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:23:11.100947 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b1a0b-71ef-424e-bfd6-9d1a937adcaa service nova] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:11.101222 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b1a0b-71ef-424e-bfd6-9d1a937adcaa service nova] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:11.101490 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b1a0b-71ef-424e-bfd6-9d1a937adcaa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:11.103616 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-927b1a0b-71ef-424e-bfd6-9d1a937adcaa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:11.177840 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:23:11.192165 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927b1a0b-71ef-424e-bfd6-9d1a937adcaa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:23:11.193769 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927b1a0b-71ef-424e-bfd6-9d1a937adcaa service nova] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:23:11.212218 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 715/1425] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:23:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:23:12.075409 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b426c3b-2b49-40b0-b31b-632cf51006c2 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:12.075975 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b426c3b-2b49-40b0-b31b-632cf51006c2 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:12.075975 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b426c3b-2b49-40b0-b31b-632cf51006c2 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:12.077339 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 711/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 01:23:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:23:12.082205 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad952d-2f3f-468d-920e-09b9fabb9f5b None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:12.082621 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad952d-2f3f-468d-920e-09b9fabb9f5b None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:12.082757 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad952d-2f3f-468d-920e-09b9fabb9f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:12.158283 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-66ad952d-2f3f-468d-920e-09b9fabb9f5b None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:23:12.159515 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-66ad952d-2f3f-468d-920e-09b9fabb9f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:12.255524 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 716/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 01:23:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:23:12.404668 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b426c3b-2b49-40b0-b31b-632cf51006c2 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:23:12.406173 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-8b426c3b-2b49-40b0-b31b-632cf51006c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:12.489294 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:23:12.551480 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b426c3b-2b49-40b0-b31b-632cf51006c2 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:23:12.667463 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3213f8-c284-41ba-a681-692ffb89c6dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8889145228a24fb6bd539a11925e62f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:23:12.668000 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3213f8-c284-41ba-a681-692ffb89c6dc service nova] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:12.668273 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3213f8-c284-41ba-a681-692ffb89c6dc service nova] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:12.668541 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3213f8-c284-41ba-a681-692ffb89c6dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:12.670127 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-0d3213f8-c284-41ba-a681-692ffb89c6dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:12.717218 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:23:12.758922 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3213f8-c284-41ba-a681-692ffb89c6dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:23:12.760543 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3213f8-c284-41ba-a681-692ffb89c6dc service nova] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:23:12.787383 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 712/1428] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:23:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:23:13.591223 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730eaff0-4bb0-46c2-a22a-c0ac4af4e8e0 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:13.591863 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730eaff0-4bb0-46c2-a22a-c0ac4af4e8e0 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:13.591863 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730eaff0-4bb0-46c2-a22a-c0ac4af4e8e0 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:13.593120 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 717/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 01:23:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:23:13.600689 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e572b6-da98-4dae-aaa8-a8c4878c46c8 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:13.601200 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e572b6-da98-4dae-aaa8-a8c4878c46c8 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:13.601297 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e572b6-da98-4dae-aaa8-a8c4878c46c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:13.683293 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-61e572b6-da98-4dae-aaa8-a8c4878c46c8 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:23:13.684515 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-61e572b6-da98-4dae-aaa8-a8c4878c46c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:13.782740 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 713/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 01:23:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:23:13.937737 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730eaff0-4bb0-46c2-a22a-c0ac4af4e8e0 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:23:13.939604 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-730eaff0-4bb0-46c2-a22a-c0ac4af4e8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:13.987533 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:23:14.082898 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730eaff0-4bb0-46c2-a22a-c0ac4af4e8e0 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:23:14.193046 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed0a66-3611-45c8-80d7-5f9d3cfeb32f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8889145228a24fb6bd539a11925e62f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:23:14.193568 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed0a66-3611-45c8-80d7-5f9d3cfeb32f service nova] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:14.193845 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed0a66-3611-45c8-80d7-5f9d3cfeb32f service nova] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:14.194113 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed0a66-3611-45c8-80d7-5f9d3cfeb32f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:14.195761 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-e3ed0a66-3611-45c8-80d7-5f9d3cfeb32f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:14.202604 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:23:14.286454 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ed0a66-3611-45c8-80d7-5f9d3cfeb32f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:23:14.288151 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ed0a66-3611-45c8-80d7-5f9d3cfeb32f service nova] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:23:14.306253 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 718/1431] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:23:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:23:15.106833 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0072f75b-dfa7-408b-9067-2eb1e55dde41 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:15.107449 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0072f75b-dfa7-408b-9067-2eb1e55dde41 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:15.107449 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0072f75b-dfa7-408b-9067-2eb1e55dde41 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:15.108742 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 714/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 01:23:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:23:15.113545 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471baf51-ef72-480e-aacf-3175d01adf95 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:15.113968 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471baf51-ef72-480e-aacf-3175d01adf95 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:15.114084 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471baf51-ef72-480e-aacf-3175d01adf95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:15.190245 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-471baf51-ef72-480e-aacf-3175d01adf95 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:23:15.191400 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-471baf51-ef72-480e-aacf-3175d01adf95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:15.261376 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:23:15.289970 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 719/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 01:23:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:23:15.440245 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0072f75b-dfa7-408b-9067-2eb1e55dde41 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:23:15.441763 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-0072f75b-dfa7-408b-9067-2eb1e55dde41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:15.458944 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:23:15.589707 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0072f75b-dfa7-408b-9067-2eb1e55dde41 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:23:15.677418 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:23:15.706651 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3d08a-bf13-4394-866b-14f0237ad578 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8889145228a24fb6bd539a11925e62f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:23:15.707184 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3d08a-bf13-4394-866b-14f0237ad578 service nova] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:15.707481 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3d08a-bf13-4394-866b-14f0237ad578 service nova] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:15.707754 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3d08a-bf13-4394-866b-14f0237ad578 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:15.709347 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-a1b3d08a-bf13-4394-866b-14f0237ad578 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:15.798420 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b3d08a-bf13-4394-866b-14f0237ad578 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:23:15.800037 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b3d08a-bf13-4394-866b-14f0237ad578 service nova] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:23:15.817977 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 715/1434] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:23:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:23:16.624618 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1eadba-9d0a-4f35-b213-f21ba16ebe90 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:16.625072 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1eadba-9d0a-4f35-b213-f21ba16ebe90 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:16.625180 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1eadba-9d0a-4f35-b213-f21ba16ebe90 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:16.626502 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 720/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 01:23:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:23:16.631562 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae797b89-e303-464e-b1e9-3b5bc9a79d56 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:16.632029 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae797b89-e303-464e-b1e9-3b5bc9a79d56 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:16.632140 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae797b89-e303-464e-b1e9-3b5bc9a79d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:16.708109 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-ae797b89-e303-464e-b1e9-3b5bc9a79d56 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:23:16.709319 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-ae797b89-e303-464e-b1e9-3b5bc9a79d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:16.750209 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:23:16.805639 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 716/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 01:23:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:23:16.960808 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1eadba-9d0a-4f35-b213-f21ba16ebe90 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:23:16.962328 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-0e1eadba-9d0a-4f35-b213-f21ba16ebe90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:17.110089 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1eadba-9d0a-4f35-b213-f21ba16ebe90 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:23:17.163164 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:23:17.221365 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9526f1-1f23-4780-931c-f873a19f3371 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8889145228a24fb6bd539a11925e62f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:23:17.221912 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9526f1-1f23-4780-931c-f873a19f3371 service nova] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:17.222188 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9526f1-1f23-4780-931c-f873a19f3371 service nova] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:17.222458 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9526f1-1f23-4780-931c-f873a19f3371 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:17.224099 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-6f9526f1-1f23-4780-931c-f873a19f3371 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:17.311989 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9526f1-1f23-4780-931c-f873a19f3371 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:23:17.313616 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9526f1-1f23-4780-931c-f873a19f3371 service nova] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:23:17.331177 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 721/1437] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:23:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:23:18.149791 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5aea68-c808-447c-90e1-cdd928a9a70a None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:18.150362 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5aea68-c808-447c-90e1-cdd928a9a70a None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:18.150362 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5aea68-c808-447c-90e1-cdd928a9a70a None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:18.151785 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 717/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 01:23:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:23:18.156697 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94be1c-d5ac-4795-8858-3d764e68cb79 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:18.157125 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94be1c-d5ac-4795-8858-3d764e68cb79 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:18.157232 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94be1c-d5ac-4795-8858-3d764e68cb79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:18.232250 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-db94be1c-d5ac-4795-8858-3d764e68cb79 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:23:18.233372 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-db94be1c-d5ac-4795-8858-3d764e68cb79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:18.235373 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:23:18.331281 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 722/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 01:23:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:23:18.483651 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5aea68-c808-447c-90e1-cdd928a9a70a None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:23:18.485147 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-fa5aea68-c808-447c-90e1-cdd928a9a70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:18.631233 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5aea68-c808-447c-90e1-cdd928a9a70a None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:23:18.658411 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:23:18.744996 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3df878-c34c-4cdb-bd7c-042842adf9fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8889145228a24fb6bd539a11925e62f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:23:18.745496 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3df878-c34c-4cdb-bd7c-042842adf9fb service nova] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:18.745767 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3df878-c34c-4cdb-bd7c-042842adf9fb service nova] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:18.746031 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3df878-c34c-4cdb-bd7c-042842adf9fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:18.747628 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-bb3df878-c34c-4cdb-bd7c-042842adf9fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:18.834485 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3df878-c34c-4cdb-bd7c-042842adf9fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:23:18.836110 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3df878-c34c-4cdb-bd7c-042842adf9fb service nova] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:23:18.854237 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 718/1440] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:23:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:23:20.716993 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb2c75-8003-410d-821b-ae7219a9e9da None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:20.717558 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb2c75-8003-410d-821b-ae7219a9e9da None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:20.717558 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb2c75-8003-410d-821b-ae7219a9e9da None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:20.718892 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 723/1441] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 01:23:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:23:20.724248 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d9dc0-0fe7-48a9-94d7-04de15724c49 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:20.724695 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d9dc0-0fe7-48a9-94d7-04de15724c49 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:20.724805 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d9dc0-0fe7-48a9-94d7-04de15724c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:20.765755 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:23:20.791688 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-a06d9dc0-0fe7-48a9-94d7-04de15724c49 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:23:20.792898 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-a06d9dc0-0fe7-48a9-94d7-04de15724c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:20.888458 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 719/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 01:23:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:23:21.173035 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb2c75-8003-410d-821b-ae7219a9e9da None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:23:21.174567 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-3acb2c75-8003-410d-821b-ae7219a9e9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:21.277710 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb2c75-8003-410d-821b-ae7219a9e9da None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:23:21.309691 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:23:21.351051 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3831dec-a39d-4d0a-b8c8-37c5cfa7549e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:23:21.352225 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3831dec-a39d-4d0a-b8c8-37c5cfa7549e service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:21.352507 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3831dec-a39d-4d0a-b8c8-37c5cfa7549e service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:21.352782 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3831dec-a39d-4d0a-b8c8-37c5cfa7549e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:21.354361 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-c3831dec-a39d-4d0a-b8c8-37c5cfa7549e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:21.461780 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3831dec-a39d-4d0a-b8c8-37c5cfa7549e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:23:21.463216 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3831dec-a39d-4d0a-b8c8-37c5cfa7549e service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:23:21.481200 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 724/1443] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:23:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:23:23.522749 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d16be-5413-4851-856a-78e25f0de428 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:23.523814 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d16be-5413-4851-856a-78e25f0de428 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:23.523814 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d16be-5413-4851-856a-78e25f0de428 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:23.525232 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 720/1444] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 01:23:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:23:23.530521 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0bc863-99a3-498b-8776-557e6c7cef2b None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:23.530907 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0bc863-99a3-498b-8776-557e6c7cef2b None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:23.531070 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0bc863-99a3-498b-8776-557e6c7cef2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:23.596754 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-de0bc863-99a3-498b-8776-557e6c7cef2b None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:23:23.597954 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-de0bc863-99a3-498b-8776-557e6c7cef2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:23.612315 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:23:23.696037 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 725/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 01:23:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:23:23.980190 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d16be-5413-4851-856a-78e25f0de428 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:23:23.981750 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-fd7d16be-5413-4851-856a-78e25f0de428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:24.084782 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d16be-5413-4851-856a-78e25f0de428 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:23:24.097359 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:23:24.157848 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab1164-842d-40a3-8550-fa208168503c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:23:24.158450 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab1164-842d-40a3-8550-fa208168503c service neutron] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:24.158726 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab1164-842d-40a3-8550-fa208168503c service neutron] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:24.158993 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab1164-842d-40a3-8550-fa208168503c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:24.160609 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-9eab1164-842d-40a3-8550-fa208168503c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:24.269039 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eab1164-842d-40a3-8550-fa208168503c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:23:24.270366 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eab1164-842d-40a3-8550-fa208168503c service neutron] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:23:24.288189 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 721/1446] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:23:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:23:26.526354 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671645f3-0729-4ca4-83c1-9f5449feaab9 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:26.526924 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671645f3-0729-4ca4-83c1-9f5449feaab9 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:26.526924 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671645f3-0729-4ca4-83c1-9f5449feaab9 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:26.528280 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 726/1447] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 01:23:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:23:26.533497 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51f913-09a0-45e2-a10f-eb7bd0a1c0f9 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:26.533945 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51f913-09a0-45e2-a10f-eb7bd0a1c0f9 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:26.534046 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51f913-09a0-45e2-a10f-eb7bd0a1c0f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:26.581660 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:23:26.600269 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-0c51f913-09a0-45e2-a10f-eb7bd0a1c0f9 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:23:26.601518 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-0c51f913-09a0-45e2-a10f-eb7bd0a1c0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:26.696579 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 722/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 01:23:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:23:26.982831 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671645f3-0729-4ca4-83c1-9f5449feaab9 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:23:26.984408 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-671645f3-0729-4ca4-83c1-9f5449feaab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:27.089721 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671645f3-0729-4ca4-83c1-9f5449feaab9 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:23:27.128851 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:23:27.162313 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113cf13c-4272-43a4-a017-e8ce34b61de6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:23:27.162914 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113cf13c-4272-43a4-a017-e8ce34b61de6 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:27.163191 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113cf13c-4272-43a4-a017-e8ce34b61de6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:27.163486 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113cf13c-4272-43a4-a017-e8ce34b61de6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:27.165645 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-113cf13c-4272-43a4-a017-e8ce34b61de6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:27.274856 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113cf13c-4272-43a4-a017-e8ce34b61de6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:23:27.276290 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113cf13c-4272-43a4-a017-e8ce34b61de6 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:23:27.294960 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 727/1449] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:23:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:23:29.340068 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0dbd0d-9682-4a3b-a63d-5d9e4db7496e None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:29.340626 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0dbd0d-9682-4a3b-a63d-5d9e4db7496e None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:29.340626 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0dbd0d-9682-4a3b-a63d-5d9e4db7496e None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:29.341968 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 723/1450] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 01:23:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:23:29.347548 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd114d-223c-45a1-a3c7-f3672e4d464f None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:29.347941 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd114d-223c-45a1-a3c7-f3672e4d464f None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:29.348136 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd114d-223c-45a1-a3c7-f3672e4d464f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:29.414825 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-4afd114d-223c-45a1-a3c7-f3672e4d464f None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:23:29.416107 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-4afd114d-223c-45a1-a3c7-f3672e4d464f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:29.436382 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:23:29.518599 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 728/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 01:23:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:23:29.808949 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0dbd0d-9682-4a3b-a63d-5d9e4db7496e None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:23:29.810496 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-8a0dbd0d-9682-4a3b-a63d-5d9e4db7496e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:29.915977 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0dbd0d-9682-4a3b-a63d-5d9e4db7496e None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:23:29.935328 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:23:29.992592 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed8583d-bdf3-443c-b4db-74530e10ab11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:23:29.993217 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed8583d-bdf3-443c-b4db-74530e10ab11 service neutron] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:29.993487 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed8583d-bdf3-443c-b4db-74530e10ab11 service neutron] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:29.993735 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed8583d-bdf3-443c-b4db-74530e10ab11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:29.996076 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-2ed8583d-bdf3-443c-b4db-74530e10ab11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:30.104643 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed8583d-bdf3-443c-b4db-74530e10ab11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:23:30.105969 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed8583d-bdf3-443c-b4db-74530e10ab11 service neutron] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:23:30.124515 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 724/1452] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:23:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:23:32.221088 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f1751-1c56-4a41-964f-7d9bb4f529ea None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:32.221658 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f1751-1c56-4a41-964f-7d9bb4f529ea None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:32.221658 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f1751-1c56-4a41-964f-7d9bb4f529ea None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:32.222970 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 729/1453] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 01:23:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:23:32.228836 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1167805-4cd9-4f16-8bae-6f49f9a47c07 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:32.229256 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1167805-4cd9-4f16-8bae-6f49f9a47c07 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:32.229383 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1167805-4cd9-4f16-8bae-6f49f9a47c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:32.293068 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:23:32.296141 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-c1167805-4cd9-4f16-8bae-6f49f9a47c07 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:23:32.297967 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-c1167805-4cd9-4f16-8bae-6f49f9a47c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:32.392348 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 725/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 01:23:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:23:32.678530 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f1751-1c56-4a41-964f-7d9bb4f529ea None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:23:32.680111 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-f07f1751-1c56-4a41-964f-7d9bb4f529ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:32.782687 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f1751-1c56-4a41-964f-7d9bb4f529ea None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:23:32.832448 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:23:32.858163 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a493e0-8e93-40a6-ad72-01916a3ab775 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:23:32.858690 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a493e0-8e93-40a6-ad72-01916a3ab775 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:32.858965 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a493e0-8e93-40a6-ad72-01916a3ab775 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:32.859235 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a493e0-8e93-40a6-ad72-01916a3ab775 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:32.860847 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-b0a493e0-8e93-40a6-ad72-01916a3ab775 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:32.967770 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a493e0-8e93-40a6-ad72-01916a3ab775 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:23:32.969292 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a493e0-8e93-40a6-ad72-01916a3ab775 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:23:32.988498 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 730/1455] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:23:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:23:34.941369 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8230a1-696c-4b60-b296-c920bbec41c2 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:34.941916 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8230a1-696c-4b60-b296-c920bbec41c2 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:34.941916 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8230a1-696c-4b60-b296-c920bbec41c2 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:34.943291 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 726/1456] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 01:23:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:23:34.949014 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a968a-519d-4027-9ab1-fe5b7f2b87fd None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:34.949502 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a968a-519d-4027-9ab1-fe5b7f2b87fd None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:34.949607 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a968a-519d-4027-9ab1-fe5b7f2b87fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:35.016140 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-971a968a-519d-4027-9ab1-fe5b7f2b87fd None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:23:35.017363 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-971a968a-519d-4027-9ab1-fe5b7f2b87fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:35.045985 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:23:35.115166 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 731/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 01:23:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:23:35.400343 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8230a1-696c-4b60-b296-c920bbec41c2 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:23:35.401860 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-fc8230a1-696c-4b60-b296-c920bbec41c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:35.505106 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8230a1-696c-4b60-b296-c920bbec41c2 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:23:35.533239 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:23:35.579602 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4b1335-6abf-47b3-8e96-e99d0e5680ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:23:35.580214 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b1335-6abf-47b3-8e96-e99d0e5680ad service neutron] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:35.580489 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b1335-6abf-47b3-8e96-e99d0e5680ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:35.580758 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b1335-6abf-47b3-8e96-e99d0e5680ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:35.582365 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-8f4b1335-6abf-47b3-8e96-e99d0e5680ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:35.692250 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4b1335-6abf-47b3-8e96-e99d0e5680ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:23:35.693680 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4b1335-6abf-47b3-8e96-e99d0e5680ad service neutron] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:23:35.721468 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 727/1458] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:23:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:23:37.784276 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135b2e4-1665-4abe-80c5-b0226dff506b None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:37.784835 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135b2e4-1665-4abe-80c5-b0226dff506b None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:37.784835 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135b2e4-1665-4abe-80c5-b0226dff506b None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:37.786157 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 732/1459] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 01:23:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:23:37.792154 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c43c4-89b0-4097-81ab-2ec4e6da4e19 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:37.792586 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c43c4-89b0-4097-81ab-2ec4e6da4e19 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:37.792686 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c43c4-89b0-4097-81ab-2ec4e6da4e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:37.859608 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-181c43c4-89b0-4097-81ab-2ec4e6da4e19 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:23:37.860710 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-181c43c4-89b0-4097-81ab-2ec4e6da4e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:37.868766 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:23:37.962660 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 728/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 01:23:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:23:38.245523 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c135b2e4-1665-4abe-80c5-b0226dff506b None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:23:38.247050 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-c135b2e4-1665-4abe-80c5-b0226dff506b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:38.351391 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c135b2e4-1665-4abe-80c5-b0226dff506b None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:23:38.405319 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:23:38.423188 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d3985b-fca1-4557-86dd-6f952b7ea3c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:23:38.423812 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3985b-fca1-4557-86dd-6f952b7ea3c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:38.424084 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3985b-fca1-4557-86dd-6f952b7ea3c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:38.424352 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3985b-fca1-4557-86dd-6f952b7ea3c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:38.425916 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-91d3985b-fca1-4557-86dd-6f952b7ea3c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:38.533746 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d3985b-fca1-4557-86dd-6f952b7ea3c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:23:38.535099 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d3985b-fca1-4557-86dd-6f952b7ea3c2 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:23:38.552672 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 733/1461] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:23:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:23:40.518500 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395d226-169f-4804-b0df-f4a11e2d4d61 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:40.519052 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395d226-169f-4804-b0df-f4a11e2d4d61 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:40.519052 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395d226-169f-4804-b0df-f4a11e2d4d61 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:40.520461 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 729/1462] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 01:23:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:23:40.526530 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681155a1-968a-407b-a274-ad0229a301fa None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:40.526967 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681155a1-968a-407b-a274-ad0229a301fa None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:40.527118 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681155a1-968a-407b-a274-ad0229a301fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:40.596888 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-681155a1-968a-407b-a274-ad0229a301fa None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:23:40.598342 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-681155a1-968a-407b-a274-ad0229a301fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:40.636934 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:23:40.694208 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 734/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 01:23:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:23:40.980587 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3395d226-169f-4804-b0df-f4a11e2d4d61 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:23:40.982113 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-3395d226-169f-4804-b0df-f4a11e2d4d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:41.083409 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3395d226-169f-4804-b0df-f4a11e2d4d61 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:23:41.124101 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:23:41.159675 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c43550-0724-49f7-baf7-8b5de0dc71e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:23:41.160285 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c43550-0724-49f7-baf7-8b5de0dc71e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:41.160559 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c43550-0724-49f7-baf7-8b5de0dc71e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:41.160824 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c43550-0724-49f7-baf7-8b5de0dc71e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:41.162417 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-68c43550-0724-49f7-baf7-8b5de0dc71e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:41.275882 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c43550-0724-49f7-baf7-8b5de0dc71e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:23:41.277234 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c43550-0724-49f7-baf7-8b5de0dc71e4 service neutron] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:23:41.295299 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 730/1464] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:23:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:23:43.223403 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b0d12-6ba1-43ff-bf22-c97143e7da0d None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:43.223923 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b0d12-6ba1-43ff-bf22-c97143e7da0d None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:43.224031 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b0d12-6ba1-43ff-bf22-c97143e7da0d None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:43.225340 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 735/1465] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 01:23:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:23:43.231082 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d814f5-94fd-466d-8b7d-f60f80c557f6 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:43.231526 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d814f5-94fd-466d-8b7d-f60f80c557f6 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:43.231653 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d814f5-94fd-466d-8b7d-f60f80c557f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:43.297206 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-90d814f5-94fd-466d-8b7d-f60f80c557f6 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:23:43.298395 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-90d814f5-94fd-466d-8b7d-f60f80c557f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:43.316503 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:23:43.394086 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 731/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 01:23:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:23:43.685964 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b0d12-6ba1-43ff-bf22-c97143e7da0d None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:23:43.687505 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-9c8b0d12-6ba1-43ff-bf22-c97143e7da0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:43.814594 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b0d12-6ba1-43ff-bf22-c97143e7da0d None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:23:43.895044 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:23:43.902227 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c21c274-0aa6-4396-9645-537e614976c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:23:43.902833 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21c274-0aa6-4396-9645-537e614976c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:43.903113 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21c274-0aa6-4396-9645-537e614976c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:43.903382 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21c274-0aa6-4396-9645-537e614976c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:43.905008 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-2c21c274-0aa6-4396-9645-537e614976c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:44.034072 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c21c274-0aa6-4396-9645-537e614976c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:23:44.035551 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c21c274-0aa6-4396-9645-537e614976c8 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:23:44.058429 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 736/1467] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:23:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:23:46.041758 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f7c1d-a942-4940-b5d5-7d0db33d34ee None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:46.042368 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f7c1d-a942-4940-b5d5-7d0db33d34ee None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:46.042368 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f7c1d-a942-4940-b5d5-7d0db33d34ee None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:46.043727 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 732/1468] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 01:23:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:23:46.048893 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae3fe0b-dfc5-4728-a0e0-96dc3a772eb1 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:46.049298 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae3fe0b-dfc5-4728-a0e0-96dc3a772eb1 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:46.049449 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae3fe0b-dfc5-4728-a0e0-96dc3a772eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:46.117514 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-eae3fe0b-dfc5-4728-a0e0-96dc3a772eb1 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:23:46.118710 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-eae3fe0b-dfc5-4728-a0e0-96dc3a772eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:46.166335 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:23:46.214862 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 737/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 01:23:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:23:46.497597 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383f7c1d-a942-4940-b5d5-7d0db33d34ee None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:23:46.499167 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-383f7c1d-a942-4940-b5d5-7d0db33d34ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:46.605186 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383f7c1d-a942-4940-b5d5-7d0db33d34ee None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:23:46.651725 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:23:46.678142 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b5b359-5429-4b02-9806-cec7fba2c531 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:23:46.678773 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5b359-5429-4b02-9806-cec7fba2c531 service neutron] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:23:46.679051 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5b359-5429-4b02-9806-cec7fba2c531 service neutron] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:23:46.679323 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5b359-5429-4b02-9806-cec7fba2c531 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:23:46.680946 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-48b5b359-5429-4b02-9806-cec7fba2c531 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:23:46.789571 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b5b359-5429-4b02-9806-cec7fba2c531 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:23:46.790929 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b5b359-5429-4b02-9806-cec7fba2c531 service neutron] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:23:46.808728 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 733/1470] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:23:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:23:56.212884 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=22 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:23:56.806421 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=66 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:24:07.183630 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c4238-52c1-4825-81ed-36bf2981d908 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:07.184182 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c4238-52c1-4825-81ed-36bf2981d908 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:07.184182 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c4238-52c1-4825-81ed-36bf2981d908 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:07.185555 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 738/1471] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:24:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:24:07.190703 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bbd410-5cb1-49cc-8d4e-35332c9cc893 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:07.191110 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bbd410-5cb1-49cc-8d4e-35332c9cc893 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:07.191243 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bbd410-5cb1-49cc-8d4e-35332c9cc893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:07.256992 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-c9bbd410-5cb1-49cc-8d4e-35332c9cc893 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:24:07.258346 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-c9bbd410-5cb1-49cc-8d4e-35332c9cc893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:24:07.354442 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 734/1472] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:24:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:24:07.650806 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7589935-5a3d-4a8a-bee5-014b02f71ad4 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:07.651092 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7589935-5a3d-4a8a-bee5-014b02f71ad4 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:07.651367 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7589935-5a3d-4a8a-bee5-014b02f71ad4 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:07.652742 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 739/1473] 10.222.0.60 () {54 vars in 967 bytes} [Tue Aug 30 01:24:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:24:07.657533 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436cf8b0-c777-427d-83e7-2745b0f47f00 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:07.657816 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436cf8b0-c777-427d-83e7-2745b0f47f00 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:07.658085 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436cf8b0-c777-427d-83e7-2745b0f47f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:07.732353 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-436cf8b0-c777-427d-83e7-2745b0f47f00 None None] MFA Rules not processed for user `2de6decc90df4df58217d5eed9c5e190`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:24:07.733540 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-436cf8b0-c777-427d-83e7-2745b0f47f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:24:07.753668 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:24:07.809135 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 735/1474] 10.222.0.60 () {58 vars in 1064 bytes} [Tue Aug 30 01:24:07 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:24:07.816764 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7589935-5a3d-4a8a-bee5-014b02f71ad4 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:24:07.818249 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-c7589935-5a3d-4a8a-bee5-014b02f71ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:24:07.920440 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7589935-5a3d-4a8a-bee5-014b02f71ad4 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:24:07.993546 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef72c773-9cee-4234-b7a2-7203638816fb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2de6decc90df4df58217d5eed9c5e190', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:24:07.994141 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72c773-9cee-4234-b7a2-7203638816fb service glance] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:07.994413 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72c773-9cee-4234-b7a2-7203638816fb service glance] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:07.994676 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72c773-9cee-4234-b7a2-7203638816fb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:07.996284 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-ef72c773-9cee-4234-b7a2-7203638816fb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:24:08.050124 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:24:08.105151 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef72c773-9cee-4234-b7a2-7203638816fb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:24:08.106598 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef72c773-9cee-4234-b7a2-7203638816fb service glance] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:24:08.125362 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 740/1475] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:24:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:24:10.137459 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637780e-d5d3-421f-baa4-781db8dbdfc7 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:10.138035 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637780e-d5d3-421f-baa4-781db8dbdfc7 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:10.138035 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637780e-d5d3-421f-baa4-781db8dbdfc7 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:10.139357 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 736/1476] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:24:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:24:10.144671 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2118c74-5c13-438f-a173-0c82b8e50620 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:10.145118 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2118c74-5c13-438f-a173-0c82b8e50620 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:10.145217 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2118c74-5c13-438f-a173-0c82b8e50620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:10.213143 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-b2118c74-5c13-438f-a173-0c82b8e50620 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:24:10.214607 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-b2118c74-5c13-438f-a173-0c82b8e50620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:24:10.312410 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 741/1477] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:24:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:24:10.588227 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e637780e-d5d3-421f-baa4-781db8dbdfc7 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:24:10.589934 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-e637780e-d5d3-421f-baa4-781db8dbdfc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:24:10.715330 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e637780e-d5d3-421f-baa4-781db8dbdfc7 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:24:10.763518 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:24:10.807801 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c78f70e-ad41-48f2-af92-fb959e899ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:24:10.808416 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78f70e-ad41-48f2-af92-fb959e899ede admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:10.808690 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78f70e-ad41-48f2-af92-fb959e899ede admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:10.808954 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78f70e-ad41-48f2-af92-fb959e899ede admin admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:10.809584 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c78f70e-ad41-48f2-af92-fb959e899ede admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:24:10.811295 dv-cinder-819668-6-smb devstack@keystone.service[81447]: WARNING py.warnings [None req-2c78f70e-ad41-48f2-af92-fb959e899ede admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 01:24:10.811295 dv-cinder-819668-6-smb devstack@keystone.service[81447]: warnings.warn(msg) Aug 30 01:24:10.811295 dv-cinder-819668-6-smb devstack@keystone.service[81447]: Aug 30 01:24:10.812455 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c78f70e-ad41-48f2-af92-fb959e899ede admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:24:10.830567 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 737/1478] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 30 01:24:10 2022] GET /identity/v3/projects => generated 2553 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:24:12.742700 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755d9ec-5d6e-4a99-a163-d6defa889965 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:12.743266 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755d9ec-5d6e-4a99-a163-d6defa889965 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:12.743266 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755d9ec-5d6e-4a99-a163-d6defa889965 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:12.744621 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 742/1479] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:24:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:24:12.749882 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865193aa-efcf-4813-81e2-5a6797b87a19 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:12.750263 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865193aa-efcf-4813-81e2-5a6797b87a19 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:12.750423 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865193aa-efcf-4813-81e2-5a6797b87a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:12.814748 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-865193aa-efcf-4813-81e2-5a6797b87a19 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:24:12.815971 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-865193aa-efcf-4813-81e2-5a6797b87a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:24:12.910864 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 738/1480] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:24:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:24:13.201041 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4755d9ec-5d6e-4a99-a163-d6defa889965 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:24:13.202711 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-4755d9ec-5d6e-4a99-a163-d6defa889965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:24:13.213611 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:24:13.351727 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4755d9ec-5d6e-4a99-a163-d6defa889965 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:24:13.429792 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:24:13.465160 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f92d2a3-068b-4247-9a8c-94253227245c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8889145228a24fb6bd539a11925e62f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:24:13.466113 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92d2a3-068b-4247-9a8c-94253227245c service nova] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:13.466600 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92d2a3-068b-4247-9a8c-94253227245c service nova] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:13.466900 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92d2a3-068b-4247-9a8c-94253227245c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:13.468573 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-9f92d2a3-068b-4247-9a8c-94253227245c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:24:13.558893 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f92d2a3-068b-4247-9a8c-94253227245c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:24:13.560532 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f92d2a3-068b-4247-9a8c-94253227245c service nova] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:24:13.578675 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 743/1481] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:24:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:24:15.677309 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5bf30-1c5b-423a-8eed-9370dce3356b None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:15.677884 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5bf30-1c5b-423a-8eed-9370dce3356b None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:15.677884 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5bf30-1c5b-423a-8eed-9370dce3356b None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:15.679817 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 739/1482] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:24:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:24:15.684959 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d014f7b1-0a5f-4747-aa5a-1d8bb5314b14 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:15.685379 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d014f7b1-0a5f-4747-aa5a-1d8bb5314b14 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:15.685509 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d014f7b1-0a5f-4747-aa5a-1d8bb5314b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:15.754541 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-d014f7b1-0a5f-4747-aa5a-1d8bb5314b14 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:24:15.755808 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-d014f7b1-0a5f-4747-aa5a-1d8bb5314b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:24:15.802167 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:24:15.854305 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 744/1483] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:24:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:24:16.140773 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5bf30-1c5b-423a-8eed-9370dce3356b None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:24:16.142304 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-e1f5bf30-1c5b-423a-8eed-9370dce3356b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:24:16.165562 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:24:16.246296 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5bf30-1c5b-423a-8eed-9370dce3356b None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:24:16.327281 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13886d79-7751-4294-bfa3-ebc81c9e2971 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:24:16.327918 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13886d79-7751-4294-bfa3-ebc81c9e2971 service neutron] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:16.328198 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13886d79-7751-4294-bfa3-ebc81c9e2971 service neutron] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:16.328469 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13886d79-7751-4294-bfa3-ebc81c9e2971 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:16.330065 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-13886d79-7751-4294-bfa3-ebc81c9e2971 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:24:16.404549 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:24:16.439571 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13886d79-7751-4294-bfa3-ebc81c9e2971 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:24:16.440998 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13886d79-7751-4294-bfa3-ebc81c9e2971 service neutron] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:24:16.459066 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 740/1484] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:24:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:24:18.430862 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e03b8b-8b36-4aeb-a04b-28ba3f694bdd None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:18.431424 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e03b8b-8b36-4aeb-a04b-28ba3f694bdd None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:18.431424 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e03b8b-8b36-4aeb-a04b-28ba3f694bdd None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:18.432763 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 745/1485] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:24:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:24:18.438140 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41564f3-24f1-4226-96a5-36c23635108c None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:18.438569 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41564f3-24f1-4226-96a5-36c23635108c None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:18.438678 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41564f3-24f1-4226-96a5-36c23635108c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:18.505268 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-f41564f3-24f1-4226-96a5-36c23635108c None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:24:18.506481 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-f41564f3-24f1-4226-96a5-36c23635108c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:24:18.605513 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 741/1486] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:24:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:24:18.894814 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e03b8b-8b36-4aeb-a04b-28ba3f694bdd None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:24:18.897291 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-e6e03b8b-8b36-4aeb-a04b-28ba3f694bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:24:19.001094 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e03b8b-8b36-4aeb-a04b-28ba3f694bdd None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:24:19.070848 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:24:19.072721 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61350ca-d1cd-48dc-8c6d-b59bca72d439 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:24:19.073322 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61350ca-d1cd-48dc-8c6d-b59bca72d439 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:19.073790 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61350ca-d1cd-48dc-8c6d-b59bca72d439 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:19.074229 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61350ca-d1cd-48dc-8c6d-b59bca72d439 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:19.076000 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-d61350ca-d1cd-48dc-8c6d-b59bca72d439 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:24:19.183659 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61350ca-d1cd-48dc-8c6d-b59bca72d439 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:24:19.185022 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61350ca-d1cd-48dc-8c6d-b59bca72d439 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:24:19.203457 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 746/1487] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:24:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:24:21.213942 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933beb98-8de9-4f80-a7f6-2606c45c5ad5 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:21.214559 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933beb98-8de9-4f80-a7f6-2606c45c5ad5 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:21.214559 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933beb98-8de9-4f80-a7f6-2606c45c5ad5 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:21.215871 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 742/1488] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:24:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:24:21.221088 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ba483-3681-4593-8284-a67b84c9535f None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:21.221522 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ba483-3681-4593-8284-a67b84c9535f None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:21.221620 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ba483-3681-4593-8284-a67b84c9535f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:21.287262 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-0f4ba483-3681-4593-8284-a67b84c9535f None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:24:21.288567 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-0f4ba483-3681-4593-8284-a67b84c9535f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:24:21.344737 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:24:21.389331 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 747/1489] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:24:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:24:21.680843 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933beb98-8de9-4f80-a7f6-2606c45c5ad5 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:24:21.682653 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-933beb98-8de9-4f80-a7f6-2606c45c5ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:24:21.720147 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:24:21.788536 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933beb98-8de9-4f80-a7f6-2606c45c5ad5 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:24:21.862212 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b484dfcf-d0dc-4da9-befa-14cbfd836dfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:24:21.862733 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b484dfcf-d0dc-4da9-befa-14cbfd836dfc service neutron] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:21.863007 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b484dfcf-d0dc-4da9-befa-14cbfd836dfc service neutron] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:21.863275 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b484dfcf-d0dc-4da9-befa-14cbfd836dfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:21.864886 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-b484dfcf-d0dc-4da9-befa-14cbfd836dfc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:24:21.943930 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:24:21.973751 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b484dfcf-d0dc-4da9-befa-14cbfd836dfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:24:21.975168 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b484dfcf-d0dc-4da9-befa-14cbfd836dfc service neutron] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:24:21.993911 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 743/1490] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:24:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:24:24.133227 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ccf3d-b72c-45ac-b524-f0686b9d1e0b None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:24.133784 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ccf3d-b72c-45ac-b524-f0686b9d1e0b None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:24.133784 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ccf3d-b72c-45ac-b524-f0686b9d1e0b None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:24.135093 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 748/1491] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 30 01:24:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:24:24.140253 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0655363-122c-4868-9f5f-e186079a891a None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:24.140685 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0655363-122c-4868-9f5f-e186079a891a None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:24.140791 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0655363-122c-4868-9f5f-e186079a891a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:24.209271 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-f0655363-122c-4868-9f5f-e186079a891a None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:24:24.211035 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-f0655363-122c-4868-9f5f-e186079a891a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:24:24.304901 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 744/1492] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 30 01:24:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:24:24.595572 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ccf3d-b72c-45ac-b524-f0686b9d1e0b None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:24:24.597113 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-067ccf3d-b72c-45ac-b524-f0686b9d1e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:24:24.701151 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ccf3d-b72c-45ac-b524-f0686b9d1e0b None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:24:24.774841 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01a1ccd-9549-4c17-96ef-a3362fd71f83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:24:24.775455 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a1ccd-9549-4c17-96ef-a3362fd71f83 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:24:24.775807 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a1ccd-9549-4c17-96ef-a3362fd71f83 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:24:24.776106 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a1ccd-9549-4c17-96ef-a3362fd71f83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:24:24.777730 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-e01a1ccd-9549-4c17-96ef-a3362fd71f83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:24:24.786755 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:24:24.909650 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01a1ccd-9549-4c17-96ef-a3362fd71f83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:24:24.911726 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01a1ccd-9549-4c17-96ef-a3362fd71f83 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:24:24.935442 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 749/1493] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:24:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:24:34.302975 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=82 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:24:34.933060 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=50 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:25:49.846404 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66fc8e-df6d-4195-a683-5fced342ba5f None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:49.846994 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66fc8e-df6d-4195-a683-5fced342ba5f None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:49.846994 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66fc8e-df6d-4195-a683-5fced342ba5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:49.927163 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-ad66fc8e-df6d-4195-a683-5fced342ba5f None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:25:49.928403 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-ad66fc8e-df6d-4195-a683-5fced342ba5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:25:50.024509 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 745/1494] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:25:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:25:50.032599 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476980c3-988d-4048-be47-8332987654b0 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:50.033084 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476980c3-988d-4048-be47-8332987654b0 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:50.033191 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476980c3-988d-4048-be47-8332987654b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:50.107915 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-476980c3-988d-4048-be47-8332987654b0 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:25:50.109099 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-476980c3-988d-4048-be47-8332987654b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:25:50.204658 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 750/1495] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:25:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:25:50.209914 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad66fc8e-df6d-4195-a683-5fced342ba5f None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:50.211118 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-ad66fc8e-df6d-4195-a683-5fced342ba5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:25:50.222753 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad66fc8e-df6d-4195-a683-5fced342ba5f None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:50.285049 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:25:50.320846 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9635d8-7b70-4537-b626-28981ea356d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:50.321456 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9635d8-7b70-4537-b626-28981ea356d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:50.321729 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9635d8-7b70-4537-b626-28981ea356d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:50.321994 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9635d8-7b70-4537-b626-28981ea356d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:50.322631 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9635d8-7b70-4537-b626-28981ea356d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:25:50.322932 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9635d8-7b70-4537-b626-28981ea356d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:50.323975 dv-cinder-819668-6-smb devstack@keystone.service[81447]: WARNING py.warnings [None req-ec9635d8-7b70-4537-b626-28981ea356d4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 01:25:50.323975 dv-cinder-819668-6-smb devstack@keystone.service[81447]: warnings.warn(msg) Aug 30 01:25:50.323975 dv-cinder-819668-6-smb devstack@keystone.service[81447]: Aug 30 01:25:50.324864 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9635d8-7b70-4537-b626-28981ea356d4 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:50.336006 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 746/1496] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 30 01:25:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:25:50.344524 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476980c3-988d-4048-be47-8332987654b0 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:50.353707 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476980c3-988d-4048-be47-8332987654b0 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:50.414077 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:25:50.449000 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0fdd6f-7e36-4a72-afad-d8b37bf2b10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:50.449597 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0fdd6f-7e36-4a72-afad-d8b37bf2b10d admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:50.449874 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0fdd6f-7e36-4a72-afad-d8b37bf2b10d admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:50.450147 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0fdd6f-7e36-4a72-afad-d8b37bf2b10d admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:50.450764 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0fdd6f-7e36-4a72-afad-d8b37bf2b10d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:50.452550 dv-cinder-819668-6-smb devstack@keystone.service[81446]: WARNING py.warnings [None req-0f0fdd6f-7e36-4a72-afad-d8b37bf2b10d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 01:25:50.452550 dv-cinder-819668-6-smb devstack@keystone.service[81446]: warnings.warn(msg) Aug 30 01:25:50.452550 dv-cinder-819668-6-smb devstack@keystone.service[81446]: Aug 30 01:25:50.453742 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0fdd6f-7e36-4a72-afad-d8b37bf2b10d admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:50.509679 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 751/1497] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:25:50 2022] POST /identity/v3/projects => generated 379 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:25:50.513823 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9635d8-7b70-4537-b626-28981ea356d4 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:50.515447 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-ec9635d8-7b70-4537-b626-28981ea356d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:25:50.549091 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9635d8-7b70-4537-b626-28981ea356d4 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:50.644576 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80911627-b51a-4a33-af43-b3c9050d3b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:50.645190 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80911627-b51a-4a33-af43-b3c9050d3b81 admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:50.645467 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80911627-b51a-4a33-af43-b3c9050d3b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:50.645736 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80911627-b51a-4a33-af43-b3c9050d3b81 admin admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:50.646373 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80911627-b51a-4a33-af43-b3c9050d3b81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:50.647380 dv-cinder-819668-6-smb devstack@keystone.service[81447]: WARNING py.warnings [None req-80911627-b51a-4a33-af43-b3c9050d3b81 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 01:25:50.647380 dv-cinder-819668-6-smb devstack@keystone.service[81447]: warnings.warn(msg) Aug 30 01:25:50.647380 dv-cinder-819668-6-smb devstack@keystone.service[81447]: Aug 30 01:25:50.648617 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80911627-b51a-4a33-af43-b3c9050d3b81 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:50.690688 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 747/1498] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:25:50 2022] POST /identity/v3/users => generated 290 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:25:50.694978 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0fdd6f-7e36-4a72-afad-d8b37bf2b10d admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:50.696517 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-0f0fdd6f-7e36-4a72-afad-d8b37bf2b10d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:25:50.758930 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0fdd6f-7e36-4a72-afad-d8b37bf2b10d admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:50.845155 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:25:50.859923 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da534af-7043-4bd0-a718-16d711e906a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:50.860586 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da534af-7043-4bd0-a718-16d711e906a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:50.860930 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da534af-7043-4bd0-a718-16d711e906a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:50.861196 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da534af-7043-4bd0-a718-16d711e906a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:50.861879 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da534af-7043-4bd0-a718-16d711e906a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:50.863032 dv-cinder-819668-6-smb devstack@keystone.service[81446]: WARNING py.warnings [None req-5da534af-7043-4bd0-a718-16d711e906a6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 01:25:50.863032 dv-cinder-819668-6-smb devstack@keystone.service[81446]: warnings.warn(msg) Aug 30 01:25:50.863032 dv-cinder-819668-6-smb devstack@keystone.service[81446]: Aug 30 01:25:50.863998 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da534af-7043-4bd0-a718-16d711e906a6 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:50.877657 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 752/1499] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:25:50 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:25:50.881883 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80911627-b51a-4a33-af43-b3c9050d3b81 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:50.883380 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-80911627-b51a-4a33-af43-b3c9050d3b81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:25:50.894439 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80911627-b51a-4a33-af43-b3c9050d3b81 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:50.919296 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:25:50.994671 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb44b8a-8057-47da-a957-f27f01912b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:50.995281 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb44b8a-8057-47da-a957-f27f01912b04 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:50.995595 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb44b8a-8057-47da-a957-f27f01912b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:50.995868 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb44b8a-8057-47da-a957-f27f01912b04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:50.996506 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb44b8a-8057-47da-a957-f27f01912b04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:50.997526 dv-cinder-819668-6-smb devstack@keystone.service[81447]: WARNING py.warnings [None req-cbb44b8a-8057-47da-a957-f27f01912b04 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 01:25:50.997526 dv-cinder-819668-6-smb devstack@keystone.service[81447]: warnings.warn(msg) Aug 30 01:25:50.997526 dv-cinder-819668-6-smb devstack@keystone.service[81447]: Aug 30 01:25:50.998411 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb44b8a-8057-47da-a957-f27f01912b04 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:51.010602 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 748/1500] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:25:50 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:25:51.014786 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da534af-7043-4bd0-a718-16d711e906a6 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:51.016327 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-5da534af-7043-4bd0-a718-16d711e906a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:25:51.050069 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da534af-7043-4bd0-a718-16d711e906a6 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:51.145005 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf0f11f-2e1f-439a-aa46-a0f239b94a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:51.145675 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0f11f-2e1f-439a-aa46-a0f239b94a75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:51.146459 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0f11f-2e1f-439a-aa46-a0f239b94a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:51.146730 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0f11f-2e1f-439a-aa46-a0f239b94a75 admin admin] PATH_INFO: `/v3/projects/15e72eb546444cf6b44abce41a4fa3a5/users/1fdc4cf1f7b2407892dd6d0f51e38a6c/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:51.169157 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf0f11f-2e1f-439a-aa46-a0f239b94a75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15e72eb546444cf6b44abce41a4fa3a5, user_id=1fdc4cf1f7b2407892dd6d0f51e38a6c, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:51.170195 dv-cinder-819668-6-smb devstack@keystone.service[81446]: WARNING py.warnings [None req-edf0f11f-2e1f-439a-aa46-a0f239b94a75 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 01:25:51.170195 dv-cinder-819668-6-smb devstack@keystone.service[81446]: warnings.warn(msg) Aug 30 01:25:51.170195 dv-cinder-819668-6-smb devstack@keystone.service[81446]: Aug 30 01:25:51.172195 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf0f11f-2e1f-439a-aa46-a0f239b94a75 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:51.196062 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 753/1501] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:25:51 2022] PUT /identity/v3/projects/15e72eb546444cf6b44abce41a4fa3a5/users/1fdc4cf1f7b2407892dd6d0f51e38a6c/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:25:51.208279 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1a4a5-0ef9-4f6d-9669-f023c678217c None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:51.209072 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1a4a5-0ef9-4f6d-9669-f023c678217c None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:51.209343 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1a4a5-0ef9-4f6d-9669-f023c678217c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:51.266112 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-51e1a4a5-0ef9-4f6d-9669-f023c678217c None None] MFA Rules not processed for user `1fdc4cf1f7b2407892dd6d0f51e38a6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:25:51.267322 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-51e1a4a5-0ef9-4f6d-9669-f023c678217c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:25:51.345113 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 749/1502] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:25:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:25:51.358694 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce821f-7a63-40d4-ba31-d3046c4effee None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:51.358983 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce821f-7a63-40d4-ba31-d3046c4effee None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:51.359258 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce821f-7a63-40d4-ba31-d3046c4effee None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:51.360686 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 754/1503] 10.222.0.60 () {54 vars in 964 bytes} [Tue Aug 30 01:25:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:25:51.365710 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50596474-53c2-4e9e-95da-2d187733dc5e None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:51.365997 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50596474-53c2-4e9e-95da-2d187733dc5e None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:51.366271 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50596474-53c2-4e9e-95da-2d187733dc5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:51.398674 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:25:51.445750 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-50596474-53c2-4e9e-95da-2d187733dc5e None None] MFA Rules not processed for user `e3040f72d52249f1b0e19e3a200bd16e`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:25:51.446949 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-50596474-53c2-4e9e-95da-2d187733dc5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:25:51.520545 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 750/1504] 10.222.0.60 () {58 vars in 1061 bytes} [Tue Aug 30 01:25:51 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:25:51.528768 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce821f-7a63-40d4-ba31-d3046c4effee None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:51.530256 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-89ce821f-7a63-40d4-ba31-d3046c4effee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:25:51.580244 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:25:51.635926 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce821f-7a63-40d4-ba31-d3046c4effee None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:51.709960 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033cb27f-cbe9-4c0d-addd-fed8e54f8ff7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:51.710481 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033cb27f-cbe9-4c0d-addd-fed8e54f8ff7 service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:51.710753 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033cb27f-cbe9-4c0d-addd-fed8e54f8ff7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:51.711019 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033cb27f-cbe9-4c0d-addd-fed8e54f8ff7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:51.712611 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-033cb27f-cbe9-4c0d-addd-fed8e54f8ff7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:25:51.809884 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033cb27f-cbe9-4c0d-addd-fed8e54f8ff7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:51.811334 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033cb27f-cbe9-4c0d-addd-fed8e54f8ff7 service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:51.814810 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:25:51.829734 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 755/1505] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:25:51 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:25:51.875846 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75622c-0481-46b2-8679-f2dd8f72e995 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:51.876138 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75622c-0481-46b2-8679-f2dd8f72e995 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:51.876432 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75622c-0481-46b2-8679-f2dd8f72e995 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:51.877697 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 751/1506] 10.222.0.60 () {52 vars in 830 bytes} [Tue Aug 30 01:25:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:25:51.881915 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033cb27f-cbe9-4c0d-addd-fed8e54f8ff7 service cinder] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:51.883120 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-033cb27f-cbe9-4c0d-addd-fed8e54f8ff7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:25:51.981010 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033cb27f-cbe9-4c0d-addd-fed8e54f8ff7 service cinder] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:52.075343 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a35528-098b-459e-aa9b-022ef97e4cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:52.076062 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a35528-098b-459e-aa9b-022ef97e4cce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:52.076285 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a35528-098b-459e-aa9b-022ef97e4cce admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:52.076557 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a35528-098b-459e-aa9b-022ef97e4cce admin admin] PATH_INFO: `/v3/users/1fdc4cf1f7b2407892dd6d0f51e38a6c` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:52.089189 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a35528-098b-459e-aa9b-022ef97e4cce admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fdc4cf1f7b2407892dd6d0f51e38a6c)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:52.090227 dv-cinder-819668-6-smb devstack@keystone.service[81446]: WARNING py.warnings [None req-64a35528-098b-459e-aa9b-022ef97e4cce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 01:25:52.090227 dv-cinder-819668-6-smb devstack@keystone.service[81446]: warnings.warn(msg) Aug 30 01:25:52.090227 dv-cinder-819668-6-smb devstack@keystone.service[81446]: Aug 30 01:25:52.091517 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a35528-098b-459e-aa9b-022ef97e4cce admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:52.101245 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:25:52.157117 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-64a35528-098b-459e-aa9b-022ef97e4cce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fdc4cf1f7b2407892dd6d0f51e38a6c'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:52.166570 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-64a35528-098b-459e-aa9b-022ef97e4cce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fdc4cf1f7b2407892dd6d0f51e38a6c'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:52.167068 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-64a35528-098b-459e-aa9b-022ef97e4cce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fdc4cf1f7b2407892dd6d0f51e38a6c'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:52.190740 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-64a35528-098b-459e-aa9b-022ef97e4cce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fdc4cf1f7b2407892dd6d0f51e38a6c'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:52.191204 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-64a35528-098b-459e-aa9b-022ef97e4cce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fdc4cf1f7b2407892dd6d0f51e38a6c'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:52.211462 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 756/1507] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:25:51 2022] DELETE /identity/v3/users/1fdc4cf1f7b2407892dd6d0f51e38a6c => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:25:52.216264 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0414eb-8c82-4657-bb63-072bf1c800ac None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:52.216760 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0414eb-8c82-4657-bb63-072bf1c800ac None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:52.216872 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0414eb-8c82-4657-bb63-072bf1c800ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:52.273924 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-cf0414eb-8c82-4657-bb63-072bf1c800ac None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:25:52.275050 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-cf0414eb-8c82-4657-bb63-072bf1c800ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:25:52.349676 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:25:52.362662 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 752/1508] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:25:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:25:52.373224 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a35528-098b-459e-aa9b-022ef97e4cce admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:52.374462 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-64a35528-098b-459e-aa9b-022ef97e4cce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:25:52.596743 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a35528-098b-459e-aa9b-022ef97e4cce admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:52.651885 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:25:52.672483 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c675bc-158a-49f4-a6bc-36143e18df5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:52.673095 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c675bc-158a-49f4-a6bc-36143e18df5a service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:52.673376 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c675bc-158a-49f4-a6bc-36143e18df5a service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:52.673650 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c675bc-158a-49f4-a6bc-36143e18df5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:52.675260 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-91c675bc-158a-49f4-a6bc-36143e18df5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:25:52.782019 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c675bc-158a-49f4-a6bc-36143e18df5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:52.783482 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c675bc-158a-49f4-a6bc-36143e18df5a service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:52.802581 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 757/1509] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:25:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:25:53.190755 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0414eb-8c82-4657-bb63-072bf1c800ac None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:25:53.192025 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-cf0414eb-8c82-4657-bb63-072bf1c800ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:25:53.204628 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0414eb-8c82-4657-bb63-072bf1c800ac None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:25:53.304469 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e224e-e5fb-419e-b206-c7dd1badef3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:25:53.305163 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e224e-e5fb-419e-b206-c7dd1badef3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:25:53.305467 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e224e-e5fb-419e-b206-c7dd1badef3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:25:53.305737 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e224e-e5fb-419e-b206-c7dd1badef3d admin admin] PATH_INFO: `/v3/projects/15e72eb546444cf6b44abce41a4fa3a5` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:25:53.315794 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81e224e-e5fb-419e-b206-c7dd1badef3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=15e72eb546444cf6b44abce41a4fa3a5)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:25:53.316824 dv-cinder-819668-6-smb devstack@keystone.service[81447]: WARNING py.warnings [None req-e81e224e-e5fb-419e-b206-c7dd1badef3d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 01:25:53.316824 dv-cinder-819668-6-smb devstack@keystone.service[81447]: warnings.warn(msg) Aug 30 01:25:53.316824 dv-cinder-819668-6-smb devstack@keystone.service[81447]: Aug 30 01:25:53.318708 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81e224e-e5fb-419e-b206-c7dd1badef3d admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:25:53.377127 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-e81e224e-e5fb-419e-b206-c7dd1badef3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15e72eb546444cf6b44abce41a4fa3a5', 'request_id': 'req-e81e224e-e5fb-419e-b206-c7dd1badef3d'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:53.390708 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-e81e224e-e5fb-419e-b206-c7dd1badef3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15e72eb546444cf6b44abce41a4fa3a5', 'request_id': 'req-e81e224e-e5fb-419e-b206-c7dd1badef3d'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:53.400444 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-e81e224e-e5fb-419e-b206-c7dd1badef3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15e72eb546444cf6b44abce41a4fa3a5', 'request_id': 'req-e81e224e-e5fb-419e-b206-c7dd1badef3d'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:53.422220 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-e81e224e-e5fb-419e-b206-c7dd1badef3d admin admin] The token cache is being invalidate because project 15e72eb546444cf6b44abce41a4fa3a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81447) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:25:53.422504 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-e81e224e-e5fb-419e-b206-c7dd1badef3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:53.422921 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-e81e224e-e5fb-419e-b206-c7dd1badef3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:25:53.424332 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 753/1510] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:25:53 2022] DELETE /identity/v3/projects/15e72eb546444cf6b44abce41a4fa3a5 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:26:02.800280 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=62 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:26:03.420271 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:27:27.846008 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd58370-68d0-4a50-8bfa-333855e92017 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:27:27.846609 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd58370-68d0-4a50-8bfa-333855e92017 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:27:27.846609 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd58370-68d0-4a50-8bfa-333855e92017 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:27:27.847948 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 758/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 01:27:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:27:27.853504 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0b4ec-c374-48b6-96ad-16fe008d20a4 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:27:27.853957 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0b4ec-c374-48b6-96ad-16fe008d20a4 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:27:27.854071 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0b4ec-c374-48b6-96ad-16fe008d20a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:27:27.937824 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-30c0b4ec-c374-48b6-96ad-16fe008d20a4 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:27:27.939066 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-30c0b4ec-c374-48b6-96ad-16fe008d20a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:27:28.043092 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 754/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 01:27:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:27:28.195906 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd58370-68d0-4a50-8bfa-333855e92017 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:27:28.198039 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-cbd58370-68d0-4a50-8bfa-333855e92017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:27:28.316057 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd58370-68d0-4a50-8bfa-333855e92017 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:27:28.321943 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606d782a-51a3-4ca8-b829-d6d91e0c653f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8889145228a24fb6bd539a11925e62f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:27:28.322519 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d782a-51a3-4ca8-b829-d6d91e0c653f service nova] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:27:28.322800 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d782a-51a3-4ca8-b829-d6d91e0c653f service nova] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:27:28.323069 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d782a-51a3-4ca8-b829-d6d91e0c653f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:27:28.331026 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606d782a-51a3-4ca8-b829-d6d91e0c653f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:27:28.333288 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606d782a-51a3-4ca8-b829-d6d91e0c653f service nova] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:27:28.342750 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 759/1513] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:27:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:27:29.177596 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b139d5-bec6-4397-96db-67252df950e6 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:27:29.178162 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b139d5-bec6-4397-96db-67252df950e6 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:27:29.178162 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b139d5-bec6-4397-96db-67252df950e6 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:27:29.179547 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 755/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 01:27:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:27:29.184693 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dba5ec-a2b2-454d-9638-07e74e36f153 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:27:29.185126 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dba5ec-a2b2-454d-9638-07e74e36f153 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:27:29.185271 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dba5ec-a2b2-454d-9638-07e74e36f153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:27:29.204159 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-15dba5ec-a2b2-454d-9638-07e74e36f153 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:27:29.205345 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-15dba5ec-a2b2-454d-9638-07e74e36f153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:27:29.213969 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 760/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 01:27:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:27:29.374173 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b139d5-bec6-4397-96db-67252df950e6 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:27:29.388372 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b139d5-bec6-4397-96db-67252df950e6 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:27:29.393839 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472506f2-9e65-4f09-b85a-718e5070a783 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8889145228a24fb6bd539a11925e62f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:27:29.394431 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472506f2-9e65-4f09-b85a-718e5070a783 service nova] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:27:29.394706 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472506f2-9e65-4f09-b85a-718e5070a783 service nova] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:27:29.395489 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472506f2-9e65-4f09-b85a-718e5070a783 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:27:29.403423 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472506f2-9e65-4f09-b85a-718e5070a783 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:27:29.405017 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472506f2-9e65-4f09-b85a-718e5070a783 service nova] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:27:29.414822 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 756/1516] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:27:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:27:29.662478 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bed680-8575-426c-ae43-e099d1d5044b None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:27:29.662760 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bed680-8575-426c-ae43-e099d1d5044b None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:27:29.663035 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bed680-8575-426c-ae43-e099d1d5044b None None] PATH_INFO: `/v3` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:27:29.664346 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 761/1517] 10.222.0.49 () {54 vars in 925 bytes} [Tue Aug 30 01:27:29 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:27:29.670487 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd4596-4612-4173-93a4-ce2c4fd27410 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:27:29.670789 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd4596-4612-4173-93a4-ce2c4fd27410 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:27:29.671060 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd4596-4612-4173-93a4-ce2c4fd27410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:27:29.732244 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-8fdd4596-4612-4173-93a4-ce2c4fd27410 None None] MFA Rules not processed for user `e8dbb4742c3944b9ad389e9628b5a047`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:27:29.733370 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-8fdd4596-4612-4173-93a4-ce2c4fd27410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:27:29.749873 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:27:29.804209 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 757/1518] 10.222.0.49 () {58 vars in 1015 bytes} [Tue Aug 30 01:27:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:27:38.623093 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb546e-1be9-4c1b-a184-8e304b64d804 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:27:38.623535 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb546e-1be9-4c1b-a184-8e304b64d804 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:27:38.623646 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb546e-1be9-4c1b-a184-8e304b64d804 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:27:38.624923 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 762/1519] 10.222.0.60 () {54 vars in 961 bytes} [Tue Aug 30 01:27:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:27:38.629793 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99300b8e-5630-4af3-a78d-1510e405b21d None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:27:38.630218 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99300b8e-5630-4af3-a78d-1510e405b21d None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:27:38.630407 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99300b8e-5630-4af3-a78d-1510e405b21d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:27:38.649616 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-99300b8e-5630-4af3-a78d-1510e405b21d None None] MFA Rules not processed for user `e8dbb4742c3944b9ad389e9628b5a047`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:27:38.650820 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-99300b8e-5630-4af3-a78d-1510e405b21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:27:38.659290 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 758/1520] 10.222.0.60 () {58 vars in 1058 bytes} [Tue Aug 30 01:27:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:27:38.667147 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddb546e-1be9-4c1b-a184-8e304b64d804 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:27:38.680822 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddb546e-1be9-4c1b-a184-8e304b64d804 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:27:38.686055 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b8fee1-d952-40f8-bad4-2f501b6c0823 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8dbb4742c3944b9ad389e9628b5a047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:27:38.686645 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8fee1-d952-40f8-bad4-2f501b6c0823 service placement] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:27:38.686959 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8fee1-d952-40f8-bad4-2f501b6c0823 service placement] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:27:38.687231 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8fee1-d952-40f8-bad4-2f501b6c0823 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:27:38.696071 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b8fee1-d952-40f8-bad4-2f501b6c0823 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:27:38.697655 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b8fee1-d952-40f8-bad4-2f501b6c0823 service placement] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:27:38.708811 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 763/1521] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:27:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:27:40.629664 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d52084-15ad-4a15-9312-96aecbd08f94 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:27:40.630153 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d52084-15ad-4a15-9312-96aecbd08f94 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:27:40.630268 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d52084-15ad-4a15-9312-96aecbd08f94 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:27:40.631579 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 759/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 01:27:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:27:40.636292 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783fe21-bb4f-421f-9e92-952384804012 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:27:40.636738 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783fe21-bb4f-421f-9e92-952384804012 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:27:40.636873 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783fe21-bb4f-421f-9e92-952384804012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:27:40.657111 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-2783fe21-bb4f-421f-9e92-952384804012 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:27:40.658305 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-2783fe21-bb4f-421f-9e92-952384804012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:27:40.666166 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 764/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 01:27:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:27:40.822809 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d52084-15ad-4a15-9312-96aecbd08f94 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:27:40.837682 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d52084-15ad-4a15-9312-96aecbd08f94 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:27:40.843047 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d6cc66-5fe7-4785-bf0f-2f2e45825756 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8889145228a24fb6bd539a11925e62f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:27:40.843813 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d6cc66-5fe7-4785-bf0f-2f2e45825756 service nova] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:27:40.844032 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d6cc66-5fe7-4785-bf0f-2f2e45825756 service nova] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:27:40.844207 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d6cc66-5fe7-4785-bf0f-2f2e45825756 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:27:40.852798 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d6cc66-5fe7-4785-bf0f-2f2e45825756 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:27:40.854313 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d6cc66-5fe7-4785-bf0f-2f2e45825756 service nova] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:27:40.864109 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 760/1524] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:27:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:27:41.679554 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13741745-752c-44b7-84f9-d411af94cb2a None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:27:41.680073 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13741745-752c-44b7-84f9-d411af94cb2a None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:27:41.680073 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13741745-752c-44b7-84f9-d411af94cb2a None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:27:41.681428 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 765/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 01:27:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:27:41.686152 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847928e3-ca3b-4290-9787-79d7b85ade5e None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:27:41.686598 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847928e3-ca3b-4290-9787-79d7b85ade5e None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:27:41.686705 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847928e3-ca3b-4290-9787-79d7b85ade5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:27:41.707651 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-847928e3-ca3b-4290-9787-79d7b85ade5e None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:27:41.708851 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-847928e3-ca3b-4290-9787-79d7b85ade5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:27:41.716922 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 761/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 01:27:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:27:41.870459 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13741745-752c-44b7-84f9-d411af94cb2a None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:27:41.884807 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13741745-752c-44b7-84f9-d411af94cb2a None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:27:41.890223 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc14821-5cc2-4394-ae11-02ff34edb579 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8889145228a24fb6bd539a11925e62f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:27:41.891103 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc14821-5cc2-4394-ae11-02ff34edb579 service nova] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:27:41.891103 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc14821-5cc2-4394-ae11-02ff34edb579 service nova] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:27:41.891339 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc14821-5cc2-4394-ae11-02ff34edb579 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:27:41.899397 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc14821-5cc2-4394-ae11-02ff34edb579 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:27:41.901005 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc14821-5cc2-4394-ae11-02ff34edb579 service nova] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:27:41.910678 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 766/1527] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:27:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:27:45.818432 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ed208-5fdf-4ac2-a163-facdaf0541cf None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:27:45.819044 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ed208-5fdf-4ac2-a163-facdaf0541cf None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:27:45.819044 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ed208-5fdf-4ac2-a163-facdaf0541cf None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:27:45.820346 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 762/1528] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 01:27:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:27:45.825501 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d03dab-e173-48e6-8b50-cc59c30e4f3d None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:27:45.825953 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d03dab-e173-48e6-8b50-cc59c30e4f3d None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:27:45.826060 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d03dab-e173-48e6-8b50-cc59c30e4f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:27:45.845406 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-f9d03dab-e173-48e6-8b50-cc59c30e4f3d None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:27:45.846598 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-f9d03dab-e173-48e6-8b50-cc59c30e4f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:27:45.854336 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 767/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 01:27:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:27:46.138623 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0ed208-5fdf-4ac2-a163-facdaf0541cf None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:27:46.140747 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-ec0ed208-5fdf-4ac2-a163-facdaf0541cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:27:46.219001 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0ed208-5fdf-4ac2-a163-facdaf0541cf None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:27:46.223073 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead0c01-9cdb-479a-aef1-a9fe130ac37f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:27:46.223708 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead0c01-9cdb-479a-aef1-a9fe130ac37f service neutron] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:27:46.223984 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead0c01-9cdb-479a-aef1-a9fe130ac37f service neutron] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:27:46.224253 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead0c01-9cdb-479a-aef1-a9fe130ac37f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:27:46.232941 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ead0c01-9cdb-479a-aef1-a9fe130ac37f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:27:46.234575 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ead0c01-9cdb-479a-aef1-a9fe130ac37f service neutron] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:27:46.244714 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 763/1530] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:27:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:27:48.246823 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1390f819-804d-4b09-b8b9-78f7172e40af None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:27:48.247345 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1390f819-804d-4b09-b8b9-78f7172e40af None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:27:48.247345 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1390f819-804d-4b09-b8b9-78f7172e40af None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:27:48.248621 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 768/1531] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 01:27:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:27:48.253684 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d46c61-f373-4acd-b0d2-32526b5cb9b7 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:27:48.254688 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d46c61-f373-4acd-b0d2-32526b5cb9b7 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:27:48.254838 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d46c61-f373-4acd-b0d2-32526b5cb9b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:27:48.274774 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-e0d46c61-f373-4acd-b0d2-32526b5cb9b7 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:27:48.276048 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-e0d46c61-f373-4acd-b0d2-32526b5cb9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:27:48.287824 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 764/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 01:27:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:27:48.572633 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1390f819-804d-4b09-b8b9-78f7172e40af None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:27:48.574332 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-1390f819-804d-4b09-b8b9-78f7172e40af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:27:48.587715 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1390f819-804d-4b09-b8b9-78f7172e40af None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:27:48.591225 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae92f6-4f97-4167-819c-b5d4f2708778 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:27:48.591890 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae92f6-4f97-4167-819c-b5d4f2708778 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:27:48.592165 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae92f6-4f97-4167-819c-b5d4f2708778 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:27:48.592432 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae92f6-4f97-4167-819c-b5d4f2708778 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:27:48.602797 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dae92f6-4f97-4167-819c-b5d4f2708778 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:27:48.604303 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dae92f6-4f97-4167-819c-b5d4f2708778 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:27:48.614441 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 769/1533] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:27:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:27:51.930855 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec9b01-5aee-4c65-8bd5-cbcfab5c6f6e None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:27:51.931501 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec9b01-5aee-4c65-8bd5-cbcfab5c6f6e None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:27:51.931501 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec9b01-5aee-4c65-8bd5-cbcfab5c6f6e None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:27:51.932788 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 765/1534] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 01:27:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:27:51.938215 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12801820-78f8-4744-aab9-4349e0e2b70a None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:27:51.938682 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12801820-78f8-4744-aab9-4349e0e2b70a None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:27:51.938793 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12801820-78f8-4744-aab9-4349e0e2b70a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:27:51.958498 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-12801820-78f8-4744-aab9-4349e0e2b70a None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:27:51.960197 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-12801820-78f8-4744-aab9-4349e0e2b70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:27:51.968437 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 770/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 01:27:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:27:52.538297 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec9b01-5aee-4c65-8bd5-cbcfab5c6f6e None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:27:52.540005 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-d7ec9b01-5aee-4c65-8bd5-cbcfab5c6f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:27:52.608088 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:27:52.622172 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec9b01-5aee-4c65-8bd5-cbcfab5c6f6e None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:27:52.625736 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4666ff71-f7b8-4dc6-95f7-449c62b7377e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:27:52.626351 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666ff71-f7b8-4dc6-95f7-449c62b7377e service cinder] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:27:52.626631 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666ff71-f7b8-4dc6-95f7-449c62b7377e service cinder] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:27:52.626908 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666ff71-f7b8-4dc6-95f7-449c62b7377e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:27:52.636501 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4666ff71-f7b8-4dc6-95f7-449c62b7377e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:27:52.637916 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4666ff71-f7b8-4dc6-95f7-449c62b7377e service cinder] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:27:52.647334 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 766/1536] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:27:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:27:54.596684 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0797a4-903b-4a07-bbe2-314573c8bdba None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:27:54.597755 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0797a4-903b-4a07-bbe2-314573c8bdba None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:27:54.597755 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0797a4-903b-4a07-bbe2-314573c8bdba None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:27:54.599086 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 771/1537] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 01:27:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:27:54.604443 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de594d28-f7e5-4aac-a2cc-ea4b5aff5966 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:27:54.604846 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de594d28-f7e5-4aac-a2cc-ea4b5aff5966 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:27:54.605002 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de594d28-f7e5-4aac-a2cc-ea4b5aff5966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:27:54.624687 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-de594d28-f7e5-4aac-a2cc-ea4b5aff5966 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:27:54.625885 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-de594d28-f7e5-4aac-a2cc-ea4b5aff5966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:27:54.633639 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 767/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 01:27:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:27:55.196106 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0797a4-903b-4a07-bbe2-314573c8bdba None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:27:55.197757 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-ae0797a4-903b-4a07-bbe2-314573c8bdba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:27:55.205310 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=84 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:27:55.212533 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0797a4-903b-4a07-bbe2-314573c8bdba None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:27:55.216044 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a1ebd-a615-474d-9dc1-42b2d857d62d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:27:55.216637 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a1ebd-a615-474d-9dc1-42b2d857d62d service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:27:55.216917 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a1ebd-a615-474d-9dc1-42b2d857d62d service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:27:55.217190 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a1ebd-a615-474d-9dc1-42b2d857d62d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:27:55.227103 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a1ebd-a615-474d-9dc1-42b2d857d62d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:27:55.228619 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a1ebd-a615-474d-9dc1-42b2d857d62d service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:27:55.240171 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 772/1539] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:27:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:28:04.619878 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=11 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:28:05.234314 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=5 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:21.079763 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7d888-5fbb-4f2e-a424-813c730d7f06 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:21.080431 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7d888-5fbb-4f2e-a424-813c730d7f06 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:21.080431 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7d888-5fbb-4f2e-a424-813c730d7f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:21.081455 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88f88b-39d1-454e-8fd4-d76030d4ca90 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:21.081455 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88f88b-39d1-454e-8fd4-d76030d4ca90 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:21.081930 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88f88b-39d1-454e-8fd4-d76030d4ca90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:21.102825 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-0f88f88b-39d1-454e-8fd4-d76030d4ca90 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:21.104051 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-0f88f88b-39d1-454e-8fd4-d76030d4ca90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:21.108865 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-1ef7d888-5fbb-4f2e-a424-813c730d7f06 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:21.110056 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-1ef7d888-5fbb-4f2e-a424-813c730d7f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:21.114142 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 773/1540] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:21.115391 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76452733-096b-412a-9abc-098f80902acb None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:21.115699 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76452733-096b-412a-9abc-098f80902acb None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:21.115986 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76452733-096b-412a-9abc-098f80902acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:21.124963 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 768/1541] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:21.126236 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47166a-bbd4-4469-9d21-923078fbe5ed None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:21.126522 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47166a-bbd4-4469-9d21-923078fbe5ed None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:21.126799 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47166a-bbd4-4469-9d21-923078fbe5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:21.148371 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-76452733-096b-412a-9abc-098f80902acb None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:21.150298 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-76452733-096b-412a-9abc-098f80902acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:21.156716 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-7b47166a-bbd4-4469-9d21-923078fbe5ed None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:21.158420 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-7b47166a-bbd4-4469-9d21-923078fbe5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:21.166167 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 774/1542] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:21.172601 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73be3e-56de-4d7a-8ae5-d9a40a31f248 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:21.172601 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73be3e-56de-4d7a-8ae5-d9a40a31f248 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:21.172601 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73be3e-56de-4d7a-8ae5-d9a40a31f248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:21.181784 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 769/1543] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:21.181989 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69491f27-e88c-4c89-853b-7a7149ffcacc None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:21.182237 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69491f27-e88c-4c89-853b-7a7149ffcacc None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:21.182426 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69491f27-e88c-4c89-853b-7a7149ffcacc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:21.194951 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-af73be3e-56de-4d7a-8ae5-d9a40a31f248 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:21.196665 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-af73be3e-56de-4d7a-8ae5-d9a40a31f248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:21.204983 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 775/1544] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:21.206154 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a8c98-cfdf-4753-b33f-a80e1783133e None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:21.206436 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a8c98-cfdf-4753-b33f-a80e1783133e None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:21.206958 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a8c98-cfdf-4753-b33f-a80e1783133e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:21.207623 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-69491f27-e88c-4c89-853b-7a7149ffcacc None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:21.208824 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-69491f27-e88c-4c89-853b-7a7149ffcacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:21.218516 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 770/1545] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:21.219771 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df2947-0dca-4628-a230-5a676f76cf79 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:21.220051 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df2947-0dca-4628-a230-5a676f76cf79 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:21.220320 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df2947-0dca-4628-a230-5a676f76cf79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:21.229528 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-0c9a8c98-cfdf-4753-b33f-a80e1783133e None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:21.230773 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-0c9a8c98-cfdf-4753-b33f-a80e1783133e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:21.243293 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-01df2947-0dca-4628-a230-5a676f76cf79 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:21.243836 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 776/1546] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:21.244541 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-01df2947-0dca-4628-a230-5a676f76cf79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:21.245510 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a6f8be-9c42-498c-9306-ad8c39bc6410 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:21.245510 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a6f8be-9c42-498c-9306-ad8c39bc6410 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:21.245715 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a6f8be-9c42-498c-9306-ad8c39bc6410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:21.252668 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 771/1547] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:21.253864 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97c6a7-29cb-4c8b-9411-81dc9b36a3a3 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:21.254137 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97c6a7-29cb-4c8b-9411-81dc9b36a3a3 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:21.254410 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97c6a7-29cb-4c8b-9411-81dc9b36a3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:21.266660 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-90a6f8be-9c42-498c-9306-ad8c39bc6410 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:21.267904 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-90a6f8be-9c42-498c-9306-ad8c39bc6410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:21.273818 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-cd97c6a7-29cb-4c8b-9411-81dc9b36a3a3 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:21.274957 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-cd97c6a7-29cb-4c8b-9411-81dc9b36a3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:21.279568 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 777/1548] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:21.279568 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1d174-57cf-40f7-86fb-e25f350560cd None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:21.279568 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1d174-57cf-40f7-86fb-e25f350560cd None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:21.279568 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1d174-57cf-40f7-86fb-e25f350560cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:21.283197 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 772/1549] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:21.284341 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6fbb6b-9470-4231-b36b-192c167b0014 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:21.284626 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6fbb6b-9470-4231-b36b-192c167b0014 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:21.284899 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6fbb6b-9470-4231-b36b-192c167b0014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:21.296605 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-22e1d174-57cf-40f7-86fb-e25f350560cd None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:21.297798 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-22e1d174-57cf-40f7-86fb-e25f350560cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:21.304606 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-ef6fbb6b-9470-4231-b36b-192c167b0014 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:21.306221 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 778/1550] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:21.306367 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-ef6fbb6b-9470-4231-b36b-192c167b0014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:21.306991 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e1d174-57cf-40f7-86fb-e25f350560cd None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:21.316416 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e1d174-57cf-40f7-86fb-e25f350560cd None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:21.319317 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 773/1551] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:21.320707 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0278195-d480-4ee2-9e7f-eb1848912ce3 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:21.321555 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0278195-d480-4ee2-9e7f-eb1848912ce3 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:21.321719 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0278195-d480-4ee2-9e7f-eb1848912ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:21.325420 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b024fe-8781-41e1-a779-3aa862b6d304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:21.326023 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b024fe-8781-41e1-a779-3aa862b6d304 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:21.326297 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b024fe-8781-41e1-a779-3aa862b6d304 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:21.326565 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b024fe-8781-41e1-a779-3aa862b6d304 admin admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:21.327229 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b024fe-8781-41e1-a779-3aa862b6d304 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:29:21.327550 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b024fe-8781-41e1-a779-3aa862b6d304 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:21.328575 dv-cinder-819668-6-smb devstack@keystone.service[81446]: WARNING py.warnings [None req-c4b024fe-8781-41e1-a779-3aa862b6d304 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 01:29:21.328575 dv-cinder-819668-6-smb devstack@keystone.service[81446]: warnings.warn(msg) Aug 30 01:29:21.328575 dv-cinder-819668-6-smb devstack@keystone.service[81446]: Aug 30 01:29:21.329449 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b024fe-8781-41e1-a779-3aa862b6d304 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:21.341027 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-a0278195-d480-4ee2-9e7f-eb1848912ce3 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:21.341362 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 779/1552] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 30 01:29:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:29:21.342228 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-a0278195-d480-4ee2-9e7f-eb1848912ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:21.342359 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b024fe-8781-41e1-a779-3aa862b6d304 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:21.350129 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 774/1553] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:21.351375 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267bd76-ef62-4a60-af6d-b220d2ceec57 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:21.351708 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267bd76-ef62-4a60-af6d-b220d2ceec57 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:21.352009 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267bd76-ef62-4a60-af6d-b220d2ceec57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:21.352598 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b024fe-8781-41e1-a779-3aa862b6d304 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:21.357313 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57218d22-f0d3-4bd2-bc41-0ec1c8b8d9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:21.357928 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57218d22-f0d3-4bd2-bc41-0ec1c8b8d9b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:21.358187 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57218d22-f0d3-4bd2-bc41-0ec1c8b8d9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:21.358454 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57218d22-f0d3-4bd2-bc41-0ec1c8b8d9b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:21.359088 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57218d22-f0d3-4bd2-bc41-0ec1c8b8d9b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:29:21.359383 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57218d22-f0d3-4bd2-bc41-0ec1c8b8d9b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:21.361023 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57218d22-f0d3-4bd2-bc41-0ec1c8b8d9b5 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:21.372137 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-0267bd76-ef62-4a60-af6d-b220d2ceec57 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:21.373421 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 780/1554] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 30 01:29:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:29:21.373554 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-0267bd76-ef62-4a60-af6d-b220d2ceec57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:21.374277 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57218d22-f0d3-4bd2-bc41-0ec1c8b8d9b5 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:21.381339 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 775/1555] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:21.382129 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0267bd76-ef62-4a60-af6d-b220d2ceec57 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:21.384402 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57218d22-f0d3-4bd2-bc41-0ec1c8b8d9b5 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:21.388990 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc16c29-102e-4973-96d4-661a6407f122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:21.389575 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc16c29-102e-4973-96d4-661a6407f122 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:21.389855 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc16c29-102e-4973-96d4-661a6407f122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:21.390123 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc16c29-102e-4973-96d4-661a6407f122 admin admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:21.390754 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc16c29-102e-4973-96d4-661a6407f122 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:29:21.391051 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc16c29-102e-4973-96d4-661a6407f122 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:21.392318 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0267bd76-ef62-4a60-af6d-b220d2ceec57 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:21.392692 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc16c29-102e-4973-96d4-661a6407f122 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:21.397528 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed54b6e2-49ee-4ba6-ae32-6c6b17a106d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:21.398119 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54b6e2-49ee-4ba6-ae32-6c6b17a106d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:21.398395 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54b6e2-49ee-4ba6-ae32-6c6b17a106d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:21.398672 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54b6e2-49ee-4ba6-ae32-6c6b17a106d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:21.399377 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed54b6e2-49ee-4ba6-ae32-6c6b17a106d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:29:21.399786 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed54b6e2-49ee-4ba6-ae32-6c6b17a106d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:21.401375 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed54b6e2-49ee-4ba6-ae32-6c6b17a106d8 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:21.404314 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 781/1556] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 30 01:29:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:29:21.408064 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e14a3-5dc9-413b-ba82-486b95aec12f None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:21.408064 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e14a3-5dc9-413b-ba82-486b95aec12f None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:21.408064 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e14a3-5dc9-413b-ba82-486b95aec12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:21.413618 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 776/1557] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 30 01:29:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:29:21.414478 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed54b6e2-49ee-4ba6-ae32-6c6b17a106d8 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:21.424591 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed54b6e2-49ee-4ba6-ae32-6c6b17a106d8 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:21.426647 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-cb7e14a3-5dc9-413b-ba82-486b95aec12f None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:21.427877 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-cb7e14a3-5dc9-413b-ba82-486b95aec12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:21.429188 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b61b6-4177-4f12-b9be-45895dbbcf4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:21.429792 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b61b6-4177-4f12-b9be-45895dbbcf4a admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:21.430613 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b61b6-4177-4f12-b9be-45895dbbcf4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:21.430890 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b61b6-4177-4f12-b9be-45895dbbcf4a admin admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:21.431572 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15b61b6-4177-4f12-b9be-45895dbbcf4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:29:21.431878 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15b61b6-4177-4f12-b9be-45895dbbcf4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:21.434517 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15b61b6-4177-4f12-b9be-45895dbbcf4a admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:21.437645 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 782/1558] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:21.438525 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e14a3-5dc9-413b-ba82-486b95aec12f None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:21.447181 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 777/1559] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 30 01:29:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:29:21.448171 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e14a3-5dc9-413b-ba82-486b95aec12f None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:21.448416 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d429d68-b056-4ce1-b2d0-b8eef88955f5 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:21.448701 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d429d68-b056-4ce1-b2d0-b8eef88955f5 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:21.448975 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d429d68-b056-4ce1-b2d0-b8eef88955f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:21.452971 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc00219d-9a89-47de-b242-c2f5e5f4fce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:21.453568 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00219d-9a89-47de-b242-c2f5e5f4fce9 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:21.453859 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00219d-9a89-47de-b242-c2f5e5f4fce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:21.454426 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00219d-9a89-47de-b242-c2f5e5f4fce9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:21.455075 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc00219d-9a89-47de-b242-c2f5e5f4fce9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:21.457049 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc00219d-9a89-47de-b242-c2f5e5f4fce9 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:21.468614 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-9d429d68-b056-4ce1-b2d0-b8eef88955f5 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:21.469823 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-9d429d68-b056-4ce1-b2d0-b8eef88955f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:21.478142 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 778/1560] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:21.478909 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d429d68-b056-4ce1-b2d0-b8eef88955f5 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:21.488019 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d429d68-b056-4ce1-b2d0-b8eef88955f5 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:21.493418 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc8e55f-7767-4ecd-bbd9-a5d9f56bc7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:21.494007 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8e55f-7767-4ecd-bbd9-a5d9f56bc7d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:21.494286 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8e55f-7767-4ecd-bbd9-a5d9f56bc7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:21.494554 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8e55f-7767-4ecd-bbd9-a5d9f56bc7d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:21.495181 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc8e55f-7767-4ecd-bbd9-a5d9f56bc7d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:21.496331 dv-cinder-819668-6-smb devstack@keystone.service[81447]: WARNING py.warnings [None req-4fc8e55f-7767-4ecd-bbd9-a5d9f56bc7d3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 01:29:21.496331 dv-cinder-819668-6-smb devstack@keystone.service[81447]: warnings.warn(msg) Aug 30 01:29:21.496331 dv-cinder-819668-6-smb devstack@keystone.service[81447]: Aug 30 01:29:21.497487 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc8e55f-7767-4ecd-bbd9-a5d9f56bc7d3 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:21.502000 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 783/1561] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:29:21 2022] POST /identity/v3/projects => generated 375 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:29:21.502000 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc00219d-9a89-47de-b242-c2f5e5f4fce9 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:21.528910 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 779/1562] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:29:21 2022] POST /identity/v3/projects => generated 391 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:29:21.528910 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc8e55f-7767-4ecd-bbd9-a5d9f56bc7d3 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:21.566388 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc00219d-9a89-47de-b242-c2f5e5f4fce9 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:21.591372 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc8e55f-7767-4ecd-bbd9-a5d9f56bc7d3 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:21.598069 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b836e3-6390-4e5f-b65c-f60c7c2bcfd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:21.598728 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b836e3-6390-4e5f-b65c-f60c7c2bcfd3 admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:21.598929 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b836e3-6390-4e5f-b65c-f60c7c2bcfd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:21.599172 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b836e3-6390-4e5f-b65c-f60c7c2bcfd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:21.600245 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b836e3-6390-4e5f-b65c-f60c7c2bcfd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:21.601747 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b836e3-6390-4e5f-b65c-f60c7c2bcfd3 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:21.624802 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:21.635765 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458492aa-729c-45f3-bac6-343f7b8bc3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:21.636380 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 780/1563] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:29:21 2022] POST /identity/v3/projects => generated 387 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:29:21.636528 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458492aa-729c-45f3-bac6-343f7b8bc3a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:21.636637 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458492aa-729c-45f3-bac6-343f7b8bc3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:21.636914 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458492aa-729c-45f3-bac6-343f7b8bc3a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:21.637193 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b836e3-6390-4e5f-b65c-f60c7c2bcfd3 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:21.637562 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458492aa-729c-45f3-bac6-343f7b8bc3a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:29:21.637864 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458492aa-729c-45f3-bac6-343f7b8bc3a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:21.639517 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458492aa-729c-45f3-bac6-343f7b8bc3a7 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:21.651268 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 784/1564] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 30 01:29:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:29:21.652171 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458492aa-729c-45f3-bac6-343f7b8bc3a7 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:21.661962 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458492aa-729c-45f3-bac6-343f7b8bc3a7 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:21.683773 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:21.704914 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b836e3-6390-4e5f-b65c-f60c7c2bcfd3 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:21.709624 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ca0938-6e64-435b-abc5-5dc78fed98af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:21.710235 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca0938-6e64-435b-abc5-5dc78fed98af admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:21.710517 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca0938-6e64-435b-abc5-5dc78fed98af admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:21.710791 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca0938-6e64-435b-abc5-5dc78fed98af admin admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:21.711478 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ca0938-6e64-435b-abc5-5dc78fed98af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:21.713649 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ca0938-6e64-435b-abc5-5dc78fed98af admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:21.719499 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8595d-dcbc-40f1-a6d6-abb84122e272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:21.720235 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8595d-dcbc-40f1-a6d6-abb84122e272 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:21.720515 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8595d-dcbc-40f1-a6d6-abb84122e272 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:21.720783 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8595d-dcbc-40f1-a6d6-abb84122e272 admin admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:21.721431 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b8595d-dcbc-40f1-a6d6-abb84122e272 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:29:21.721727 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b8595d-dcbc-40f1-a6d6-abb84122e272 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:21.723319 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b8595d-dcbc-40f1-a6d6-abb84122e272 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:21.736497 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 785/1565] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 30 01:29:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:29:21.737529 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8595d-dcbc-40f1-a6d6-abb84122e272 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:21.747670 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8595d-dcbc-40f1-a6d6-abb84122e272 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:21.748856 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 781/1566] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:29:21 2022] POST /identity/v3/projects => generated 393 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:29:21.749853 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ca0938-6e64-435b-abc5-5dc78fed98af admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:21.807036 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8abb8cc-0af9-4b1a-836a-54c5a4281897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:21.807756 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8abb8cc-0af9-4b1a-836a-54c5a4281897 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:21.807952 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8abb8cc-0af9-4b1a-836a-54c5a4281897 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:21.808228 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8abb8cc-0af9-4b1a-836a-54c5a4281897 admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:21.808867 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8abb8cc-0af9-4b1a-836a-54c5a4281897 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:21.810809 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8abb8cc-0af9-4b1a-836a-54c5a4281897 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:21.812478 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ca0938-6e64-435b-abc5-5dc78fed98af admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:21.817166 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51d75b3-2044-4cd7-8a81-7e4e875a75b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:21.817777 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d75b3-2044-4cd7-8a81-7e4e875a75b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:21.818058 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d75b3-2044-4cd7-8a81-7e4e875a75b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:21.818332 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d75b3-2044-4cd7-8a81-7e4e875a75b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:21.818981 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51d75b3-2044-4cd7-8a81-7e4e875a75b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:29:21.819287 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51d75b3-2044-4cd7-8a81-7e4e875a75b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:21.820950 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51d75b3-2044-4cd7-8a81-7e4e875a75b3 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:21.832820 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 782/1567] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 30 01:29:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:29:21.833617 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51d75b3-2044-4cd7-8a81-7e4e875a75b3 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:21.840827 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 786/1568] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:29:21 2022] POST /identity/v3/projects => generated 405 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:29:21.840827 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8abb8cc-0af9-4b1a-836a-54c5a4281897 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:21.846765 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51d75b3-2044-4cd7-8a81-7e4e875a75b3 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:21.906919 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8abb8cc-0af9-4b1a-836a-54c5a4281897 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:21.910245 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef25b60-84a0-4864-908e-523620f01d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:21.910866 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef25b60-84a0-4864-908e-523620f01d26 admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:21.911146 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef25b60-84a0-4864-908e-523620f01d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:21.911417 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef25b60-84a0-4864-908e-523620f01d26 admin admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:21.911707 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c624f758-3044-4090-bf22-06ea23e8a1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:21.912116 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef25b60-84a0-4864-908e-523620f01d26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:21.912307 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624f758-3044-4090-bf22-06ea23e8a1f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:21.912590 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624f758-3044-4090-bf22-06ea23e8a1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:21.912857 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624f758-3044-4090-bf22-06ea23e8a1f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:21.913487 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c624f758-3044-4090-bf22-06ea23e8a1f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:21.914076 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef25b60-84a0-4864-908e-523620f01d26 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:21.915025 dv-cinder-819668-6-smb devstack@keystone.service[81446]: WARNING py.warnings [None req-c624f758-3044-4090-bf22-06ea23e8a1f0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 01:29:21.915025 dv-cinder-819668-6-smb devstack@keystone.service[81446]: warnings.warn(msg) Aug 30 01:29:21.915025 dv-cinder-819668-6-smb devstack@keystone.service[81446]: Aug 30 01:29:21.916239 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c624f758-3044-4090-bf22-06ea23e8a1f0 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:21.926092 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:21.939079 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 783/1569] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:29:21 2022] POST /identity/v3/users => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:29:21.942375 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 787/1570] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:29:21 2022] POST /identity/v3/users => generated 296 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:29:21.942541 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef25b60-84a0-4864-908e-523620f01d26 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:21.942655 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c624f758-3044-4090-bf22-06ea23e8a1f0 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:21.950940 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c624f758-3044-4090-bf22-06ea23e8a1f0 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:21.952016 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef25b60-84a0-4864-908e-523620f01d26 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:21.955511 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df7592-cb42-4436-a96b-8cc64cadcd20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:21.956100 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df7592-cb42-4436-a96b-8cc64cadcd20 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:21.956379 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df7592-cb42-4436-a96b-8cc64cadcd20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:21.956589 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ee12f-2fe8-4ebb-a73b-14d5d1e707aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:21.956710 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df7592-cb42-4436-a96b-8cc64cadcd20 admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:21.957186 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ee12f-2fe8-4ebb-a73b-14d5d1e707aa admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:21.957312 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97df7592-cb42-4436-a96b-8cc64cadcd20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:21.957470 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ee12f-2fe8-4ebb-a73b-14d5d1e707aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:21.957744 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ee12f-2fe8-4ebb-a73b-14d5d1e707aa admin admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:21.958367 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ee12f-2fe8-4ebb-a73b-14d5d1e707aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:21.959194 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97df7592-cb42-4436-a96b-8cc64cadcd20 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:21.960342 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ee12f-2fe8-4ebb-a73b-14d5d1e707aa admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:21.985322 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 784/1571] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:29:21 2022] POST /identity/v3/users => generated 294 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:29:21.986194 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ee12f-2fe8-4ebb-a73b-14d5d1e707aa admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:21.992531 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 788/1572] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:29:21 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:29:21.995738 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ee12f-2fe8-4ebb-a73b-14d5d1e707aa admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:21.996619 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df7592-cb42-4436-a96b-8cc64cadcd20 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:22.020904 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:22.056076 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e24b177-b6ff-40e3-880b-69cc536e628a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:22.056788 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24b177-b6ff-40e3-880b-69cc536e628a admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:22.057129 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24b177-b6ff-40e3-880b-69cc536e628a admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:22.057471 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24b177-b6ff-40e3-880b-69cc536e628a admin admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:22.058496 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e24b177-b6ff-40e3-880b-69cc536e628a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:22.060066 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df7592-cb42-4436-a96b-8cc64cadcd20 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:22.060377 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e24b177-b6ff-40e3-880b-69cc536e628a admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:22.064597 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e27340-4fd4-4156-b824-24f187f93e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:22.065196 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e27340-4fd4-4156-b824-24f187f93e07 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:22.065471 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e27340-4fd4-4156-b824-24f187f93e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:22.065749 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e27340-4fd4-4156-b824-24f187f93e07 admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:22.066371 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e27340-4fd4-4156-b824-24f187f93e07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:22.068349 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e27340-4fd4-4156-b824-24f187f93e07 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:22.093173 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 785/1573] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:29:21 2022] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:29:22.093754 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 789/1574] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:29:21 2022] POST /identity/v3/users => generated 297 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:29:22.094134 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e24b177-b6ff-40e3-880b-69cc536e628a admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:22.094232 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e27340-4fd4-4156-b824-24f187f93e07 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:22.104650 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e27340-4fd4-4156-b824-24f187f93e07 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:22.154112 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e24b177-b6ff-40e3-880b-69cc536e628a admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:22.158675 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d9255-12cb-43f5-b0a5-d44b307dc3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:22.159275 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d9255-12cb-43f5-b0a5-d44b307dc3d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:22.159575 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d9255-12cb-43f5-b0a5-d44b307dc3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:22.159841 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d9255-12cb-43f5-b0a5-d44b307dc3d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:22.160459 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d9255-12cb-43f5-b0a5-d44b307dc3d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:22.161562 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c353feb2-c01d-4d8b-a829-33f051903e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:22.162171 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353feb2-c01d-4d8b-a829-33f051903e69 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:22.162355 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d9255-12cb-43f5-b0a5-d44b307dc3d5 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:22.162462 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353feb2-c01d-4d8b-a829-33f051903e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:22.162710 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353feb2-c01d-4d8b-a829-33f051903e69 admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:22.163342 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c353feb2-c01d-4d8b-a829-33f051903e69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:22.165853 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c353feb2-c01d-4d8b-a829-33f051903e69 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:22.190749 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 786/1575] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:29:22 2022] POST /identity/v3/users => generated 303 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:29:22.190749 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d9255-12cb-43f5-b0a5-d44b307dc3d5 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:22.195584 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 790/1576] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:29:22 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:29:22.196599 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c353feb2-c01d-4d8b-a829-33f051903e69 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:22.201398 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d9255-12cb-43f5-b0a5-d44b307dc3d5 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:22.244927 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:22.260030 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c353feb2-c01d-4d8b-a829-33f051903e69 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:22.260353 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9485be39-e5a7-40f7-9869-6de5533f3675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:22.261101 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485be39-e5a7-40f7-9869-6de5533f3675 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:22.261541 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485be39-e5a7-40f7-9869-6de5533f3675 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:22.261817 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485be39-e5a7-40f7-9869-6de5533f3675 admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:22.262457 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9485be39-e5a7-40f7-9869-6de5533f3675 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:22.264168 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9485be39-e5a7-40f7-9869-6de5533f3675 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:22.264628 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e1c4bb-123b-4cb7-9f50-79774537688c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:22.265241 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e1c4bb-123b-4cb7-9f50-79774537688c admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:22.265521 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e1c4bb-123b-4cb7-9f50-79774537688c admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:22.265791 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e1c4bb-123b-4cb7-9f50-79774537688c admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:22.266429 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e1c4bb-123b-4cb7-9f50-79774537688c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:22.268052 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e1c4bb-123b-4cb7-9f50-79774537688c admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:22.275516 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 787/1577] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:29:22.276312 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9485be39-e5a7-40f7-9869-6de5533f3675 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:22.281103 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 791/1578] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:29:22.281103 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e1c4bb-123b-4cb7-9f50-79774537688c admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:22.287847 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9485be39-e5a7-40f7-9869-6de5533f3675 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:22.288893 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e1c4bb-123b-4cb7-9f50-79774537688c admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:22.293003 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec3c41c-36be-48da-9019-33ebef143ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:22.293600 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3c41c-36be-48da-9019-33ebef143ab3 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:22.293883 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3c41c-36be-48da-9019-33ebef143ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:22.294136 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c99cd65-8378-4926-8bf3-06a927b4df28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:22.294254 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3c41c-36be-48da-9019-33ebef143ab3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:22.294717 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99cd65-8378-4926-8bf3-06a927b4df28 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:22.294830 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec3c41c-36be-48da-9019-33ebef143ab3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:22.294998 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99cd65-8378-4926-8bf3-06a927b4df28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:22.295272 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99cd65-8378-4926-8bf3-06a927b4df28 admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:22.295942 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c99cd65-8378-4926-8bf3-06a927b4df28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:22.296420 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec3c41c-36be-48da-9019-33ebef143ab3 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:22.297836 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c99cd65-8378-4926-8bf3-06a927b4df28 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:22.306314 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 788/1579] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:29:22.307166 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec3c41c-36be-48da-9019-33ebef143ab3 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:22.317696 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec3c41c-36be-48da-9019-33ebef143ab3 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:22.323350 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac8e24c-2803-46ae-acd7-02c0e795bf44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:22.323987 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8e24c-2803-46ae-acd7-02c0e795bf44 admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:22.324266 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8e24c-2803-46ae-acd7-02c0e795bf44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:22.324537 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8e24c-2803-46ae-acd7-02c0e795bf44 admin admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:22.324659 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 792/1580] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:29:22 2022] POST /identity/v3/users => generated 289 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:29:22.325441 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c99cd65-8378-4926-8bf3-06a927b4df28 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:22.325824 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac8e24c-2803-46ae-acd7-02c0e795bf44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:22.327971 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac8e24c-2803-46ae-acd7-02c0e795bf44 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:22.334925 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c99cd65-8378-4926-8bf3-06a927b4df28 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:22.341159 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e9b8a8-46f9-4790-bf09-7fcf5f85a509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:22.341834 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9b8a8-46f9-4790-bf09-7fcf5f85a509 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:22.342113 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9b8a8-46f9-4790-bf09-7fcf5f85a509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:22.342409 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9b8a8-46f9-4790-bf09-7fcf5f85a509 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:22.343125 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e9b8a8-46f9-4790-bf09-7fcf5f85a509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:22.344713 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e9b8a8-46f9-4790-bf09-7fcf5f85a509 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:22.350386 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 789/1581] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:29:22 2022] POST /identity/v3/users => generated 287 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:29:22.351279 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac8e24c-2803-46ae-acd7-02c0e795bf44 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:22.355183 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 793/1582] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:29:22.355937 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e9b8a8-46f9-4790-bf09-7fcf5f85a509 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:22.365503 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e9b8a8-46f9-4790-bf09-7fcf5f85a509 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:22.366004 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac8e24c-2803-46ae-acd7-02c0e795bf44 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:22.370126 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d28fc2b-27fd-418c-8f95-6602a7672218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:22.370700 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d28fc2b-27fd-418c-8f95-6602a7672218 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:22.370871 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32ae76a-11c8-4d54-bb53-26fbaf4887da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:22.371002 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d28fc2b-27fd-418c-8f95-6602a7672218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:22.371234 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d28fc2b-27fd-418c-8f95-6602a7672218 admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:22.371489 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ae76a-11c8-4d54-bb53-26fbaf4887da admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:22.371775 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ae76a-11c8-4d54-bb53-26fbaf4887da admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:22.371890 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d28fc2b-27fd-418c-8f95-6602a7672218 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:22.372046 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ae76a-11c8-4d54-bb53-26fbaf4887da admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:22.372688 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32ae76a-11c8-4d54-bb53-26fbaf4887da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:22.373819 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d28fc2b-27fd-418c-8f95-6602a7672218 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:22.374296 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32ae76a-11c8-4d54-bb53-26fbaf4887da admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:22.379629 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:22.387414 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 790/1583] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:29:22.388682 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32ae76a-11c8-4d54-bb53-26fbaf4887da admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:22.401049 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 794/1584] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:29:22 2022] POST /identity/v3/users => generated 293 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:29:22.401049 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d28fc2b-27fd-418c-8f95-6602a7672218 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:22.401308 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32ae76a-11c8-4d54-bb53-26fbaf4887da admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:22.405659 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0038d0d5-2ea3-48eb-9d96-9eb816c81f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:22.406260 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038d0d5-2ea3-48eb-9d96-9eb816c81f5a admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:22.406533 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038d0d5-2ea3-48eb-9d96-9eb816c81f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:22.406798 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038d0d5-2ea3-48eb-9d96-9eb816c81f5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:22.407460 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0038d0d5-2ea3-48eb-9d96-9eb816c81f5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:22.409161 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0038d0d5-2ea3-48eb-9d96-9eb816c81f5a admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:22.411027 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d28fc2b-27fd-418c-8f95-6602a7672218 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:22.415678 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98419ec3-9fda-4253-a672-eab1f1ba8b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:22.416266 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98419ec3-9fda-4253-a672-eab1f1ba8b30 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:22.416559 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98419ec3-9fda-4253-a672-eab1f1ba8b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:22.416823 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98419ec3-9fda-4253-a672-eab1f1ba8b30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:22.417464 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98419ec3-9fda-4253-a672-eab1f1ba8b30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:22.419054 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 791/1585] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:29:22.419171 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98419ec3-9fda-4253-a672-eab1f1ba8b30 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:22.419878 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0038d0d5-2ea3-48eb-9d96-9eb816c81f5a admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:22.428983 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0038d0d5-2ea3-48eb-9d96-9eb816c81f5a admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:22.432847 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 795/1586] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:29:22.432847 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98419ec3-9fda-4253-a672-eab1f1ba8b30 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:22.436816 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dccfb2f-6dec-4dfb-95b9-84041be100a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:22.437422 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dccfb2f-6dec-4dfb-95b9-84041be100a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:22.437706 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dccfb2f-6dec-4dfb-95b9-84041be100a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:22.437977 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dccfb2f-6dec-4dfb-95b9-84041be100a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:22.438668 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dccfb2f-6dec-4dfb-95b9-84041be100a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:22.440311 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dccfb2f-6dec-4dfb-95b9-84041be100a4 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:22.443288 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98419ec3-9fda-4253-a672-eab1f1ba8b30 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:22.449109 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f16511-3739-4579-b26f-cf53d63fb5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:22.449708 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f16511-3739-4579-b26f-cf53d63fb5c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:22.449985 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f16511-3739-4579-b26f-cf53d63fb5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:22.450256 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f16511-3739-4579-b26f-cf53d63fb5c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:22.450890 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f16511-3739-4579-b26f-cf53d63fb5c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:22.451507 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 792/1587] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:29:22.452522 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f16511-3739-4579-b26f-cf53d63fb5c2 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:22.452624 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dccfb2f-6dec-4dfb-95b9-84041be100a4 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:22.462801 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dccfb2f-6dec-4dfb-95b9-84041be100a4 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:22.464961 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 796/1588] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:29:22.465776 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f16511-3739-4579-b26f-cf53d63fb5c2 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:22.470341 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c0c86-9c16-4860-9b7e-787a94d19be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:22.470944 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c0c86-9c16-4860-9b7e-787a94d19be5 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:22.471226 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c0c86-9c16-4860-9b7e-787a94d19be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:22.472036 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c0c86-9c16-4860-9b7e-787a94d19be5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:22.472156 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60c0c86-9c16-4860-9b7e-787a94d19be5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:22.473737 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60c0c86-9c16-4860-9b7e-787a94d19be5 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:22.475290 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f16511-3739-4579-b26f-cf53d63fb5c2 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:22.479780 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd82f16b-4b87-4715-8ace-f53c3def91d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:22.480353 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82f16b-4b87-4715-8ace-f53c3def91d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:22.480629 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82f16b-4b87-4715-8ace-f53c3def91d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:22.480899 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82f16b-4b87-4715-8ace-f53c3def91d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:22.481518 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd82f16b-4b87-4715-8ace-f53c3def91d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:22.483103 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd82f16b-4b87-4715-8ace-f53c3def91d5 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:22.484402 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 793/1589] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:29:22.485269 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c0c86-9c16-4860-9b7e-787a94d19be5 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:22.493231 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 797/1590] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:29:22.494038 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd82f16b-4b87-4715-8ace-f53c3def91d5 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:22.495211 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c0c86-9c16-4860-9b7e-787a94d19be5 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:22.500299 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d1134-1ff8-4bb7-8215-d54b6adb76c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:22.500894 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d1134-1ff8-4bb7-8215-d54b6adb76c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:22.501172 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d1134-1ff8-4bb7-8215-d54b6adb76c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:22.501441 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d1134-1ff8-4bb7-8215-d54b6adb76c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:22.502076 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805d1134-1ff8-4bb7-8215-d54b6adb76c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:22.503687 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805d1134-1ff8-4bb7-8215-d54b6adb76c4 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:22.505323 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd82f16b-4b87-4715-8ace-f53c3def91d5 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:22.510376 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86574428-f000-499b-9315-f019ae676439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:22.510948 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86574428-f000-499b-9315-f019ae676439 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:22.511250 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86574428-f000-499b-9315-f019ae676439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:22.511827 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86574428-f000-499b-9315-f019ae676439 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:22.512143 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86574428-f000-499b-9315-f019ae676439 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:22.513716 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86574428-f000-499b-9315-f019ae676439 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:22.517463 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 794/1591] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:29:22.517463 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d1134-1ff8-4bb7-8215-d54b6adb76c4 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:22.525373 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d1134-1ff8-4bb7-8215-d54b6adb76c4 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:22.527051 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 798/1592] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:29:22.527909 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86574428-f000-499b-9315-f019ae676439 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:22.533386 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb8885-3404-429a-80d4-e2771b5a4767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:22.535842 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb8885-3404-429a-80d4-e2771b5a4767 admin admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:22.535842 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb8885-3404-429a-80d4-e2771b5a4767 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:22.535842 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb8885-3404-429a-80d4-e2771b5a4767 admin admin] PATH_INFO: `/v3/projects/69809c268b194aed8c90c9d7a9b308a8/users/38c2e7c6a31c4947a54508953733e983/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:22.537564 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86574428-f000-499b-9315-f019ae676439 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:22.542192 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b6fd3-3b39-4e6c-8523-a7803966c337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:22.542843 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b6fd3-3b39-4e6c-8523-a7803966c337 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:22.543120 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b6fd3-3b39-4e6c-8523-a7803966c337 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:22.543390 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b6fd3-3b39-4e6c-8523-a7803966c337 admin admin] PATH_INFO: `/v3/projects/c20f8587b32e42829bdcc8286e5b671a/users/eac14549c49a4896bdeb4d6674135298/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:22.551586 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fb8885-3404-429a-80d4-e2771b5a4767 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69809c268b194aed8c90c9d7a9b308a8, user_id=38c2e7c6a31c4947a54508953733e983, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:22.552637 dv-cinder-819668-6-smb devstack@keystone.service[81447]: WARNING py.warnings [None req-68fb8885-3404-429a-80d4-e2771b5a4767 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 01:29:22.552637 dv-cinder-819668-6-smb devstack@keystone.service[81447]: warnings.warn(msg) Aug 30 01:29:22.552637 dv-cinder-819668-6-smb devstack@keystone.service[81447]: Aug 30 01:29:22.554569 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fb8885-3404-429a-80d4-e2771b5a4767 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:22.558142 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3b6fd3-3b39-4e6c-8523-a7803966c337 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c20f8587b32e42829bdcc8286e5b671a, user_id=eac14549c49a4896bdeb4d6674135298, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:22.561007 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3b6fd3-3b39-4e6c-8523-a7803966c337 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:22.567650 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 795/1593] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:29:22 2022] PUT /identity/v3/projects/69809c268b194aed8c90c9d7a9b308a8/users/38c2e7c6a31c4947a54508953733e983/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:29:22.568464 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb8885-3404-429a-80d4-e2771b5a4767 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:22.575996 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 799/1594] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:29:22 2022] PUT /identity/v3/projects/c20f8587b32e42829bdcc8286e5b671a/users/eac14549c49a4896bdeb4d6674135298/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:29:22.577165 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b6fd3-3b39-4e6c-8523-a7803966c337 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:22.642937 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb8885-3404-429a-80d4-e2771b5a4767 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:22.643686 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b6fd3-3b39-4e6c-8523-a7803966c337 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:22.647597 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15fda19-765a-4b26-82cb-f63f1848f446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:22.648242 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9199547-fd70-44a7-9d05-64a41ebfe7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:22.648395 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15fda19-765a-4b26-82cb-f63f1848f446 admin admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:22.648522 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15fda19-765a-4b26-82cb-f63f1848f446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:22.649402 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15fda19-765a-4b26-82cb-f63f1848f446 admin admin] PATH_INFO: `/v3/projects/c5387643d3e0464a820529df26a29cfc/users/0648872a9f8648ca803418bc3a3b04b2/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:22.649528 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9199547-fd70-44a7-9d05-64a41ebfe7b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:22.649689 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9199547-fd70-44a7-9d05-64a41ebfe7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:22.649955 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9199547-fd70-44a7-9d05-64a41ebfe7b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:22.650625 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9199547-fd70-44a7-9d05-64a41ebfe7b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:22.652387 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9199547-fd70-44a7-9d05-64a41ebfe7b1 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:22.662539 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 800/1595] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:29:22.663463 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9199547-fd70-44a7-9d05-64a41ebfe7b1 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:22.664448 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15fda19-765a-4b26-82cb-f63f1848f446 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5387643d3e0464a820529df26a29cfc, user_id=0648872a9f8648ca803418bc3a3b04b2, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:22.667777 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15fda19-765a-4b26-82cb-f63f1848f446 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:22.676104 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9199547-fd70-44a7-9d05-64a41ebfe7b1 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:22.682819 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 796/1596] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:29:22 2022] PUT /identity/v3/projects/c5387643d3e0464a820529df26a29cfc/users/0648872a9f8648ca803418bc3a3b04b2/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:29:22.683882 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15fda19-765a-4b26-82cb-f63f1848f446 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:22.700033 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:22.736817 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42bed49-5053-4206-a3cf-d5bc60fad648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:22.737426 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42bed49-5053-4206-a3cf-d5bc60fad648 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:22.737707 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42bed49-5053-4206-a3cf-d5bc60fad648 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:22.737982 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42bed49-5053-4206-a3cf-d5bc60fad648 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:22.738630 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42bed49-5053-4206-a3cf-d5bc60fad648 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:22.740273 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42bed49-5053-4206-a3cf-d5bc60fad648 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:22.746211 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15fda19-765a-4b26-82cb-f63f1848f446 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:22.750489 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 801/1597] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:29:22.751221 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42bed49-5053-4206-a3cf-d5bc60fad648 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:22.754329 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad69e21-6358-48a4-ac37-fe68d02560bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:22.754996 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad69e21-6358-48a4-ac37-fe68d02560bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:22.755270 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad69e21-6358-48a4-ac37-fe68d02560bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:22.755567 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad69e21-6358-48a4-ac37-fe68d02560bf admin admin] PATH_INFO: `/v3/projects/7e0e671b3fe3461da0aa1badfd844f78/users/b9ee91e130434c8c9c7ce081dade1395/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:22.761496 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42bed49-5053-4206-a3cf-d5bc60fad648 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:22.766113 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ef56d-1f6f-4be6-9279-5a05661a7563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:22.766748 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ef56d-1f6f-4be6-9279-5a05661a7563 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:22.767031 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ef56d-1f6f-4be6-9279-5a05661a7563 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:22.767309 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ef56d-1f6f-4be6-9279-5a05661a7563 admin admin] PATH_INFO: `/v3/projects/27e942df9038496eb3e978500dc68a69/users/7e8558a33a7d4154b5180ad44216c652/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:22.771146 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad69e21-6358-48a4-ac37-fe68d02560bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e0e671b3fe3461da0aa1badfd844f78, user_id=b9ee91e130434c8c9c7ce081dade1395, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:22.773938 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad69e21-6358-48a4-ac37-fe68d02560bf admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:22.781970 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:22.783360 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ef56d-1f6f-4be6-9279-5a05661a7563 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27e942df9038496eb3e978500dc68a69, user_id=7e8558a33a7d4154b5180ad44216c652, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:22.786151 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ef56d-1f6f-4be6-9279-5a05661a7563 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:22.790430 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 797/1598] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:29:22 2022] PUT /identity/v3/projects/7e0e671b3fe3461da0aa1badfd844f78/users/b9ee91e130434c8c9c7ce081dade1395/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:29:22.791382 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad69e21-6358-48a4-ac37-fe68d02560bf admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:22.800160 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 802/1599] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:29:22 2022] PUT /identity/v3/projects/27e942df9038496eb3e978500dc68a69/users/7e8558a33a7d4154b5180ad44216c652/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:29:22.801412 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35252bc-d0fc-436c-b94c-344e2672dfdf None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:22.801703 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35252bc-d0fc-436c-b94c-344e2672dfdf None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:22.802008 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35252bc-d0fc-436c-b94c-344e2672dfdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:22.829819 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-f35252bc-d0fc-436c-b94c-344e2672dfdf None None] MFA Rules not processed for user `38c2e7c6a31c4947a54508953733e983`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:22.831081 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-f35252bc-d0fc-436c-b94c-344e2672dfdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:22.858428 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad69e21-6358-48a4-ac37-fe68d02560bf admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:22.896913 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 803/1600] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:22 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:22.900746 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d580e2e-baaa-48cb-b0f0-348c5112ddb8 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:22.901035 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d580e2e-baaa-48cb-b0f0-348c5112ddb8 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:22.901306 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d580e2e-baaa-48cb-b0f0-348c5112ddb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:22.917369 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad67e80-af12-41a8-8f96-4c5ee950e4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:22.917985 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad67e80-af12-41a8-8f96-4c5ee950e4b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:22.918260 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad67e80-af12-41a8-8f96-4c5ee950e4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:22.918529 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad67e80-af12-41a8-8f96-4c5ee950e4b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:22.919167 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad67e80-af12-41a8-8f96-4c5ee950e4b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:22.920819 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad67e80-af12-41a8-8f96-4c5ee950e4b4 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:22.928819 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-1d580e2e-baaa-48cb-b0f0-348c5112ddb8 None None] MFA Rules not processed for user `eac14549c49a4896bdeb4d6674135298`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:22.930740 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-1d580e2e-baaa-48cb-b0f0-348c5112ddb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:22.931341 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 798/1601] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:29:22.932149 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad67e80-af12-41a8-8f96-4c5ee950e4b4 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:22.941558 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad67e80-af12-41a8-8f96-4c5ee950e4b4 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:22.946695 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa79de-c93d-4912-aa5b-8a5075eea218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:22.947326 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa79de-c93d-4912-aa5b-8a5075eea218 admin admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:22.947637 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa79de-c93d-4912-aa5b-8a5075eea218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:22.947917 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa79de-c93d-4912-aa5b-8a5075eea218 admin admin] PATH_INFO: `/v3/projects/fc70ed6d5f5344f28554bcda77c1a552/users/55904c5143cd4836bf6e3a97e9262eb7/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:22.962913 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baa79de-c93d-4912-aa5b-8a5075eea218 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc70ed6d5f5344f28554bcda77c1a552, user_id=55904c5143cd4836bf6e3a97e9262eb7, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:22.965601 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baa79de-c93d-4912-aa5b-8a5075eea218 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:22.979952 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 799/1602] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:29:22 2022] PUT /identity/v3/projects/fc70ed6d5f5344f28554bcda77c1a552/users/55904c5143cd4836bf6e3a97e9262eb7/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:29:22.981299 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa17be5-692e-4546-a8d0-674327ad7d74 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:22.981685 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa17be5-692e-4546-a8d0-674327ad7d74 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:22.982056 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa17be5-692e-4546-a8d0-674327ad7d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:22.999399 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 804/1603] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:23.000248 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d580e2e-baaa-48cb-b0f0-348c5112ddb8 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:23.001633 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-8fa17be5-692e-4546-a8d0-674327ad7d74 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:23.002819 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-8fa17be5-692e-4546-a8d0-674327ad7d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:23.011048 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d580e2e-baaa-48cb-b0f0-348c5112ddb8 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:23.022677 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:23.074536 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f95520e-bc38-4cbd-bde3-b79b068f3f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:23.075199 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95520e-bc38-4cbd-bde3-b79b068f3f52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:23.075531 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95520e-bc38-4cbd-bde3-b79b068f3f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:23.075810 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95520e-bc38-4cbd-bde3-b79b068f3f52 admin admin] PATH_INFO: `/v3/projects/2fe15daea3ae4f86af35bdfda9dac52e/users/e542da06f5f24869aa810bdc36926ae1/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:23.076756 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 800/1604] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:23.080180 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c61a06-ca6c-4ba3-8286-8f84dea5e58f None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:23.080180 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c61a06-ca6c-4ba3-8286-8f84dea5e58f None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:23.080180 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c61a06-ca6c-4ba3-8286-8f84dea5e58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:23.091530 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f95520e-bc38-4cbd-bde3-b79b068f3f52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fe15daea3ae4f86af35bdfda9dac52e, user_id=e542da06f5f24869aa810bdc36926ae1, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:23.094237 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f95520e-bc38-4cbd-bde3-b79b068f3f52 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:23.098297 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-77c61a06-ca6c-4ba3-8286-8f84dea5e58f None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:23.099551 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-77c61a06-ca6c-4ba3-8286-8f84dea5e58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:23.107890 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 801/1605] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:23.109102 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5784b-03ee-41c5-832e-7b5c0b889b67 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:23.109439 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5784b-03ee-41c5-832e-7b5c0b889b67 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:23.109662 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5784b-03ee-41c5-832e-7b5c0b889b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:23.111692 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 805/1606] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:29:22 2022] PUT /identity/v3/projects/2fe15daea3ae4f86af35bdfda9dac52e/users/e542da06f5f24869aa810bdc36926ae1/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:29:23.113356 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f95520e-bc38-4cbd-bde3-b79b068f3f52 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:23.129462 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-90e5784b-03ee-41c5-832e-7b5c0b889b67 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:23.130668 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-90e5784b-03ee-41c5-832e-7b5c0b889b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:23.136171 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:23.179630 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f95520e-bc38-4cbd-bde3-b79b068f3f52 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:23.184961 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4786f36-04de-4f6d-8f32-c73a33e3e281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:23.185562 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4786f36-04de-4f6d-8f32-c73a33e3e281 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:23.185844 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4786f36-04de-4f6d-8f32-c73a33e3e281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:23.186122 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4786f36-04de-4f6d-8f32-c73a33e3e281 admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:23.186752 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4786f36-04de-4f6d-8f32-c73a33e3e281 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:23.188759 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4786f36-04de-4f6d-8f32-c73a33e3e281 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:23.194386 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 802/1607] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:23.194386 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e5784b-03ee-41c5-832e-7b5c0b889b67 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:23.203949 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e5784b-03ee-41c5-832e-7b5c0b889b67 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:23.208955 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb6d92-5fbd-4c79-a24d-fbba99dfdab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:23.209620 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb6d92-5fbd-4c79-a24d-fbba99dfdab7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:23.209928 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb6d92-5fbd-4c79-a24d-fbba99dfdab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:23.210277 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb6d92-5fbd-4c79-a24d-fbba99dfdab7 admin admin] PATH_INFO: `/v3/projects/06927fb76c3e4d9994140b11a6f69241/users/a991f1a0f804497c91d21d69e33113ed/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:23.220938 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 806/1608] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:29:23 2022] POST /identity/v3/projects => generated 393 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:29:23.220938 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c762cf-3d90-41f6-9057-5c40f0b72478 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:23.220938 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c762cf-3d90-41f6-9057-5c40f0b72478 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:23.220938 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c762cf-3d90-41f6-9057-5c40f0b72478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:23.225561 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fb6d92-5fbd-4c79-a24d-fbba99dfdab7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06927fb76c3e4d9994140b11a6f69241, user_id=a991f1a0f804497c91d21d69e33113ed, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:23.228798 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fb6d92-5fbd-4c79-a24d-fbba99dfdab7 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:23.240097 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-76c762cf-3d90-41f6-9057-5c40f0b72478 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:23.241312 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-76c762cf-3d90-41f6-9057-5c40f0b72478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:23.241864 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 803/1609] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:29:23 2022] PUT /identity/v3/projects/06927fb76c3e4d9994140b11a6f69241/users/a991f1a0f804497c91d21d69e33113ed/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:29:23.243867 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30410901-c8d5-4085-98c9-789af5274514 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:23.244150 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30410901-c8d5-4085-98c9-789af5274514 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:23.244417 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30410901-c8d5-4085-98c9-789af5274514 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:23.245636 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 804/1610] 10.222.0.60 () {54 vars in 962 bytes} [Tue Aug 30 01:29:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:29:23.246554 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30410901-c8d5-4085-98c9-789af5274514 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:23.304432 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30410901-c8d5-4085-98c9-789af5274514 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:23.304681 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 807/1611] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:23.305877 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c762cf-3d90-41f6-9057-5c40f0b72478 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:23.311707 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa7b84b-ebcd-4f9f-ba65-a311f75b2aa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:23.312333 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7b84b-ebcd-4f9f-ba65-a311f75b2aa6 service neutron] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:23.312606 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7b84b-ebcd-4f9f-ba65-a311f75b2aa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:23.312879 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7b84b-ebcd-4f9f-ba65-a311f75b2aa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:23.315164 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c762cf-3d90-41f6-9057-5c40f0b72478 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:23.318697 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b9dda-0b63-412d-97ea-b782f6c0c84f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:23.319280 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b9dda-0b63-412d-97ea-b782f6c0c84f service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:23.319589 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b9dda-0b63-412d-97ea-b782f6c0c84f service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:23.319855 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b9dda-0b63-412d-97ea-b782f6c0c84f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:23.323034 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa7b84b-ebcd-4f9f-ba65-a311f75b2aa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:23.324505 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa7b84b-ebcd-4f9f-ba65-a311f75b2aa6 service neutron] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:23.329126 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359b9dda-0b63-412d-97ea-b782f6c0c84f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:23.330660 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359b9dda-0b63-412d-97ea-b782f6c0c84f service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:23.334090 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 805/1612] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:29:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:29:23.335547 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3b9ec-9d29-4cd4-908e-19f4dd2f273e None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:23.335895 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3b9ec-9d29-4cd4-908e-19f4dd2f273e None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:23.336998 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3b9ec-9d29-4cd4-908e-19f4dd2f273e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:23.341378 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 808/1613] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:29:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:29:23.344405 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b9dda-0b63-412d-97ea-b782f6c0c84f service neutron] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:23.355517 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b9dda-0b63-412d-97ea-b782f6c0c84f service neutron] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:23.360722 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1385cecb-8ebc-4474-967b-cce04103c3bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:23.361098 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1385cecb-8ebc-4474-967b-cce04103c3bf service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:23.361353 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1385cecb-8ebc-4474-967b-cce04103c3bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:23.361664 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1385cecb-8ebc-4474-967b-cce04103c3bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:23.369080 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-39f3b9ec-9d29-4cd4-908e-19f4dd2f273e None None] MFA Rules not processed for user `e542da06f5f24869aa810bdc36926ae1`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:23.370379 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-39f3b9ec-9d29-4cd4-908e-19f4dd2f273e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:23.373196 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1385cecb-8ebc-4474-967b-cce04103c3bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:23.375330 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1385cecb-8ebc-4474-967b-cce04103c3bf service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:23.379869 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:23.388967 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 809/1614] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:29:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:29:23.389848 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1385cecb-8ebc-4474-967b-cce04103c3bf service neutron] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:23.400329 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1385cecb-8ebc-4474-967b-cce04103c3bf service neutron] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:23.406326 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b88a32c-7b5e-45b3-8ef5-ad7db3aeac2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:23.407019 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88a32c-7b5e-45b3-8ef5-ad7db3aeac2f admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:23.407305 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88a32c-7b5e-45b3-8ef5-ad7db3aeac2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:23.407926 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88a32c-7b5e-45b3-8ef5-ad7db3aeac2f admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:23.408635 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b88a32c-7b5e-45b3-8ef5-ad7db3aeac2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:23.411665 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b88a32c-7b5e-45b3-8ef5-ad7db3aeac2f admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:23.444200 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 810/1615] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:29:23 2022] POST /identity/v3/users => generated 303 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:29:23.445502 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b7265-a7d4-4003-a051-9327a041e351 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:23.447681 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b7265-a7d4-4003-a051-9327a041e351 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:23.447681 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b7265-a7d4-4003-a051-9327a041e351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:23.468928 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 806/1616] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:23.472775 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d4d6ae-e303-43bf-8d37-43fb54080338 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:23.472775 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d4d6ae-e303-43bf-8d37-43fb54080338 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:23.473099 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-142b7265-a7d4-4003-a051-9327a041e351 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:23.473190 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d4d6ae-e303-43bf-8d37-43fb54080338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:23.473267 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-142b7265-a7d4-4003-a051-9327a041e351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:23.482116 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 811/1617] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:23.483053 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b7265-a7d4-4003-a051-9327a041e351 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:23.501977 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b7265-a7d4-4003-a051-9327a041e351 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:23.512817 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b4f8aa-4943-4b33-9ffb-20595573f8b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:23.514135 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4f8aa-4943-4b33-9ffb-20595573f8b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:23.514436 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4f8aa-4943-4b33-9ffb-20595573f8b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:23.514684 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4f8aa-4943-4b33-9ffb-20595573f8b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:23.538934 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b4f8aa-4943-4b33-9ffb-20595573f8b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:23.543378 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b4f8aa-4943-4b33-9ffb-20595573f8b7 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:23.547512 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:23.554718 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-44d4d6ae-e303-43bf-8d37-43fb54080338 None None] MFA Rules not processed for user `8889145228a24fb6bd539a11925e62f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:23.559150 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-44d4d6ae-e303-43bf-8d37-43fb54080338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:23.569792 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 812/1618] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:29:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:29:23.570982 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b4f8aa-4943-4b33-9ffb-20595573f8b7 service neutron] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:23.582296 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b4f8aa-4943-4b33-9ffb-20595573f8b7 service neutron] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:23.593076 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decbbf2f-b2e4-42a9-ab4e-dfc8940a4008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:23.594473 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decbbf2f-b2e4-42a9-ab4e-dfc8940a4008 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:23.595005 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decbbf2f-b2e4-42a9-ab4e-dfc8940a4008 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:23.595571 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decbbf2f-b2e4-42a9-ab4e-dfc8940a4008 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:23.596641 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decbbf2f-b2e4-42a9-ab4e-dfc8940a4008 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:23.599205 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decbbf2f-b2e4-42a9-ab4e-dfc8940a4008 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:23.618627 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 813/1619] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:29:23 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:29:23.620573 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decbbf2f-b2e4-42a9-ab4e-dfc8940a4008 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:23.636472 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decbbf2f-b2e4-42a9-ab4e-dfc8940a4008 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:23.645963 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c1fcdd-cf45-4c5e-b82f-ea3205f1fd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:23.646725 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1fcdd-cf45-4c5e-b82f-ea3205f1fd17 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:23.647008 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1fcdd-cf45-4c5e-b82f-ea3205f1fd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:23.647349 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1fcdd-cf45-4c5e-b82f-ea3205f1fd17 admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:23.651508 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c1fcdd-cf45-4c5e-b82f-ea3205f1fd17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:23.653830 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c1fcdd-cf45-4c5e-b82f-ea3205f1fd17 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:23.680061 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 807/1620] 10.222.0.60 () {58 vars in 1059 bytes} [Tue Aug 30 01:29:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:23.681350 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d4d6ae-e303-43bf-8d37-43fb54080338 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:23.686504 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 814/1621] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:29:23 2022] POST /identity/v3/projects => generated 369 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:29:23.687373 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c1fcdd-cf45-4c5e-b82f-ea3205f1fd17 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:23.691766 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d4d6ae-e303-43bf-8d37-43fb54080338 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:23.757107 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3229e77d-6490-4c52-87e4-444da83adfb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:23.758516 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229e77d-6490-4c52-87e4-444da83adfb2 service neutron] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:23.758794 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229e77d-6490-4c52-87e4-444da83adfb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:23.759409 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229e77d-6490-4c52-87e4-444da83adfb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:23.770899 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c1fcdd-cf45-4c5e-b82f-ea3205f1fd17 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:23.776571 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3229e77d-6490-4c52-87e4-444da83adfb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:23.778918 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00750f50-a009-41f7-bef7-5d9eb6e4fb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:23.779463 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3229e77d-6490-4c52-87e4-444da83adfb2 service neutron] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:23.779906 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00750f50-a009-41f7-bef7-5d9eb6e4fb99 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:23.780209 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00750f50-a009-41f7-bef7-5d9eb6e4fb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:23.780481 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00750f50-a009-41f7-bef7-5d9eb6e4fb99 admin admin] PATH_INFO: `/v3/projects/33547ba157684f218e21552ff96c8d12/users/6e1cb804990949ca8cb7ed49fc2876bd/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:23.797039 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 808/1622] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:29:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:29:23.798273 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3229e77d-6490-4c52-87e4-444da83adfb2 service neutron] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:23.801856 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00750f50-a009-41f7-bef7-5d9eb6e4fb99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33547ba157684f218e21552ff96c8d12, user_id=6e1cb804990949ca8cb7ed49fc2876bd, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:23.805610 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00750f50-a009-41f7-bef7-5d9eb6e4fb99 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:23.812240 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3229e77d-6490-4c52-87e4-444da83adfb2 service neutron] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:23.818844 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd27d990-f1bc-4117-ab6f-7c5af64599a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:23.819128 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd27d990-f1bc-4117-ab6f-7c5af64599a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:23.819623 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd27d990-f1bc-4117-ab6f-7c5af64599a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:23.819906 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd27d990-f1bc-4117-ab6f-7c5af64599a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:23.820575 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd27d990-f1bc-4117-ab6f-7c5af64599a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:23.824321 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd27d990-f1bc-4117-ab6f-7c5af64599a7 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:23.832955 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 815/1623] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:29:23 2022] PUT /identity/v3/projects/33547ba157684f218e21552ff96c8d12/users/6e1cb804990949ca8cb7ed49fc2876bd/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:29:23.836479 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00750f50-a009-41f7-bef7-5d9eb6e4fb99 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:23.863121 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 809/1624] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:29:23 2022] POST /identity/v3/users => generated 291 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:29:23.863121 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd27d990-f1bc-4117-ab6f-7c5af64599a7 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:23.890243 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd27d990-f1bc-4117-ab6f-7c5af64599a7 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:23.969305 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00750f50-a009-41f7-bef7-5d9eb6e4fb99 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:23.973259 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba4003-88e1-4d56-9d1c-81d38bb3209f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:23.974118 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba4003-88e1-4d56-9d1c-81d38bb3209f admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:23.974681 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba4003-88e1-4d56-9d1c-81d38bb3209f admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:23.976431 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba4003-88e1-4d56-9d1c-81d38bb3209f admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:23.976431 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ba4003-88e1-4d56-9d1c-81d38bb3209f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:23.976620 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10334f6b-b088-4f32-8d9a-53a8c8e58310 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8889145228a24fb6bd539a11925e62f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:23.978091 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10334f6b-b088-4f32-8d9a-53a8c8e58310 service nova] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:23.978530 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10334f6b-b088-4f32-8d9a-53a8c8e58310 service nova] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:23.978815 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10334f6b-b088-4f32-8d9a-53a8c8e58310 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:23.981486 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ba4003-88e1-4d56-9d1c-81d38bb3209f admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:23.987230 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:24.005537 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 810/1625] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:29:23 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:29:24.007027 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba4003-88e1-4d56-9d1c-81d38bb3209f admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:24.025712 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba4003-88e1-4d56-9d1c-81d38bb3209f admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:24.033393 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c516e-63b3-4bfd-a856-f83a17437ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:24.035102 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c516e-63b3-4bfd-a856-f83a17437ec5 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:24.035514 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c516e-63b3-4bfd-a856-f83a17437ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:24.036361 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c516e-63b3-4bfd-a856-f83a17437ec5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:24.037330 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6c516e-63b3-4bfd-a856-f83a17437ec5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:24.040397 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6c516e-63b3-4bfd-a856-f83a17437ec5 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:24.066715 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 811/1626] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:29:24 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:29:24.073677 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c516e-63b3-4bfd-a856-f83a17437ec5 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:24.090110 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10334f6b-b088-4f32-8d9a-53a8c8e58310 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:24.090859 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c516e-63b3-4bfd-a856-f83a17437ec5 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:24.094285 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10334f6b-b088-4f32-8d9a-53a8c8e58310 service nova] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:24.098560 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a0a88-839d-4b33-bdc8-e0ae89d51d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:24.099249 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a0a88-839d-4b33-bdc8-e0ae89d51d5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:24.099857 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a0a88-839d-4b33-bdc8-e0ae89d51d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:24.100193 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a0a88-839d-4b33-bdc8-e0ae89d51d5e admin admin] PATH_INFO: `/v3/projects/33547ba157684f218e21552ff96c8d12/users/6e1cb804990949ca8cb7ed49fc2876bd/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:24.103220 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619a0a88-839d-4b33-bdc8-e0ae89d51d5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=33547ba157684f218e21552ff96c8d12, user_id=6e1cb804990949ca8cb7ed49fc2876bd, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:24.108631 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619a0a88-839d-4b33-bdc8-e0ae89d51d5e admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:24.110516 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 816/1627] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:29:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:29:24.112016 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10334f6b-b088-4f32-8d9a-53a8c8e58310 service nova] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:24.113043 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:24.126398 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 812/1628] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:29:24 2022] PUT /identity/v3/projects/33547ba157684f218e21552ff96c8d12/users/6e1cb804990949ca8cb7ed49fc2876bd/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:29:24.128256 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10334f6b-b088-4f32-8d9a-53a8c8e58310 service nova] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:24.139419 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b7e76-fb78-46bb-b0aa-4a9451430f26 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:24.140202 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b7e76-fb78-46bb-b0aa-4a9451430f26 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:24.140656 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b7e76-fb78-46bb-b0aa-4a9451430f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:24.226985 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee0cea-ec3b-4b89-804d-8488914427c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:24.228638 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee0cea-ec3b-4b89-804d-8488914427c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:24.229356 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee0cea-ec3b-4b89-804d-8488914427c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:24.229834 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee0cea-ec3b-4b89-804d-8488914427c0 admin admin] PATH_INFO: `/v3/projects/5489cb1fcfff4be6a2726c465b33f7ca/users/d32059d1b3f64f71aad1d653a59a968a/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:24.239527 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-358b7e76-fb78-46bb-b0aa-4a9451430f26 None None] MFA Rules not processed for user `6e1cb804990949ca8cb7ed49fc2876bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:24.244075 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-358b7e76-fb78-46bb-b0aa-4a9451430f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:24.262911 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ee0cea-ec3b-4b89-804d-8488914427c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5489cb1fcfff4be6a2726c465b33f7ca, user_id=d32059d1b3f64f71aad1d653a59a968a, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:24.268427 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ee0cea-ec3b-4b89-804d-8488914427c0 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:24.310655 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 817/1629] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:29:24 2022] PUT /identity/v3/projects/5489cb1fcfff4be6a2726c465b33f7ca/users/d32059d1b3f64f71aad1d653a59a968a/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:29:24.313117 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee0cea-ec3b-4b89-804d-8488914427c0 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:24.461266 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 813/1630] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:24 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:29:24.470509 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b7e76-fb78-46bb-b0aa-4a9451430f26 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:24.504585 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee0cea-ec3b-4b89-804d-8488914427c0 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:24.519414 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8150fe-edaf-43ce-ac77-bd1239335e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:24.520061 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8150fe-edaf-43ce-ac77-bd1239335e95 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:24.520404 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8150fe-edaf-43ce-ac77-bd1239335e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:24.520859 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8150fe-edaf-43ce-ac77-bd1239335e95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:24.521605 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8150fe-edaf-43ce-ac77-bd1239335e95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:24.526515 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8150fe-edaf-43ce-ac77-bd1239335e95 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:24.545426 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 818/1631] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:29:24 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:29:24.550903 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8150fe-edaf-43ce-ac77-bd1239335e95 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:24.591902 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8150fe-edaf-43ce-ac77-bd1239335e95 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:24.616796 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c8ade6-a64b-4682-b834-e99964a358e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:24.618753 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8ade6-a64b-4682-b834-e99964a358e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:24.619033 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8ade6-a64b-4682-b834-e99964a358e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:24.619308 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8ade6-a64b-4682-b834-e99964a358e1 admin admin] PATH_INFO: `/v3/projects/5489cb1fcfff4be6a2726c465b33f7ca/users/d32059d1b3f64f71aad1d653a59a968a/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:24.621394 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b7e76-fb78-46bb-b0aa-4a9451430f26 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:24.621659 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c8ade6-a64b-4682-b834-e99964a358e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5489cb1fcfff4be6a2726c465b33f7ca, user_id=d32059d1b3f64f71aad1d653a59a968a, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:24.625285 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c8ade6-a64b-4682-b834-e99964a358e1 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:24.652332 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 819/1632] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:29:24 2022] PUT /identity/v3/projects/5489cb1fcfff4be6a2726c465b33f7ca/users/d32059d1b3f64f71aad1d653a59a968a/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:29:24.657883 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67afa3e5-c118-45f1-ad14-05105912a6d6 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:24.658190 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67afa3e5-c118-45f1-ad14-05105912a6d6 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:24.658486 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67afa3e5-c118-45f1-ad14-05105912a6d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:24.719061 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d66ad7-123b-4153-ac65-cac5f18aaf21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:24.723814 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:24.725625 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d66ad7-123b-4153-ac65-cac5f18aaf21 service cinder] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:24.726325 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d66ad7-123b-4153-ac65-cac5f18aaf21 service cinder] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:24.727640 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d66ad7-123b-4153-ac65-cac5f18aaf21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:24.732240 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-67afa3e5-c118-45f1-ad14-05105912a6d6 None None] MFA Rules not processed for user `d32059d1b3f64f71aad1d653a59a968a`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:24.733479 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-67afa3e5-c118-45f1-ad14-05105912a6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:24.801269 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:24.817725 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d66ad7-123b-4153-ac65-cac5f18aaf21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:24.819331 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d66ad7-123b-4153-ac65-cac5f18aaf21 service cinder] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:24.833356 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 814/1633] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:29:24 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:29:24.872800 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33808c-a39a-49b9-ae83-70e846585566 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:24.873366 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33808c-a39a-49b9-ae83-70e846585566 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:24.873798 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33808c-a39a-49b9-ae83-70e846585566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:24.892938 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 820/1634] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:24 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:24.906999 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67afa3e5-c118-45f1-ad14-05105912a6d6 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:24.958905 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-6e33808c-a39a-49b9-ae83-70e846585566 None None] MFA Rules not processed for user `7e8558a33a7d4154b5180ad44216c652`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:24.960651 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-6e33808c-a39a-49b9-ae83-70e846585566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:25.029464 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67afa3e5-c118-45f1-ad14-05105912a6d6 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:25.033934 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e043ae78-cada-4371-95d4-7edc5154402a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:25.034789 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043ae78-cada-4371-95d4-7edc5154402a service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:25.035072 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043ae78-cada-4371-95d4-7edc5154402a service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:25.035349 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043ae78-cada-4371-95d4-7edc5154402a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:25.050522 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e043ae78-cada-4371-95d4-7edc5154402a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:25.052567 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e043ae78-cada-4371-95d4-7edc5154402a service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:25.067137 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 821/1635] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:29:24 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:29:25.068458 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e043ae78-cada-4371-95d4-7edc5154402a service cinder] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:25.080488 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e043ae78-cada-4371-95d4-7edc5154402a service cinder] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:25.087471 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd0b5c1-ddc3-4a58-99da-06ba27272795 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:25.089899 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd0b5c1-ddc3-4a58-99da-06ba27272795 service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:25.090305 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd0b5c1-ddc3-4a58-99da-06ba27272795 service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:25.090859 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd0b5c1-ddc3-4a58-99da-06ba27272795 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:25.121363 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 815/1636] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:24 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:25.122829 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4575597-6037-4c20-aafe-6867c6e13f36 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:25.123751 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4575597-6037-4c20-aafe-6867c6e13f36 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:25.123751 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4575597-6037-4c20-aafe-6867c6e13f36 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:25.130033 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 816/1637] 10.222.0.60 () {54 vars in 962 bytes} [Tue Aug 30 01:29:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:29:25.131161 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4575597-6037-4c20-aafe-6867c6e13f36 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:25.171549 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd0b5c1-ddc3-4a58-99da-06ba27272795 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:25.173770 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd0b5c1-ddc3-4a58-99da-06ba27272795 service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:25.188414 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 822/1638] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:29:25 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:29:25.190043 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b5fdb-7dd4-405c-b924-e00052328225 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:25.190233 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b5fdb-7dd4-405c-b924-e00052328225 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:25.190515 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b5fdb-7dd4-405c-b924-e00052328225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:25.220627 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-c35b5fdb-7dd4-405c-b924-e00052328225 None None] MFA Rules not processed for user `8889145228a24fb6bd539a11925e62f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:25.221933 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-c35b5fdb-7dd4-405c-b924-e00052328225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:25.238483 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4575597-6037-4c20-aafe-6867c6e13f36 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:25.265239 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e168ca3a-4eb8-4764-b96b-3f1ca9df9e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:25.266684 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e168ca3a-4eb8-4764-b96b-3f1ca9df9e8c admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:25.267610 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e168ca3a-4eb8-4764-b96b-3f1ca9df9e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:25.268038 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e168ca3a-4eb8-4764-b96b-3f1ca9df9e8c admin admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:25.268971 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e168ca3a-4eb8-4764-b96b-3f1ca9df9e8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:25.271060 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e168ca3a-4eb8-4764-b96b-3f1ca9df9e8c admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:25.288764 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:25.334980 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 817/1639] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:29:25 2022] POST /identity/v3/projects => generated 405 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:29:25.338911 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e168ca3a-4eb8-4764-b96b-3f1ca9df9e8c admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:25.339758 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 823/1640] 10.222.0.60 () {58 vars in 1059 bytes} [Tue Aug 30 01:29:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:25.345510 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52c34b-e603-4fea-9a24-a8158023a448 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:25.345798 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52c34b-e603-4fea-9a24-a8158023a448 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:25.346075 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52c34b-e603-4fea-9a24-a8158023a448 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:25.348913 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 824/1641] 10.222.0.60 () {54 vars in 912 bytes} [Tue Aug 30 01:29:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:29:25.354948 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7daf29-8626-4ebc-aa09-958ebbf5b513 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:25.355291 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7daf29-8626-4ebc-aa09-958ebbf5b513 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:25.355597 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7daf29-8626-4ebc-aa09-958ebbf5b513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:25.430602 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-3e7daf29-8626-4ebc-aa09-958ebbf5b513 None None] MFA Rules not processed for user `8889145228a24fb6bd539a11925e62f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:25.433465 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-3e7daf29-8626-4ebc-aa09-958ebbf5b513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:25.513092 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e168ca3a-4eb8-4764-b96b-3f1ca9df9e8c admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:25.522378 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1712bd62-bb7d-4215-b418-34c37f4f0fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:25.523247 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712bd62-bb7d-4215-b418-34c37f4f0fce admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:25.523673 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712bd62-bb7d-4215-b418-34c37f4f0fce admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:25.524676 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712bd62-bb7d-4215-b418-34c37f4f0fce admin admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:25.525404 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1712bd62-bb7d-4215-b418-34c37f4f0fce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:25.528329 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1712bd62-bb7d-4215-b418-34c37f4f0fce admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:25.542568 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:25.573382 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 818/1642] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:29:25 2022] POST /identity/v3/users => generated 309 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:29:25.575826 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1712bd62-bb7d-4215-b418-34c37f4f0fce admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:25.601225 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 825/1643] 10.222.0.60 () {58 vars in 1009 bytes} [Tue Aug 30 01:29:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:29:25.604771 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1712bd62-bb7d-4215-b418-34c37f4f0fce admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:25.610305 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf8316-02aa-4e57-bca3-72072592c41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:25.611048 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf8316-02aa-4e57-bca3-72072592c41e admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:25.611314 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf8316-02aa-4e57-bca3-72072592c41e admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:25.611708 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf8316-02aa-4e57-bca3-72072592c41e admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:25.612456 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdf8316-02aa-4e57-bca3-72072592c41e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:25.617300 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdf8316-02aa-4e57-bca3-72072592c41e admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:25.632330 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 819/1644] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:29:25 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:29:25.637293 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7daf29-8626-4ebc-aa09-958ebbf5b513 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:25.649906 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf8316-02aa-4e57-bca3-72072592c41e admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:25.655333 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7daf29-8626-4ebc-aa09-958ebbf5b513 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:25.666333 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d733ce-4390-4972-a781-e21974873ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:25.667028 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d733ce-4390-4972-a781-e21974873ee7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:25.667292 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d733ce-4390-4972-a781-e21974873ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:25.667591 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d733ce-4390-4972-a781-e21974873ee7 admin admin] PATH_INFO: `/v3/projects/9d2efb6727da4c1c8fda7f24d1768527/users/cdab0d70c2d941c5888b9738dc0b5789/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:25.709223 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d733ce-4390-4972-a781-e21974873ee7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d2efb6727da4c1c8fda7f24d1768527, user_id=cdab0d70c2d941c5888b9738dc0b5789, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:25.718257 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d733ce-4390-4972-a781-e21974873ee7 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:25.753043 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 826/1645] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:29:25 2022] PUT /identity/v3/projects/9d2efb6727da4c1c8fda7f24d1768527/users/cdab0d70c2d941c5888b9738dc0b5789/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:29:25.754209 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d733ce-4390-4972-a781-e21974873ee7 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:25.779506 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf8316-02aa-4e57-bca3-72072592c41e admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:25.893694 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91571cf-af82-445c-b91b-b747ab545e8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:25.894739 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91571cf-af82-445c-b91b-b747ab545e8f service cinder] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:25.895060 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91571cf-af82-445c-b91b-b747ab545e8f service cinder] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:25.895447 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91571cf-af82-445c-b91b-b747ab545e8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:25.919861 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d733ce-4390-4972-a781-e21974873ee7 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:25.926734 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44eea57-32dd-4ca5-b4d6-3f24e81b3aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:25.927350 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44eea57-32dd-4ca5-b4d6-3f24e81b3aee admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:25.927704 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44eea57-32dd-4ca5-b4d6-3f24e81b3aee admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:25.928832 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44eea57-32dd-4ca5-b4d6-3f24e81b3aee admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:25.929541 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44eea57-32dd-4ca5-b4d6-3f24e81b3aee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:25.932167 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44eea57-32dd-4ca5-b4d6-3f24e81b3aee admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:25.946955 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 827/1646] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:29:25 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:29:25.952061 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44eea57-32dd-4ca5-b4d6-3f24e81b3aee admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:25.968476 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44eea57-32dd-4ca5-b4d6-3f24e81b3aee admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:25.974138 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d819025-4acf-43ab-9321-d5e0aa69dc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:25.975396 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d819025-4acf-43ab-9321-d5e0aa69dc94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:25.976015 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d819025-4acf-43ab-9321-d5e0aa69dc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:25.976015 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d819025-4acf-43ab-9321-d5e0aa69dc94 admin admin] PATH_INFO: `/v3/projects/9d2efb6727da4c1c8fda7f24d1768527/users/cdab0d70c2d941c5888b9738dc0b5789/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:25.980345 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d819025-4acf-43ab-9321-d5e0aa69dc94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d2efb6727da4c1c8fda7f24d1768527, user_id=cdab0d70c2d941c5888b9738dc0b5789, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:25.987834 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d819025-4acf-43ab-9321-d5e0aa69dc94 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:26.007394 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 828/1647] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:29:25 2022] PUT /identity/v3/projects/9d2efb6727da4c1c8fda7f24d1768527/users/cdab0d70c2d941c5888b9738dc0b5789/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:29:26.041024 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91571cf-af82-445c-b91b-b747ab545e8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:26.042500 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91571cf-af82-445c-b91b-b747ab545e8f service cinder] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:26.057151 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 820/1648] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:29:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:29:26.264035 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3daa93-2baf-43fb-9466-bd5ea60485ca None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:26.265448 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3daa93-2baf-43fb-9466-bd5ea60485ca None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:26.266039 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3daa93-2baf-43fb-9466-bd5ea60485ca None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:26.268447 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 829/1649] 10.222.0.60 () {54 vars in 912 bytes} [Tue Aug 30 01:29:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 01:29:26.289772 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c044e-b397-4e2c-b440-45a5c286ef3d None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:26.290758 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c044e-b397-4e2c-b440-45a5c286ef3d None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:26.291640 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c044e-b397-4e2c-b440-45a5c286ef3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:26.344816 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-4f6c044e-b397-4e2c-b440-45a5c286ef3d None None] MFA Rules not processed for user `8889145228a24fb6bd539a11925e62f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:26.348351 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-4f6c044e-b397-4e2c-b440-45a5c286ef3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:26.460572 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:26.528916 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 821/1650] 10.222.0.60 () {58 vars in 1009 bytes} [Tue Aug 30 01:29:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:26.535100 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3daa93-2baf-43fb-9466-bd5ea60485ca None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:26.591479 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:26.653334 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6c044e-b397-4e2c-b440-45a5c286ef3d None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:26.695338 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3daa93-2baf-43fb-9466-bd5ea60485ca None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:26.709733 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1036b7-ebc2-4951-9143-c08ead9a93b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:26.710362 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1036b7-ebc2-4951-9143-c08ead9a93b1 service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:26.710637 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1036b7-ebc2-4951-9143-c08ead9a93b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:26.710906 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1036b7-ebc2-4951-9143-c08ead9a93b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:26.753330 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1036b7-ebc2-4951-9143-c08ead9a93b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:26.756093 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1036b7-ebc2-4951-9143-c08ead9a93b1 service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:26.779080 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 830/1651] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:29:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:29:26.856131 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6c044e-b397-4e2c-b440-45a5c286ef3d None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:26.868643 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda52fbb-8a93-4a24-bcf4-d64137c3a725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:26.869378 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda52fbb-8a93-4a24-bcf4-d64137c3a725 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:26.869724 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda52fbb-8a93-4a24-bcf4-d64137c3a725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:26.870103 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda52fbb-8a93-4a24-bcf4-d64137c3a725 admin admin] PATH_INFO: `/v3/users/e542da06f5f24869aa810bdc36926ae1` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:26.871940 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda52fbb-8a93-4a24-bcf4-d64137c3a725 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e542da06f5f24869aa810bdc36926ae1)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:26.873620 dv-cinder-819668-6-smb devstack@keystone.service[81447]: WARNING py.warnings [None req-eda52fbb-8a93-4a24-bcf4-d64137c3a725 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 01:29:26.873620 dv-cinder-819668-6-smb devstack@keystone.service[81447]: warnings.warn(msg) Aug 30 01:29:26.873620 dv-cinder-819668-6-smb devstack@keystone.service[81447]: Aug 30 01:29:26.877187 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda52fbb-8a93-4a24-bcf4-d64137c3a725 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:26.925386 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1036b7-ebc2-4951-9143-c08ead9a93b1 service cinder] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:26.953785 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1036b7-ebc2-4951-9143-c08ead9a93b1 service cinder] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:27.032262 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a11d2-d2ad-431b-9c00-c4537041e334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:27.038286 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a11d2-d2ad-431b-9c00-c4537041e334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:27.038755 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a11d2-d2ad-431b-9c00-c4537041e334 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:27.039038 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a11d2-d2ad-431b-9c00-c4537041e334 admin admin] PATH_INFO: `/v3/users/eac14549c49a4896bdeb4d6674135298` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:27.051695 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813a11d2-d2ad-431b-9c00-c4537041e334 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eac14549c49a4896bdeb4d6674135298)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:27.053680 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813a11d2-d2ad-431b-9c00-c4537041e334 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:27.130537 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-eda52fbb-8a93-4a24-bcf4-d64137c3a725 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e542da06f5f24869aa810bdc36926ae1'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:27.140928 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-eda52fbb-8a93-4a24-bcf4-d64137c3a725 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e542da06f5f24869aa810bdc36926ae1'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:27.141704 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-eda52fbb-8a93-4a24-bcf4-d64137c3a725 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e542da06f5f24869aa810bdc36926ae1'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:27.142385 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-eda52fbb-8a93-4a24-bcf4-d64137c3a725 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e542da06f5f24869aa810bdc36926ae1'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:27.154874 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-813a11d2-d2ad-431b-9c00-c4537041e334 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eac14549c49a4896bdeb4d6674135298'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:27.167306 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-813a11d2-d2ad-431b-9c00-c4537041e334 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eac14549c49a4896bdeb4d6674135298'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:27.168737 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-eda52fbb-8a93-4a24-bcf4-d64137c3a725 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e542da06f5f24869aa810bdc36926ae1'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:27.169044 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-813a11d2-d2ad-431b-9c00-c4537041e334 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eac14549c49a4896bdeb4d6674135298'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:27.196555 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-813a11d2-d2ad-431b-9c00-c4537041e334 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eac14549c49a4896bdeb4d6674135298'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:27.197912 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-813a11d2-d2ad-431b-9c00-c4537041e334 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eac14549c49a4896bdeb4d6674135298'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:27.198864 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 822/1652] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:29:26 2022] DELETE /identity/v3/users/e542da06f5f24869aa810bdc36926ae1 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:29:27.202240 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e3789-c90d-4d6c-83e1-26647e9e388f None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:27.202462 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e3789-c90d-4d6c-83e1-26647e9e388f None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:27.202743 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e3789-c90d-4d6c-83e1-26647e9e388f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:27.226608 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-1b8e3789-c90d-4d6c-83e1-26647e9e388f None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:27.228436 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-1b8e3789-c90d-4d6c-83e1-26647e9e388f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:27.236418 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 831/1653] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:29:26 2022] DELETE /identity/v3/users/eac14549c49a4896bdeb4d6674135298 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:29:27.240906 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcfcee3-f3a2-4d0c-9d17-0cebc2e5a37e None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:27.241379 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcfcee3-f3a2-4d0c-9d17-0cebc2e5a37e None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:27.241781 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcfcee3-f3a2-4d0c-9d17-0cebc2e5a37e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:27.264874 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-dfcfcee3-f3a2-4d0c-9d17-0cebc2e5a37e None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:27.266992 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-dfcfcee3-f3a2-4d0c-9d17-0cebc2e5a37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:27.305521 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:27.353308 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 823/1654] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:27.362053 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 832/1655] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:29:27.396085 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e3789-c90d-4d6c-83e1-26647e9e388f None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:27.398359 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-1b8e3789-c90d-4d6c-83e1-26647e9e388f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:27.429983 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcfcee3-f3a2-4d0c-9d17-0cebc2e5a37e None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:27.438788 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-dfcfcee3-f3a2-4d0c-9d17-0cebc2e5a37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:27.538225 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e3789-c90d-4d6c-83e1-26647e9e388f None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:27.551314 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:27.552691 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff2d66c-9e1f-4e6c-83be-98ceb9b4fc7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:27.553330 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2d66c-9e1f-4e6c-83be-98ceb9b4fc7a service neutron] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:27.553615 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2d66c-9e1f-4e6c-83be-98ceb9b4fc7a service neutron] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:27.553895 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2d66c-9e1f-4e6c-83be-98ceb9b4fc7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:27.578194 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff2d66c-9e1f-4e6c-83be-98ceb9b4fc7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:27.579764 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff2d66c-9e1f-4e6c-83be-98ceb9b4fc7a service neutron] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:27.603889 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcfcee3-f3a2-4d0c-9d17-0cebc2e5a37e None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:27.605385 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 824/1656] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:29:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:29:27.608687 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eadc426-a083-4647-a71a-c26d28b93e16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:27.609473 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eadc426-a083-4647-a71a-c26d28b93e16 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:27.609848 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eadc426-a083-4647-a71a-c26d28b93e16 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:27.610184 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eadc426-a083-4647-a71a-c26d28b93e16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:27.634177 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eadc426-a083-4647-a71a-c26d28b93e16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:27.635791 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eadc426-a083-4647-a71a-c26d28b93e16 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:27.653635 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 833/1657] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:29:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:29:29.088102 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff2d66c-9e1f-4e6c-83be-98ceb9b4fc7a service neutron] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:29.089575 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-bff2d66c-9e1f-4e6c-83be-98ceb9b4fc7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:29.125612 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff2d66c-9e1f-4e6c-83be-98ceb9b4fc7a service neutron] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:29.139098 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9483ea-ad37-46a4-b528-6a209b6595e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:29.140582 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9483ea-ad37-46a4-b528-6a209b6595e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:29.140908 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9483ea-ad37-46a4-b528-6a209b6595e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:29.141127 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9483ea-ad37-46a4-b528-6a209b6595e4 admin admin] PATH_INFO: `/v3/projects/2fe15daea3ae4f86af35bdfda9dac52e` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:29.142656 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9483ea-ad37-46a4-b528-6a209b6595e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fe15daea3ae4f86af35bdfda9dac52e)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:29.147181 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9483ea-ad37-46a4-b528-6a209b6595e4 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:29.274275 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-bb9483ea-ad37-46a4-b528-6a209b6595e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fe15daea3ae4f86af35bdfda9dac52e', 'request_id': 'req-bb9483ea-ad37-46a4-b528-6a209b6595e4'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:29.281825 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-bb9483ea-ad37-46a4-b528-6a209b6595e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fe15daea3ae4f86af35bdfda9dac52e', 'request_id': 'req-bb9483ea-ad37-46a4-b528-6a209b6595e4'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:29.296857 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-bb9483ea-ad37-46a4-b528-6a209b6595e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fe15daea3ae4f86af35bdfda9dac52e', 'request_id': 'req-bb9483ea-ad37-46a4-b528-6a209b6595e4'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:29.322880 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-bb9483ea-ad37-46a4-b528-6a209b6595e4 admin admin] The token cache is being invalidate because project 2fe15daea3ae4f86af35bdfda9dac52e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81447) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:29:29.323463 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-bb9483ea-ad37-46a4-b528-6a209b6595e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:29.324716 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-bb9483ea-ad37-46a4-b528-6a209b6595e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:29.328864 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 825/1658] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:29:29 2022] DELETE /identity/v3/projects/2fe15daea3ae4f86af35bdfda9dac52e => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:29:29.332942 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eadc426-a083-4647-a71a-c26d28b93e16 service neutron] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:29.356139 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eadc426-a083-4647-a71a-c26d28b93e16 service neutron] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:29.504505 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9483ea-ad37-46a4-b528-6a209b6595e4 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:29.508349 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-bb9483ea-ad37-46a4-b528-6a209b6595e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:29.636107 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447b2c61-16d1-440f-b61d-80bb4a62c5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:29.637588 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b2c61-16d1-440f-b61d-80bb4a62c5b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:29.637588 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b2c61-16d1-440f-b61d-80bb4a62c5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:29.637588 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b2c61-16d1-440f-b61d-80bb4a62c5b6 admin admin] PATH_INFO: `/v3/users/d32059d1b3f64f71aad1d653a59a968a` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:29.638962 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447b2c61-16d1-440f-b61d-80bb4a62c5b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d32059d1b3f64f71aad1d653a59a968a)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:29.640954 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447b2c61-16d1-440f-b61d-80bb4a62c5b6 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:29.689725 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9483ea-ad37-46a4-b528-6a209b6595e4 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:29.709347 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0448f2-2c70-4fe9-a81b-af7d3f5264ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:29.710097 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0448f2-2c70-4fe9-a81b-af7d3f5264ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:29.710392 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0448f2-2c70-4fe9-a81b-af7d3f5264ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:29.710641 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0448f2-2c70-4fe9-a81b-af7d3f5264ee admin admin] PATH_INFO: `/v3/projects/c20f8587b32e42829bdcc8286e5b671a` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:29.715235 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0448f2-2c70-4fe9-a81b-af7d3f5264ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=c20f8587b32e42829bdcc8286e5b671a)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:29.729663 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0448f2-2c70-4fe9-a81b-af7d3f5264ee admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:29.814574 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:29.837614 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-447b2c61-16d1-440f-b61d-80bb4a62c5b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd32059d1b3f64f71aad1d653a59a968a'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:29.862686 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-447b2c61-16d1-440f-b61d-80bb4a62c5b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd32059d1b3f64f71aad1d653a59a968a'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:29.863038 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-447b2c61-16d1-440f-b61d-80bb4a62c5b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd32059d1b3f64f71aad1d653a59a968a'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:29.892765 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-8f0448f2-2c70-4fe9-a81b-af7d3f5264ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c20f8587b32e42829bdcc8286e5b671a', 'request_id': 'req-8f0448f2-2c70-4fe9-a81b-af7d3f5264ee'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:29.894923 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-447b2c61-16d1-440f-b61d-80bb4a62c5b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd32059d1b3f64f71aad1d653a59a968a'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:29.897734 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-447b2c61-16d1-440f-b61d-80bb4a62c5b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd32059d1b3f64f71aad1d653a59a968a'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:29.906482 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-8f0448f2-2c70-4fe9-a81b-af7d3f5264ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c20f8587b32e42829bdcc8286e5b671a', 'request_id': 'req-8f0448f2-2c70-4fe9-a81b-af7d3f5264ee'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:29.919351 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-8f0448f2-2c70-4fe9-a81b-af7d3f5264ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c20f8587b32e42829bdcc8286e5b671a', 'request_id': 'req-8f0448f2-2c70-4fe9-a81b-af7d3f5264ee'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:29.934564 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 834/1659] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:29:29 2022] DELETE /identity/v3/users/d32059d1b3f64f71aad1d653a59a968a => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:29:29.943293 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-8f0448f2-2c70-4fe9-a81b-af7d3f5264ee admin admin] The token cache is being invalidate because project c20f8587b32e42829bdcc8286e5b671a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81447) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:29:29.944057 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-8f0448f2-2c70-4fe9-a81b-af7d3f5264ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:29.946844 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-8f0448f2-2c70-4fe9-a81b-af7d3f5264ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:29.949250 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 826/1660] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:29:29 2022] DELETE /identity/v3/projects/c20f8587b32e42829bdcc8286e5b671a => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:29:29.955761 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd0e3c-b336-4152-98f0-6898f4223b59 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:29.956057 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd0e3c-b336-4152-98f0-6898f4223b59 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:29.956462 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd0e3c-b336-4152-98f0-6898f4223b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:30.001452 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-4ccd0e3c-b336-4152-98f0-6898f4223b59 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:30.001856 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-4ccd0e3c-b336-4152-98f0-6898f4223b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:30.155856 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:30.168618 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d2df20-fe47-44d2-b9fd-322d4da2c754 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:30.169096 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d2df20-fe47-44d2-b9fd-322d4da2c754 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:30.169177 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d2df20-fe47-44d2-b9fd-322d4da2c754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:30.176713 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 835/1661] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:30.184056 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440864ff-abd5-4fe8-82da-6f8773d43a48 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:30.184588 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440864ff-abd5-4fe8-82da-6f8773d43a48 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:30.184985 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440864ff-abd5-4fe8-82da-6f8773d43a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:30.208458 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-d6d2df20-fe47-44d2-b9fd-322d4da2c754 None None] MFA Rules not processed for user `cdab0d70c2d941c5888b9738dc0b5789`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:30.209700 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-d6d2df20-fe47-44d2-b9fd-322d4da2c754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:30.226261 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-440864ff-abd5-4fe8-82da-6f8773d43a48 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:30.227582 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-440864ff-abd5-4fe8-82da-6f8773d43a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:30.248408 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 836/1662] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:30.252824 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440864ff-abd5-4fe8-82da-6f8773d43a48 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:30.267978 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440864ff-abd5-4fe8-82da-6f8773d43a48 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:30.281869 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bda5d53-c59a-4f16-acbd-d352202e3b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:30.283214 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda5d53-c59a-4f16-acbd-d352202e3b24 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:30.283983 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda5d53-c59a-4f16-acbd-d352202e3b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:30.284679 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda5d53-c59a-4f16-acbd-d352202e3b24 admin admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:30.289995 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bda5d53-c59a-4f16-acbd-d352202e3b24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:29:30.290981 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bda5d53-c59a-4f16-acbd-d352202e3b24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:30.292936 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bda5d53-c59a-4f16-acbd-d352202e3b24 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:30.321627 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 837/1663] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 30 01:29:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:29:30.325615 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bda5d53-c59a-4f16-acbd-d352202e3b24 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:30.344357 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bda5d53-c59a-4f16-acbd-d352202e3b24 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:30.360048 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b038b13-99e5-4fab-b275-5d9a02d81264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:30.360743 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b038b13-99e5-4fab-b275-5d9a02d81264 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:30.361155 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b038b13-99e5-4fab-b275-5d9a02d81264 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:30.361431 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b038b13-99e5-4fab-b275-5d9a02d81264 admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:30.362081 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b038b13-99e5-4fab-b275-5d9a02d81264 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:30.364239 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b038b13-99e5-4fab-b275-5d9a02d81264 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:30.378753 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 827/1664] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:30 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:30.422513 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 838/1665] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:29:30 2022] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:29:30.427706 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d2df20-fe47-44d2-b9fd-322d4da2c754 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:30.446413 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d2df20-fe47-44d2-b9fd-322d4da2c754 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:30.620117 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f8cb0-85dc-4285-b82c-0273af30e18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:30.623317 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f8cb0-85dc-4285-b82c-0273af30e18f admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:30.623787 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f8cb0-85dc-4285-b82c-0273af30e18f admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:30.624387 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f8cb0-85dc-4285-b82c-0273af30e18f admin admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:30.626688 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123f8cb0-85dc-4285-b82c-0273af30e18f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:30.629811 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123f8cb0-85dc-4285-b82c-0273af30e18f admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:30.690112 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 828/1666] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:29:30 2022] POST /identity/v3/users => generated 291 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:29:30.694330 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b038b13-99e5-4fab-b275-5d9a02d81264 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:30.712364 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b038b13-99e5-4fab-b275-5d9a02d81264 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:30.721493 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5ecffa-a6ca-4cff-886f-358db8cebc4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:30.724466 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ecffa-a6ca-4cff-886f-358db8cebc4a admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:30.724982 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ecffa-a6ca-4cff-886f-358db8cebc4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:30.725508 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ecffa-a6ca-4cff-886f-358db8cebc4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:30.726412 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5ecffa-a6ca-4cff-886f-358db8cebc4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:30.728761 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5ecffa-a6ca-4cff-886f-358db8cebc4a admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:30.745122 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 839/1667] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:29:30 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:29:30.745990 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f8cb0-85dc-4285-b82c-0273af30e18f admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:30.756232 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f8cb0-85dc-4285-b82c-0273af30e18f admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:30.774664 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cee25b-16d6-46b2-a9ba-4e8d6659d9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:30.775294 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cee25b-16d6-46b2-a9ba-4e8d6659d9f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:30.775602 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cee25b-16d6-46b2-a9ba-4e8d6659d9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:30.775868 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cee25b-16d6-46b2-a9ba-4e8d6659d9f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:30.776526 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cee25b-16d6-46b2-a9ba-4e8d6659d9f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:30.778147 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cee25b-16d6-46b2-a9ba-4e8d6659d9f2 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:30.799046 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 829/1668] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:29:30 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:29:30.800362 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5ecffa-a6ca-4cff-886f-358db8cebc4a admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:30.812457 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5ecffa-a6ca-4cff-886f-358db8cebc4a admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:30.824093 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fdaa76-fcab-45e3-8747-d26460cb0b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:30.824777 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fdaa76-fcab-45e3-8747-d26460cb0b2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:30.825105 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fdaa76-fcab-45e3-8747-d26460cb0b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:30.825390 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fdaa76-fcab-45e3-8747-d26460cb0b2c admin admin] PATH_INFO: `/v3/projects/a78ea5d206df4ed3b6d8852e305aec0b/users/6328274838c54c288994c93c52bc693b/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:30.844133 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fdaa76-fcab-45e3-8747-d26460cb0b2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a78ea5d206df4ed3b6d8852e305aec0b, user_id=6328274838c54c288994c93c52bc693b, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:30.846847 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fdaa76-fcab-45e3-8747-d26460cb0b2c admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:30.875491 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 840/1669] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:29:30 2022] PUT /identity/v3/projects/a78ea5d206df4ed3b6d8852e305aec0b/users/6328274838c54c288994c93c52bc693b/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:29:30.888444 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07b62a-8fce-4188-a0b3-da9aeb06f2fa None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:30.888739 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07b62a-8fce-4188-a0b3-da9aeb06f2fa None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:30.889031 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07b62a-8fce-4188-a0b3-da9aeb06f2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:30.914438 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:30.964783 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-1c07b62a-8fce-4188-a0b3-da9aeb06f2fa None None] MFA Rules not processed for user `6328274838c54c288994c93c52bc693b`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:30.966385 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-1c07b62a-8fce-4188-a0b3-da9aeb06f2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:31.107668 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 830/1670] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:31.110662 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fdaa76-fcab-45e3-8747-d26460cb0b2c admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:31.214422 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fdaa76-fcab-45e3-8747-d26460cb0b2c admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:31.221415 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb190ed3-9860-498c-b6e1-a75169fd4eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:31.222170 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb190ed3-9860-498c-b6e1-a75169fd4eb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:31.222587 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb190ed3-9860-498c-b6e1-a75169fd4eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:31.223322 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb190ed3-9860-498c-b6e1-a75169fd4eb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:31.224414 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb190ed3-9860-498c-b6e1-a75169fd4eb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:31.226733 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb190ed3-9860-498c-b6e1-a75169fd4eb0 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:31.267905 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 841/1671] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:29:31 2022] POST /identity/v3/projects => generated 381 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:29:31.273739 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c07b62a-8fce-4188-a0b3-da9aeb06f2fa None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:31.296765 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb190ed3-9860-498c-b6e1-a75169fd4eb0 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:31.298693 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-cb190ed3-9860-498c-b6e1-a75169fd4eb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:31.306458 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c07b62a-8fce-4188-a0b3-da9aeb06f2fa None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:31.474638 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a39a47-34e7-45ff-aff3-5d6bbb70350a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:31.478129 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a39a47-34e7-45ff-aff3-5d6bbb70350a admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:31.478522 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a39a47-34e7-45ff-aff3-5d6bbb70350a admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:31.479824 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a39a47-34e7-45ff-aff3-5d6bbb70350a admin admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:31.481251 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb190ed3-9860-498c-b6e1-a75169fd4eb0 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:31.482506 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a39a47-34e7-45ff-aff3-5d6bbb70350a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:31.488518 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a39a47-34e7-45ff-aff3-5d6bbb70350a admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:31.498070 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a535d5d4-588c-4609-9149-e7409a1bce1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:31.500515 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535d5d4-588c-4609-9149-e7409a1bce1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:31.500886 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535d5d4-588c-4609-9149-e7409a1bce1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:31.501265 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535d5d4-588c-4609-9149-e7409a1bce1e admin admin] PATH_INFO: `/v3/users/38c2e7c6a31c4947a54508953733e983` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:31.503074 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a535d5d4-588c-4609-9149-e7409a1bce1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=38c2e7c6a31c4947a54508953733e983)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:31.508438 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a535d5d4-588c-4609-9149-e7409a1bce1e admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:31.542967 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:31.543359 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 831/1672] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:29:31 2022] POST /identity/v3/users => generated 297 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:29:31.547918 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a39a47-34e7-45ff-aff3-5d6bbb70350a admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:31.581419 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a39a47-34e7-45ff-aff3-5d6bbb70350a admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:31.632588 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c07c687-0b5c-498a-9fe0-152f797f5cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:31.638547 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c07c687-0b5c-498a-9fe0-152f797f5cd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:31.638865 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c07c687-0b5c-498a-9fe0-152f797f5cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:31.642315 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c07c687-0b5c-498a-9fe0-152f797f5cd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:31.643978 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c07c687-0b5c-498a-9fe0-152f797f5cd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:31.645624 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c07c687-0b5c-498a-9fe0-152f797f5cd2 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:31.676060 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 832/1673] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:29:31 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:29:31.683410 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c07c687-0b5c-498a-9fe0-152f797f5cd2 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:31.688560 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-0c07c687-0b5c-498a-9fe0-152f797f5cd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:31.704611 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-a535d5d4-588c-4609-9149-e7409a1bce1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38c2e7c6a31c4947a54508953733e983'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:31.734153 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-a535d5d4-588c-4609-9149-e7409a1bce1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38c2e7c6a31c4947a54508953733e983'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:31.736214 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-a535d5d4-588c-4609-9149-e7409a1bce1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38c2e7c6a31c4947a54508953733e983'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:31.749995 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c07c687-0b5c-498a-9fe0-152f797f5cd2 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:31.763081 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-a535d5d4-588c-4609-9149-e7409a1bce1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38c2e7c6a31c4947a54508953733e983'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:31.765153 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-a535d5d4-588c-4609-9149-e7409a1bce1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38c2e7c6a31c4947a54508953733e983'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:31.775404 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489005ad-6ebe-4bee-a83b-68eb465ef844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:31.776146 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489005ad-6ebe-4bee-a83b-68eb465ef844 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:31.776430 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489005ad-6ebe-4bee-a83b-68eb465ef844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:31.782245 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489005ad-6ebe-4bee-a83b-68eb465ef844 admin admin] PATH_INFO: `/v3/projects/5489cb1fcfff4be6a2726c465b33f7ca` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:31.788111 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489005ad-6ebe-4bee-a83b-68eb465ef844 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5489cb1fcfff4be6a2726c465b33f7ca)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:31.796509 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489005ad-6ebe-4bee-a83b-68eb465ef844 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:31.799467 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 842/1674] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:29:31 2022] DELETE /identity/v3/users/38c2e7c6a31c4947a54508953733e983 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:29:31.800210 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a535d5d4-588c-4609-9149-e7409a1bce1e admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:31.803776 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-a535d5d4-588c-4609-9149-e7409a1bce1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:31.967036 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-489005ad-6ebe-4bee-a83b-68eb465ef844 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5489cb1fcfff4be6a2726c465b33f7ca', 'request_id': 'req-489005ad-6ebe-4bee-a83b-68eb465ef844'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:31.994532 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-489005ad-6ebe-4bee-a83b-68eb465ef844 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5489cb1fcfff4be6a2726c465b33f7ca', 'request_id': 'req-489005ad-6ebe-4bee-a83b-68eb465ef844'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:32.017963 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-489005ad-6ebe-4bee-a83b-68eb465ef844 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5489cb1fcfff4be6a2726c465b33f7ca', 'request_id': 'req-489005ad-6ebe-4bee-a83b-68eb465ef844'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:32.048691 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-489005ad-6ebe-4bee-a83b-68eb465ef844 admin admin] The token cache is being invalidate because project 5489cb1fcfff4be6a2726c465b33f7ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81447) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:29:32.050921 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:32.051642 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-489005ad-6ebe-4bee-a83b-68eb465ef844 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:32.053711 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-489005ad-6ebe-4bee-a83b-68eb465ef844 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:32.056565 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 833/1675] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:29:31 2022] DELETE /identity/v3/projects/5489cb1fcfff4be6a2726c465b33f7ca => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:29:32.061600 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4befee-b9c9-4b2c-bf72-8587877c8974 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:32.062201 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4befee-b9c9-4b2c-bf72-8587877c8974 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:32.062697 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4befee-b9c9-4b2c-bf72-8587877c8974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:32.072998 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a535d5d4-588c-4609-9149-e7409a1bce1e admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:32.128058 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-6a4befee-b9c9-4b2c-bf72-8587877c8974 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:32.129550 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-6a4befee-b9c9-4b2c-bf72-8587877c8974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:32.283317 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad07e31-258c-4391-91fe-2ec21ac7db2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:32.284085 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad07e31-258c-4391-91fe-2ec21ac7db2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:32.284515 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad07e31-258c-4391-91fe-2ec21ac7db2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:32.284902 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad07e31-258c-4391-91fe-2ec21ac7db2f admin admin] PATH_INFO: `/v3/projects/fa98e7cf466748e4bb8685f0a078ac92/users/b33db6f21e1f4e0d9c86d3a0e0af2b2e/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:32.330186 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 834/1676] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:32.334525 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433d1f0-d542-453c-8025-699257839d8d None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:32.334836 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433d1f0-d542-453c-8025-699257839d8d None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:32.335166 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433d1f0-d542-453c-8025-699257839d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:32.349047 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad07e31-258c-4391-91fe-2ec21ac7db2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa98e7cf466748e4bb8685f0a078ac92, user_id=b33db6f21e1f4e0d9c86d3a0e0af2b2e, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:32.352869 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad07e31-258c-4391-91fe-2ec21ac7db2f admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:32.392585 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-6433d1f0-d542-453c-8025-699257839d8d None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:32.396248 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-6433d1f0-d542-453c-8025-699257839d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:32.399826 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 843/1677] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:29:31 2022] PUT /identity/v3/projects/fa98e7cf466748e4bb8685f0a078ac92/users/b33db6f21e1f4e0d9c86d3a0e0af2b2e/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:29:32.422844 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad07e31-258c-4391-91fe-2ec21ac7db2f admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:32.430069 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-1ad07e31-258c-4391-91fe-2ec21ac7db2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:32.472801 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:32.571490 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 835/1678] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:32.572546 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6433d1f0-d542-453c-8025-699257839d8d None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:32.573697 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad07e31-258c-4391-91fe-2ec21ac7db2f admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:32.574650 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-6433d1f0-d542-453c-8025-699257839d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:32.582126 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1cf533-ee00-4981-bb67-ca2922ccea13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:32.584068 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1cf533-ee00-4981-bb67-ca2922ccea13 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:32.584583 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1cf533-ee00-4981-bb67-ca2922ccea13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:32.608335 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1cf533-ee00-4981-bb67-ca2922ccea13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:32.609790 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1cf533-ee00-4981-bb67-ca2922ccea13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:32.611742 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1cf533-ee00-4981-bb67-ca2922ccea13 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:32.636843 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 844/1679] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:29:32.640356 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a13ef-2557-41cf-938a-0168f32b972c None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:32.640723 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a13ef-2557-41cf-938a-0168f32b972c None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:32.641620 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a13ef-2557-41cf-938a-0168f32b972c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:32.682234 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-560a13ef-2557-41cf-938a-0168f32b972c None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:32.683682 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-560a13ef-2557-41cf-938a-0168f32b972c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:32.696307 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 845/1680] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:32.697203 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a13ef-2557-41cf-938a-0168f32b972c None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:32.718999 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a13ef-2557-41cf-938a-0168f32b972c None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:32.722874 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6433d1f0-d542-453c-8025-699257839d8d None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:32.728484 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c78562-8280-4b59-8a6a-b76e7d5ac7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:32.729616 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c78562-8280-4b59-8a6a-b76e7d5ac7b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:32.729903 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c78562-8280-4b59-8a6a-b76e7d5ac7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:32.730934 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c78562-8280-4b59-8a6a-b76e7d5ac7b1 admin admin] PATH_INFO: `/v3/projects/fa98e7cf466748e4bb8685f0a078ac92/users/b33db6f21e1f4e0d9c86d3a0e0af2b2e/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:32.732324 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e69c5-d5b1-468e-bf15-f17ee1f2781e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:32.733007 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e69c5-d5b1-468e-bf15-f17ee1f2781e service neutron] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:32.733286 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e69c5-d5b1-468e-bf15-f17ee1f2781e service neutron] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:32.733552 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e69c5-d5b1-468e-bf15-f17ee1f2781e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:32.736569 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c78562-8280-4b59-8a6a-b76e7d5ac7b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa98e7cf466748e4bb8685f0a078ac92, user_id=b33db6f21e1f4e0d9c86d3a0e0af2b2e, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:32.739670 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c78562-8280-4b59-8a6a-b76e7d5ac7b1 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:32.754604 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2e69c5-d5b1-468e-bf15-f17ee1f2781e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:32.758562 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2e69c5-d5b1-468e-bf15-f17ee1f2781e service neutron] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:32.775591 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 846/1681] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:29:32 2022] PUT /identity/v3/projects/fa98e7cf466748e4bb8685f0a078ac92/users/b33db6f21e1f4e0d9c86d3a0e0af2b2e/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:29:32.776810 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c78562-8280-4b59-8a6a-b76e7d5ac7b1 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:32.801833 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 836/1682] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:29:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:29:32.803128 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d0316-a18d-46fe-ba84-178929d62186 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:32.803409 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d0316-a18d-46fe-ba84-178929d62186 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:32.803706 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d0316-a18d-46fe-ba84-178929d62186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:32.886378 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-976d0316-a18d-46fe-ba84-178929d62186 None None] MFA Rules not processed for user `b33db6f21e1f4e0d9c86d3a0e0af2b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:32.887815 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-976d0316-a18d-46fe-ba84-178929d62186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:32.989181 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:32.995685 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c78562-8280-4b59-8a6a-b76e7d5ac7b1 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:33.012260 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3998277e-6104-424b-a123-efc50a37d1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:33.013924 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998277e-6104-424b-a123-efc50a37d1b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:33.013924 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998277e-6104-424b-a123-efc50a37d1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:33.013924 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998277e-6104-424b-a123-efc50a37d1b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:33.020979 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3998277e-6104-424b-a123-efc50a37d1b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:29:33.025354 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3998277e-6104-424b-a123-efc50a37d1b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:33.027266 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3998277e-6104-424b-a123-efc50a37d1b2 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:33.053852 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 847/1683] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 30 01:29:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:29:33.058844 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3998277e-6104-424b-a123-efc50a37d1b2 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:33.077381 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3998277e-6104-424b-a123-efc50a37d1b2 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:33.098223 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be583a8b-b6db-4c8b-891c-9f28c29031cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:33.099092 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be583a8b-b6db-4c8b-891c-9f28c29031cb admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:33.099455 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be583a8b-b6db-4c8b-891c-9f28c29031cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:33.099897 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be583a8b-b6db-4c8b-891c-9f28c29031cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:33.100610 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be583a8b-b6db-4c8b-891c-9f28c29031cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:33.105360 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be583a8b-b6db-4c8b-891c-9f28c29031cb admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:33.130515 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 837/1684] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:32 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:33.143587 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d0316-a18d-46fe-ba84-178929d62186 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:33.144211 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-976d0316-a18d-46fe-ba84-178929d62186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:33.173254 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 848/1685] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:29:33 2022] POST /identity/v3/projects => generated 355 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:29:33.174469 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be583a8b-b6db-4c8b-891c-9f28c29031cb admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:33.274224 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be583a8b-b6db-4c8b-891c-9f28c29031cb admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:33.282488 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b649c-64b5-4ccc-9fd7-da803ce93a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:33.283210 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b649c-64b5-4ccc-9fd7-da803ce93a2d admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:33.284933 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b649c-64b5-4ccc-9fd7-da803ce93a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:33.285290 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b649c-64b5-4ccc-9fd7-da803ce93a2d admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:33.286027 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530b649c-64b5-4ccc-9fd7-da803ce93a2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:33.292362 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530b649c-64b5-4ccc-9fd7-da803ce93a2d admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:33.306209 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d0316-a18d-46fe-ba84-178929d62186 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:33.318312 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:33.345306 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 849/1686] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:29:33 2022] POST /identity/v3/users => generated 278 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:29:33.349270 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b649c-64b5-4ccc-9fd7-da803ce93a2d admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:33.379382 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b649c-64b5-4ccc-9fd7-da803ce93a2d admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:33.396996 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa78b7a-d1d0-4488-99b4-e4d800ed9556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:33.397692 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa78b7a-d1d0-4488-99b4-e4d800ed9556 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:33.397982 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa78b7a-d1d0-4488-99b4-e4d800ed9556 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:33.399009 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa78b7a-d1d0-4488-99b4-e4d800ed9556 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:33.399468 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa78b7a-d1d0-4488-99b4-e4d800ed9556 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:33.401089 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa78b7a-d1d0-4488-99b4-e4d800ed9556 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:33.422978 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9385655b-0637-468f-b0d9-4fa805cb6b90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:33.423632 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385655b-0637-468f-b0d9-4fa805cb6b90 service cinder] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:33.423918 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385655b-0637-468f-b0d9-4fa805cb6b90 service cinder] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:33.424188 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385655b-0637-468f-b0d9-4fa805cb6b90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:33.433072 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 850/1687] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:29:33 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:29:33.437633 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa78b7a-d1d0-4488-99b4-e4d800ed9556 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:33.459192 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa78b7a-d1d0-4488-99b4-e4d800ed9556 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:33.473621 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84214027-c2aa-425c-ae0e-23466ce52546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:33.476306 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84214027-c2aa-425c-ae0e-23466ce52546 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:33.477385 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84214027-c2aa-425c-ae0e-23466ce52546 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:33.477830 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84214027-c2aa-425c-ae0e-23466ce52546 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:33.480169 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84214027-c2aa-425c-ae0e-23466ce52546 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:33.485120 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84214027-c2aa-425c-ae0e-23466ce52546 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:33.520131 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 851/1688] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:29:33 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:29:33.524631 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84214027-c2aa-425c-ae0e-23466ce52546 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:33.542311 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84214027-c2aa-425c-ae0e-23466ce52546 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:33.553037 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8585848b-a58b-4f57-8e6e-d2cfbea0a80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:33.553037 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585848b-a58b-4f57-8e6e-d2cfbea0a80a admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:33.553037 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585848b-a58b-4f57-8e6e-d2cfbea0a80a admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:33.553037 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585848b-a58b-4f57-8e6e-d2cfbea0a80a admin admin] PATH_INFO: `/v3/projects/ae3d14a61867486d81248ad64e0977c6/users/443c30347f6341d6acb3399680c148be/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:33.575940 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8585848b-a58b-4f57-8e6e-d2cfbea0a80a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae3d14a61867486d81248ad64e0977c6, user_id=443c30347f6341d6acb3399680c148be, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:33.578746 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8585848b-a58b-4f57-8e6e-d2cfbea0a80a admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:33.590783 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9385655b-0637-468f-b0d9-4fa805cb6b90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:33.591666 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9385655b-0637-468f-b0d9-4fa805cb6b90 service cinder] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:33.603519 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 852/1689] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:29:33 2022] PUT /identity/v3/projects/ae3d14a61867486d81248ad64e0977c6/users/443c30347f6341d6acb3399680c148be/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:29:33.606275 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 838/1690] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:29:33 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:29:33.613376 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635b99b-fe28-4a17-8ac8-175b3580007a None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:33.614066 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635b99b-fe28-4a17-8ac8-175b3580007a None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:33.614520 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635b99b-fe28-4a17-8ac8-175b3580007a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:33.689234 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-2635b99b-fe28-4a17-8ac8-175b3580007a None None] MFA Rules not processed for user `443c30347f6341d6acb3399680c148be`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:33.690463 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-2635b99b-fe28-4a17-8ac8-175b3580007a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:33.769724 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9385655b-0637-468f-b0d9-4fa805cb6b90 service cinder] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:33.816257 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9385655b-0637-468f-b0d9-4fa805cb6b90 service cinder] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:33.851106 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 853/1691] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:33 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:33.857060 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2635b99b-fe28-4a17-8ac8-175b3580007a None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:33.906268 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:33.934275 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395bf4a5-5b70-41bc-9590-ba72f73a25db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:33.935556 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395bf4a5-5b70-41bc-9590-ba72f73a25db service cinder] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:33.935658 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395bf4a5-5b70-41bc-9590-ba72f73a25db service cinder] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:33.937198 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395bf4a5-5b70-41bc-9590-ba72f73a25db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:33.938722 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-395bf4a5-5b70-41bc-9590-ba72f73a25db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:34.046623 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395bf4a5-5b70-41bc-9590-ba72f73a25db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:34.049259 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395bf4a5-5b70-41bc-9590-ba72f73a25db service cinder] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:34.061874 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2635b99b-fe28-4a17-8ac8-175b3580007a None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:34.069370 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2527bc6d-3d2b-4717-8610-fdc0af4bd54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:34.070197 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527bc6d-3d2b-4717-8610-fdc0af4bd54d admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:34.070635 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527bc6d-3d2b-4717-8610-fdc0af4bd54d admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:34.071273 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527bc6d-3d2b-4717-8610-fdc0af4bd54d admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:34.072335 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2527bc6d-3d2b-4717-8610-fdc0af4bd54d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:34.074455 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2527bc6d-3d2b-4717-8610-fdc0af4bd54d admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:34.088240 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 839/1692] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:29:33 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:29:34.093122 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899fb47f-b809-444c-a411-ccb1dc3dfb5a None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:34.096291 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899fb47f-b809-444c-a411-ccb1dc3dfb5a None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:34.097514 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899fb47f-b809-444c-a411-ccb1dc3dfb5a None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:34.101051 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 840/1693] 10.222.0.60 () {54 vars in 921 bytes} [Tue Aug 30 01:29:34 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:29:34.116584 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899fb47f-b809-444c-a411-ccb1dc3dfb5a None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:34.118854 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 854/1694] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:29:33 2022] POST /identity/v3/projects => generated 355 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:29:34.209943 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899fb47f-b809-444c-a411-ccb1dc3dfb5a None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:34.217006 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a12e8d-2508-4319-81d2-ddba15a89b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:34.219647 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a12e8d-2508-4319-81d2-ddba15a89b3f admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:34.220216 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a12e8d-2508-4319-81d2-ddba15a89b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:34.220706 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a12e8d-2508-4319-81d2-ddba15a89b3f admin admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:34.221648 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a12e8d-2508-4319-81d2-ddba15a89b3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:34.224220 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a12e8d-2508-4319-81d2-ddba15a89b3f admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:34.264419 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2527bc6d-3d2b-4717-8610-fdc0af4bd54d admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:34.267146 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 841/1695] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:29:34 2022] POST /identity/v3/users => generated 284 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:29:34.269661 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb30cea9-c72b-463f-b427-8e802f0d9b9e None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:34.269958 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb30cea9-c72b-463f-b427-8e802f0d9b9e None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:34.270278 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb30cea9-c72b-463f-b427-8e802f0d9b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:34.288125 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2527bc6d-3d2b-4717-8610-fdc0af4bd54d admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:34.300898 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9815e911-aa8f-4234-b518-058d2ea84c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:34.303167 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9815e911-aa8f-4234-b518-058d2ea84c50 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:34.303498 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9815e911-aa8f-4234-b518-058d2ea84c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:34.303782 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9815e911-aa8f-4234-b518-058d2ea84c50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:34.305070 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9815e911-aa8f-4234-b518-058d2ea84c50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:34.308143 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9815e911-aa8f-4234-b518-058d2ea84c50 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:34.324344 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-bb30cea9-c72b-463f-b427-8e802f0d9b9e None None] MFA Rules not processed for user `e8dbb4742c3944b9ad389e9628b5a047`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:34.330662 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-bb30cea9-c72b-463f-b427-8e802f0d9b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:34.332281 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 855/1696] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:29:34 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:29:34.333766 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9815e911-aa8f-4234-b518-058d2ea84c50 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:34.349689 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9815e911-aa8f-4234-b518-058d2ea84c50 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:34.358707 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08053a75-9d0e-4a6e-be98-6037b63a1a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:34.360835 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08053a75-9d0e-4a6e-be98-6037b63a1a0a admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:34.361349 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08053a75-9d0e-4a6e-be98-6037b63a1a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:34.361940 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08053a75-9d0e-4a6e-be98-6037b63a1a0a admin admin] PATH_INFO: `/v3/projects/bf155c3a868747c691140033e604f1d3/users/b7d809bbe9a4447683b2b58e18b13e20/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:34.379048 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:34.385035 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08053a75-9d0e-4a6e-be98-6037b63a1a0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf155c3a868747c691140033e604f1d3, user_id=b7d809bbe9a4447683b2b58e18b13e20, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:34.388376 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08053a75-9d0e-4a6e-be98-6037b63a1a0a admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:34.431497 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 856/1697] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:29:34 2022] PUT /identity/v3/projects/bf155c3a868747c691140033e604f1d3/users/b7d809bbe9a4447683b2b58e18b13e20/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:29:34.434591 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08053a75-9d0e-4a6e-be98-6037b63a1a0a admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:34.595132 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 842/1698] 10.222.0.60 () {58 vars in 1018 bytes} [Tue Aug 30 01:29:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:34.702010 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08053a75-9d0e-4a6e-be98-6037b63a1a0a admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:34.712467 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d077b16-ac02-464c-aa77-0f1da12d7505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:34.713027 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d077b16-ac02-464c-aa77-0f1da12d7505 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:34.713116 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d077b16-ac02-464c-aa77-0f1da12d7505 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:34.713382 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d077b16-ac02-464c-aa77-0f1da12d7505 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:34.719540 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d077b16-ac02-464c-aa77-0f1da12d7505 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:34.726297 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d077b16-ac02-464c-aa77-0f1da12d7505 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:34.743160 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb30cea9-c72b-463f-b427-8e802f0d9b9e None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:34.745352 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-bb30cea9-c72b-463f-b427-8e802f0d9b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:34.770444 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 857/1699] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:29:34 2022] GET /identity/v3/roles => generated 1420 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:29:34.778095 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d077b16-ac02-464c-aa77-0f1da12d7505 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:34.782619 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb30cea9-c72b-463f-b427-8e802f0d9b9e None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:34.793240 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d077b16-ac02-464c-aa77-0f1da12d7505 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:34.800556 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccf8608-b4f4-43c9-8132-7235d71e8707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:34.801423 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf8608-b4f4-43c9-8132-7235d71e8707 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:34.801714 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf8608-b4f4-43c9-8132-7235d71e8707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:34.801992 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf8608-b4f4-43c9-8132-7235d71e8707 admin admin] PATH_INFO: `/v3/projects/bf155c3a868747c691140033e604f1d3/users/b7d809bbe9a4447683b2b58e18b13e20/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:34.804209 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccf8608-b4f4-43c9-8132-7235d71e8707 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf155c3a868747c691140033e604f1d3, user_id=b7d809bbe9a4447683b2b58e18b13e20, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:34.807713 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccf8608-b4f4-43c9-8132-7235d71e8707 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:34.834341 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:34.844177 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 858/1700] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:29:34 2022] PUT /identity/v3/projects/bf155c3a868747c691140033e604f1d3/users/b7d809bbe9a4447683b2b58e18b13e20/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:29:34.846129 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1891f9fe-62af-41a7-b1e9-370c63fd2deb None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:34.846522 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1891f9fe-62af-41a7-b1e9-370c63fd2deb None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:34.846815 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1891f9fe-62af-41a7-b1e9-370c63fd2deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:34.949029 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-1891f9fe-62af-41a7-b1e9-370c63fd2deb None None] MFA Rules not processed for user `b7d809bbe9a4447683b2b58e18b13e20`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:34.960163 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-1891f9fe-62af-41a7-b1e9-370c63fd2deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:35.006431 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1612b4ba-749a-4dd0-9112-6b66b3815d89 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8dbb4742c3944b9ad389e9628b5a047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:35.007079 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612b4ba-749a-4dd0-9112-6b66b3815d89 service placement] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:35.008284 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612b4ba-749a-4dd0-9112-6b66b3815d89 service placement] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:35.008584 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612b4ba-749a-4dd0-9112-6b66b3815d89 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:35.020624 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1612b4ba-749a-4dd0-9112-6b66b3815d89 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:35.022754 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1612b4ba-749a-4dd0-9112-6b66b3815d89 service placement] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:35.050291 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 843/1701] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:29:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:29:35.104636 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 859/1702] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:34 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:35.117528 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1612b4ba-749a-4dd0-9112-6b66b3815d89 service placement] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:35.229776 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1612b4ba-749a-4dd0-9112-6b66b3815d89 service placement] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:35.310894 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c2bf80-4e0c-4b72-b7f4-c90cd3894659 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:35.312251 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2bf80-4e0c-4b72-b7f4-c90cd3894659 service cinder] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:35.313613 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2bf80-4e0c-4b72-b7f4-c90cd3894659 service cinder] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:35.314253 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2bf80-4e0c-4b72-b7f4-c90cd3894659 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:35.342335 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c2bf80-4e0c-4b72-b7f4-c90cd3894659 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:35.343861 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c2bf80-4e0c-4b72-b7f4-c90cd3894659 service cinder] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:35.365932 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 844/1703] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:29:35 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:29:35.518409 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1891f9fe-62af-41a7-b1e9-370c63fd2deb None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:35.519580 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c2bf80-4e0c-4b72-b7f4-c90cd3894659 service cinder] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:35.525042 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-1891f9fe-62af-41a7-b1e9-370c63fd2deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:35.537335 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c2bf80-4e0c-4b72-b7f4-c90cd3894659 service cinder] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:35.564805 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207aa51e-f5a6-4c34-b6e5-aee286132936 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:35.569520 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207aa51e-f5a6-4c34-b6e5-aee286132936 service cinder] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:35.571381 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207aa51e-f5a6-4c34-b6e5-aee286132936 service cinder] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:35.571728 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207aa51e-f5a6-4c34-b6e5-aee286132936 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:35.690151 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207aa51e-f5a6-4c34-b6e5-aee286132936 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:35.692840 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207aa51e-f5a6-4c34-b6e5-aee286132936 service cinder] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:35.718627 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:35.719072 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 845/1704] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:29:35 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:29:35.738560 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1891f9fe-62af-41a7-b1e9-370c63fd2deb None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:35.744534 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdce7e32-a954-4b8a-803c-717b2879997a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:35.745206 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce7e32-a954-4b8a-803c-717b2879997a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:35.745489 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce7e32-a954-4b8a-803c-717b2879997a admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:35.745770 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce7e32-a954-4b8a-803c-717b2879997a admin admin] PATH_INFO: `/v3/projects/69809c268b194aed8c90c9d7a9b308a8` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:35.746984 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdce7e32-a954-4b8a-803c-717b2879997a admin admin] RBAC: Authorizing `identity:delete_project(project_id=69809c268b194aed8c90c9d7a9b308a8)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:35.748085 dv-cinder-819668-6-smb devstack@keystone.service[81446]: WARNING py.warnings [None req-fdce7e32-a954-4b8a-803c-717b2879997a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 01:29:35.748085 dv-cinder-819668-6-smb devstack@keystone.service[81446]: warnings.warn(msg) Aug 30 01:29:35.748085 dv-cinder-819668-6-smb devstack@keystone.service[81446]: Aug 30 01:29:35.749310 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdce7e32-a954-4b8a-803c-717b2879997a admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:35.900006 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-fdce7e32-a954-4b8a-803c-717b2879997a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69809c268b194aed8c90c9d7a9b308a8', 'request_id': 'req-fdce7e32-a954-4b8a-803c-717b2879997a'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:35.934272 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-fdce7e32-a954-4b8a-803c-717b2879997a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69809c268b194aed8c90c9d7a9b308a8', 'request_id': 'req-fdce7e32-a954-4b8a-803c-717b2879997a'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:35.954442 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-fdce7e32-a954-4b8a-803c-717b2879997a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69809c268b194aed8c90c9d7a9b308a8', 'request_id': 'req-fdce7e32-a954-4b8a-803c-717b2879997a'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:35.980420 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-fdce7e32-a954-4b8a-803c-717b2879997a admin admin] The token cache is being invalidate because project 69809c268b194aed8c90c9d7a9b308a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:29:35.980760 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-fdce7e32-a954-4b8a-803c-717b2879997a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:35.982747 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-fdce7e32-a954-4b8a-803c-717b2879997a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:35.990625 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 860/1705] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:29:35 2022] DELETE /identity/v3/projects/69809c268b194aed8c90c9d7a9b308a8 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:29:35.992049 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207aa51e-f5a6-4c34-b6e5-aee286132936 service cinder] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:36.000252 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:36.014292 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207aa51e-f5a6-4c34-b6e5-aee286132936 service cinder] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:36.206635 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb31606-d595-4da1-86cf-1e297fbdeb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:36.219989 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb31606-d595-4da1-86cf-1e297fbdeb40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:36.219989 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb31606-d595-4da1-86cf-1e297fbdeb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:36.219989 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb31606-d595-4da1-86cf-1e297fbdeb40 admin admin] PATH_INFO: `/v3/users/6e1cb804990949ca8cb7ed49fc2876bd` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:36.219989 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb31606-d595-4da1-86cf-1e297fbdeb40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e1cb804990949ca8cb7ed49fc2876bd)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:36.220872 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb31606-d595-4da1-86cf-1e297fbdeb40 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:36.320794 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-aeb31606-d595-4da1-86cf-1e297fbdeb40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e1cb804990949ca8cb7ed49fc2876bd'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:36.340948 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-aeb31606-d595-4da1-86cf-1e297fbdeb40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e1cb804990949ca8cb7ed49fc2876bd'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:36.341741 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-aeb31606-d595-4da1-86cf-1e297fbdeb40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e1cb804990949ca8cb7ed49fc2876bd'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:36.342533 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-aeb31606-d595-4da1-86cf-1e297fbdeb40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e1cb804990949ca8cb7ed49fc2876bd'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:36.366483 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-aeb31606-d595-4da1-86cf-1e297fbdeb40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e1cb804990949ca8cb7ed49fc2876bd'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:36.400515 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 846/1706] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:29:35 2022] DELETE /identity/v3/users/6e1cb804990949ca8cb7ed49fc2876bd => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:29:37.324978 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdce7e32-a954-4b8a-803c-717b2879997a admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:37.326359 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-fdce7e32-a954-4b8a-803c-717b2879997a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:37.352027 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdce7e32-a954-4b8a-803c-717b2879997a admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:37.469165 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4a0bd7-ceb7-471d-bb93-77a2f978fc4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:37.469977 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a0bd7-ceb7-471d-bb93-77a2f978fc4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:37.470264 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a0bd7-ceb7-471d-bb93-77a2f978fc4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:37.470538 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a0bd7-ceb7-471d-bb93-77a2f978fc4b admin admin] PATH_INFO: `/v3/users/7e8558a33a7d4154b5180ad44216c652` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:37.472368 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4a0bd7-ceb7-471d-bb93-77a2f978fc4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e8558a33a7d4154b5180ad44216c652)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:37.475035 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4a0bd7-ceb7-471d-bb93-77a2f978fc4b admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:37.573750 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-0f4a0bd7-ceb7-471d-bb93-77a2f978fc4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e8558a33a7d4154b5180ad44216c652'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:37.600274 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-0f4a0bd7-ceb7-471d-bb93-77a2f978fc4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e8558a33a7d4154b5180ad44216c652'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:37.601921 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-0f4a0bd7-ceb7-471d-bb93-77a2f978fc4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e8558a33a7d4154b5180ad44216c652'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:37.642359 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-0f4a0bd7-ceb7-471d-bb93-77a2f978fc4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e8558a33a7d4154b5180ad44216c652'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:37.645004 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-0f4a0bd7-ceb7-471d-bb93-77a2f978fc4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e8558a33a7d4154b5180ad44216c652'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:37.697608 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 861/1707] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:29:37 2022] DELETE /identity/v3/users/7e8558a33a7d4154b5180ad44216c652 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:29:37.766616 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf714e50-86c8-428d-af45-5f550778add6 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:37.767142 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf714e50-86c8-428d-af45-5f550778add6 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:37.767233 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf714e50-86c8-428d-af45-5f550778add6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:37.810781 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-bf714e50-86c8-428d-af45-5f550778add6 None None] MFA Rules not processed for user `0648872a9f8648ca803418bc3a3b04b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:37.812265 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-bf714e50-86c8-428d-af45-5f550778add6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:37.949035 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 847/1708] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:37 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:37.965664 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4a0bd7-ceb7-471d-bb93-77a2f978fc4b admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:37.967414 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-0f4a0bd7-ceb7-471d-bb93-77a2f978fc4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:37.988522 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:38.192509 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4a0bd7-ceb7-471d-bb93-77a2f978fc4b admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:38.199996 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f2b9a1-d22e-4f93-9d53-d007ec2e8351 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8889145228a24fb6bd539a11925e62f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:38.211347 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f2b9a1-d22e-4f93-9d53-d007ec2e8351 service nova] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:38.212217 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f2b9a1-d22e-4f93-9d53-d007ec2e8351 service nova] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:38.212807 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f2b9a1-d22e-4f93-9d53-d007ec2e8351 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:38.244403 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f2b9a1-d22e-4f93-9d53-d007ec2e8351 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:38.246691 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f2b9a1-d22e-4f93-9d53-d007ec2e8351 service nova] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:38.276270 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 862/1709] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:29:37 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:29:38.797384 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf714e50-86c8-428d-af45-5f550778add6 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:38.800771 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-bf714e50-86c8-428d-af45-5f550778add6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:38.860891 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:38.926276 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f2b9a1-d22e-4f93-9d53-d007ec2e8351 service nova] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:38.927996 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-58f2b9a1-d22e-4f93-9d53-d007ec2e8351 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:39.027871 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf714e50-86c8-428d-af45-5f550778add6 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:39.035528 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f2b9a1-d22e-4f93-9d53-d007ec2e8351 service nova] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:39.037329 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb32406f-8dcb-4c88-95fe-6a48f594a9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:39.038090 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32406f-8dcb-4c88-95fe-6a48f594a9b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:39.038377 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32406f-8dcb-4c88-95fe-6a48f594a9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:39.039281 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32406f-8dcb-4c88-95fe-6a48f594a9b0 admin admin] PATH_INFO: `/v3/projects/27e942df9038496eb3e978500dc68a69` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:39.044290 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a1be2-b445-46b8-be88-efd5b14f0688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:39.044952 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a1be2-b445-46b8-be88-efd5b14f0688 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:39.045238 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a1be2-b445-46b8-be88-efd5b14f0688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:39.045518 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a1be2-b445-46b8-be88-efd5b14f0688 admin admin] PATH_INFO: `/v3/projects/33547ba157684f218e21552ff96c8d12` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:39.046758 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1a1be2-b445-46b8-be88-efd5b14f0688 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33547ba157684f218e21552ff96c8d12)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:39.046911 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb32406f-8dcb-4c88-95fe-6a48f594a9b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27e942df9038496eb3e978500dc68a69)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:39.049272 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb32406f-8dcb-4c88-95fe-6a48f594a9b0 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:39.049464 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1a1be2-b445-46b8-be88-efd5b14f0688 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:39.138901 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-2e1a1be2-b445-46b8-be88-efd5b14f0688 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33547ba157684f218e21552ff96c8d12', 'request_id': 'req-2e1a1be2-b445-46b8-be88-efd5b14f0688'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:39.149067 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-2e1a1be2-b445-46b8-be88-efd5b14f0688 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33547ba157684f218e21552ff96c8d12', 'request_id': 'req-2e1a1be2-b445-46b8-be88-efd5b14f0688'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:39.160166 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-fb32406f-8dcb-4c88-95fe-6a48f594a9b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27e942df9038496eb3e978500dc68a69', 'request_id': 'req-fb32406f-8dcb-4c88-95fe-6a48f594a9b0'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:39.169196 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-2e1a1be2-b445-46b8-be88-efd5b14f0688 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33547ba157684f218e21552ff96c8d12', 'request_id': 'req-2e1a1be2-b445-46b8-be88-efd5b14f0688'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:39.174787 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-fb32406f-8dcb-4c88-95fe-6a48f594a9b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27e942df9038496eb3e978500dc68a69', 'request_id': 'req-fb32406f-8dcb-4c88-95fe-6a48f594a9b0'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:39.189555 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-2e1a1be2-b445-46b8-be88-efd5b14f0688 admin admin] The token cache is being invalidate because project 33547ba157684f218e21552ff96c8d12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:29:39.190475 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-2e1a1be2-b445-46b8-be88-efd5b14f0688 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:39.192531 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-2e1a1be2-b445-46b8-be88-efd5b14f0688 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:39.192776 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-fb32406f-8dcb-4c88-95fe-6a48f594a9b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27e942df9038496eb3e978500dc68a69', 'request_id': 'req-fb32406f-8dcb-4c88-95fe-6a48f594a9b0'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:39.200689 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 863/1710] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:29:38 2022] DELETE /identity/v3/projects/33547ba157684f218e21552ff96c8d12 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:29:39.203349 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a54a44-630b-4948-bfaf-a054e483ff1b None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:39.203857 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a54a44-630b-4948-bfaf-a054e483ff1b None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:39.204280 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a54a44-630b-4948-bfaf-a054e483ff1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:39.234258 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-fb32406f-8dcb-4c88-95fe-6a48f594a9b0 admin admin] The token cache is being invalidate because project 27e942df9038496eb3e978500dc68a69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81447) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:29:39.234557 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-fb32406f-8dcb-4c88-95fe-6a48f594a9b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:39.236743 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-f6a54a44-630b-4948-bfaf-a054e483ff1b None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:39.238266 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-f6a54a44-630b-4948-bfaf-a054e483ff1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:39.240630 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-fb32406f-8dcb-4c88-95fe-6a48f594a9b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:39.244848 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 848/1711] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:29:38 2022] DELETE /identity/v3/projects/27e942df9038496eb3e978500dc68a69 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:29:39.248460 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb32406f-8dcb-4c88-95fe-6a48f594a9b0 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:39.261629 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-fb32406f-8dcb-4c88-95fe-6a48f594a9b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:39.288809 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:39.428613 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 864/1712] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:39.430324 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cfe464-b0b1-48c6-bd1c-b3e994c3251e None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:39.430616 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cfe464-b0b1-48c6-bd1c-b3e994c3251e None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:39.430942 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cfe464-b0b1-48c6-bd1c-b3e994c3251e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:39.475376 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-e8cfe464-b0b1-48c6-bd1c-b3e994c3251e None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:39.476404 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb32406f-8dcb-4c88-95fe-6a48f594a9b0 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:39.477756 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-e8cfe464-b0b1-48c6-bd1c-b3e994c3251e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:39.487501 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1975b284-8f11-44ad-b01f-49c8cd8751b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:39.490958 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975b284-8f11-44ad-b01f-49c8cd8751b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:39.491368 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975b284-8f11-44ad-b01f-49c8cd8751b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:39.491868 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975b284-8f11-44ad-b01f-49c8cd8751b0 admin admin] PATH_INFO: `/v3/users/cdab0d70c2d941c5888b9738dc0b5789` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:39.495424 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1975b284-8f11-44ad-b01f-49c8cd8751b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdab0d70c2d941c5888b9738dc0b5789)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:39.502842 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 865/1713] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:39.504686 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1975b284-8f11-44ad-b01f-49c8cd8751b0 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:39.505385 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cfe464-b0b1-48c6-bd1c-b3e994c3251e None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:39.525689 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cfe464-b0b1-48c6-bd1c-b3e994c3251e None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:39.544834 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa90a941-0dd5-4817-86ff-1704f2769f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:39.546308 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa90a941-0dd5-4817-86ff-1704f2769f9a admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:39.550112 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa90a941-0dd5-4817-86ff-1704f2769f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:39.550454 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa90a941-0dd5-4817-86ff-1704f2769f9a admin admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:39.551319 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa90a941-0dd5-4817-86ff-1704f2769f9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:29:39.551658 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa90a941-0dd5-4817-86ff-1704f2769f9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:39.557968 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa90a941-0dd5-4817-86ff-1704f2769f9a admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:39.606165 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 866/1714] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 30 01:29:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:29:39.610026 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa90a941-0dd5-4817-86ff-1704f2769f9a admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:39.637756 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:39.643767 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-1975b284-8f11-44ad-b01f-49c8cd8751b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdab0d70c2d941c5888b9738dc0b5789'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:39.643971 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa90a941-0dd5-4817-86ff-1704f2769f9a admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:39.660946 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e5bc8-90cb-44aa-a209-3ad6e5bc719a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:39.662427 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e5bc8-90cb-44aa-a209-3ad6e5bc719a admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:39.662744 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e5bc8-90cb-44aa-a209-3ad6e5bc719a admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:39.663949 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e5bc8-90cb-44aa-a209-3ad6e5bc719a admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:39.666044 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560e5bc8-90cb-44aa-a209-3ad6e5bc719a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:39.666266 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-1975b284-8f11-44ad-b01f-49c8cd8751b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdab0d70c2d941c5888b9738dc0b5789'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:39.666913 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-1975b284-8f11-44ad-b01f-49c8cd8751b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdab0d70c2d941c5888b9738dc0b5789'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:39.667616 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-1975b284-8f11-44ad-b01f-49c8cd8751b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdab0d70c2d941c5888b9738dc0b5789'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:39.674977 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560e5bc8-90cb-44aa-a209-3ad6e5bc719a admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:39.703985 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-1975b284-8f11-44ad-b01f-49c8cd8751b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdab0d70c2d941c5888b9738dc0b5789'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:39.755712 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 849/1715] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:29:39 2022] DELETE /identity/v3/users/cdab0d70c2d941c5888b9738dc0b5789 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:29:39.791012 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 867/1716] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:29:39 2022] POST /identity/v3/projects => generated 389 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:29:39.794720 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1975b284-8f11-44ad-b01f-49c8cd8751b0 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:39.798590 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-1975b284-8f11-44ad-b01f-49c8cd8751b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:40.002852 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1975b284-8f11-44ad-b01f-49c8cd8751b0 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:40.145433 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e2c1f-2ce6-4d46-aed1-1ba2c5522f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:40.161380 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e2c1f-2ce6-4d46-aed1-1ba2c5522f1f admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:40.162434 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e2c1f-2ce6-4d46-aed1-1ba2c5522f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:40.162748 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e2c1f-2ce6-4d46-aed1-1ba2c5522f1f admin admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:40.163672 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401e2c1f-2ce6-4d46-aed1-1ba2c5522f1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:40.168733 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401e2c1f-2ce6-4d46-aed1-1ba2c5522f1f admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:40.253480 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e5bc8-90cb-44aa-a209-3ad6e5bc719a admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:40.259111 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 850/1717] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:29:39 2022] POST /identity/v3/users => generated 295 bytes in 461 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:29:40.278688 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e5bc8-90cb-44aa-a209-3ad6e5bc719a admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:40.293232 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098707c8-ab20-4a4c-924f-9007b78cdfea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:40.293976 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098707c8-ab20-4a4c-924f-9007b78cdfea admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:40.296299 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098707c8-ab20-4a4c-924f-9007b78cdfea admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:40.296604 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098707c8-ab20-4a4c-924f-9007b78cdfea admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:40.299400 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098707c8-ab20-4a4c-924f-9007b78cdfea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:40.301065 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098707c8-ab20-4a4c-924f-9007b78cdfea admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:40.352662 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 868/1718] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:29:40.353946 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e2c1f-2ce6-4d46-aed1-1ba2c5522f1f admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:40.364872 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e2c1f-2ce6-4d46-aed1-1ba2c5522f1f admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:40.404389 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6161b362-28b7-416d-b0db-567cc99827f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:40.405083 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6161b362-28b7-416d-b0db-567cc99827f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:40.405367 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6161b362-28b7-416d-b0db-567cc99827f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:40.405638 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6161b362-28b7-416d-b0db-567cc99827f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:40.406300 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6161b362-28b7-416d-b0db-567cc99827f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:40.408027 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6161b362-28b7-416d-b0db-567cc99827f1 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:40.436862 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 851/1719] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:29:40.441517 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098707c8-ab20-4a4c-924f-9007b78cdfea admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:40.474463 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098707c8-ab20-4a4c-924f-9007b78cdfea admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:40.495918 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb36f7-f1a2-42db-9d41-409a7a982997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:40.496668 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb36f7-f1a2-42db-9d41-409a7a982997 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:40.496949 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb36f7-f1a2-42db-9d41-409a7a982997 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:40.497399 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb36f7-f1a2-42db-9d41-409a7a982997 admin admin] PATH_INFO: `/v3/projects/8904118955b54557b1ddf490ff5a35ca/users/500e26b758d3412eb6b893de874cc65b/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:40.545650 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cb36f7-f1a2-42db-9d41-409a7a982997 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8904118955b54557b1ddf490ff5a35ca, user_id=500e26b758d3412eb6b893de874cc65b, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:40.548464 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cb36f7-f1a2-42db-9d41-409a7a982997 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:40.581730 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 869/1720] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:29:40 2022] PUT /identity/v3/projects/8904118955b54557b1ddf490ff5a35ca/users/500e26b758d3412eb6b893de874cc65b/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:29:40.602374 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a08fae-d5eb-4b8c-995e-aa1c57b0110c None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:40.604887 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a08fae-d5eb-4b8c-995e-aa1c57b0110c None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:40.604887 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a08fae-d5eb-4b8c-995e-aa1c57b0110c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:40.618959 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb36f7-f1a2-42db-9d41-409a7a982997 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:40.621066 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-78cb36f7-f1a2-42db-9d41-409a7a982997 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:40.712750 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-44a08fae-d5eb-4b8c-995e-aa1c57b0110c None None] MFA Rules not processed for user `500e26b758d3412eb6b893de874cc65b`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:40.726119 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-44a08fae-d5eb-4b8c-995e-aa1c57b0110c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:40.816971 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:40.882017 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb36f7-f1a2-42db-9d41-409a7a982997 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:40.889929 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0375e389-8fbc-4e86-9bd7-c7c17852c986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:40.891888 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375e389-8fbc-4e86-9bd7-c7c17852c986 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:40.892623 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375e389-8fbc-4e86-9bd7-c7c17852c986 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:40.893016 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375e389-8fbc-4e86-9bd7-c7c17852c986 admin admin] PATH_INFO: `/v3/projects/9d2efb6727da4c1c8fda7f24d1768527` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:40.894673 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0375e389-8fbc-4e86-9bd7-c7c17852c986 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d2efb6727da4c1c8fda7f24d1768527)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:40.897206 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0375e389-8fbc-4e86-9bd7-c7c17852c986 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:40.944932 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 852/1721] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:40 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:40.950758 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b6495-5d30-4311-8047-874f20a7ae42 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:40.952197 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b6495-5d30-4311-8047-874f20a7ae42 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:40.952492 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b6495-5d30-4311-8047-874f20a7ae42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:41.024791 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:41.031831 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-0375e389-8fbc-4e86-9bd7-c7c17852c986 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d2efb6727da4c1c8fda7f24d1768527', 'request_id': 'req-0375e389-8fbc-4e86-9bd7-c7c17852c986'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:41.045271 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-376b6495-5d30-4311-8047-874f20a7ae42 None None] MFA Rules not processed for user `a991f1a0f804497c91d21d69e33113ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:41.049525 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-376b6495-5d30-4311-8047-874f20a7ae42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:41.063374 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-0375e389-8fbc-4e86-9bd7-c7c17852c986 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d2efb6727da4c1c8fda7f24d1768527', 'request_id': 'req-0375e389-8fbc-4e86-9bd7-c7c17852c986'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:41.082979 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-0375e389-8fbc-4e86-9bd7-c7c17852c986 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d2efb6727da4c1c8fda7f24d1768527', 'request_id': 'req-0375e389-8fbc-4e86-9bd7-c7c17852c986'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:41.113840 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-0375e389-8fbc-4e86-9bd7-c7c17852c986 admin admin] The token cache is being invalidate because project 9d2efb6727da4c1c8fda7f24d1768527 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:29:41.114189 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-0375e389-8fbc-4e86-9bd7-c7c17852c986 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:41.115213 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-0375e389-8fbc-4e86-9bd7-c7c17852c986 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:41.132640 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 870/1722] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:29:40 2022] DELETE /identity/v3/projects/9d2efb6727da4c1c8fda7f24d1768527 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:29:41.134573 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0375e389-8fbc-4e86-9bd7-c7c17852c986 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:41.145918 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-0375e389-8fbc-4e86-9bd7-c7c17852c986 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:41.320460 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 853/1723] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:41.339305 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071cc9fc-57c1-4cc8-a2d4-61048bef98ab None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:41.339637 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071cc9fc-57c1-4cc8-a2d4-61048bef98ab None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:41.339915 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071cc9fc-57c1-4cc8-a2d4-61048bef98ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:41.380264 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-071cc9fc-57c1-4cc8-a2d4-61048bef98ab None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:41.381514 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-071cc9fc-57c1-4cc8-a2d4-61048bef98ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:41.400414 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0375e389-8fbc-4e86-9bd7-c7c17852c986 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:41.424532 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3d0ba6-2dee-46e5-ba24-fe276f3d1721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:41.427396 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d0ba6-2dee-46e5-ba24-fe276f3d1721 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:41.427996 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 854/1724] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:41.428848 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071cc9fc-57c1-4cc8-a2d4-61048bef98ab None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:41.430137 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d0ba6-2dee-46e5-ba24-fe276f3d1721 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:41.430424 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d0ba6-2dee-46e5-ba24-fe276f3d1721 admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:41.431101 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3d0ba6-2dee-46e5-ba24-fe276f3d1721 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:41.435611 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-071cc9fc-57c1-4cc8-a2d4-61048bef98ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:41.442989 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3d0ba6-2dee-46e5-ba24-fe276f3d1721 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:41.520071 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 871/1725] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:29:41 2022] POST /identity/v3/projects => generated 387 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:29:41.525634 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3af8e6-339e-4c41-b522-a1484a7965f7 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:41.526027 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3af8e6-339e-4c41-b522-a1484a7965f7 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:41.526427 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3af8e6-339e-4c41-b522-a1484a7965f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:41.609511 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-cf3af8e6-339e-4c41-b522-a1484a7965f7 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:41.614964 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-cf3af8e6-339e-4c41-b522-a1484a7965f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:41.698582 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071cc9fc-57c1-4cc8-a2d4-61048bef98ab None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:41.789661 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 872/1726] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:41.794306 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3af8e6-339e-4c41-b522-a1484a7965f7 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:41.826735 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3af8e6-339e-4c41-b522-a1484a7965f7 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:41.844950 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d5e04f-e873-441a-a9f5-ca80d6960d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:41.845875 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5e04f-e873-441a-a9f5-ca80d6960d2b admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:41.846812 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5e04f-e873-441a-a9f5-ca80d6960d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:41.847771 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5e04f-e873-441a-a9f5-ca80d6960d2b admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:41.848670 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d5e04f-e873-441a-a9f5-ca80d6960d2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:41.853571 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d5e04f-e873-441a-a9f5-ca80d6960d2b admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:41.876153 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:41.895727 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4320278f-4e74-468e-833a-601acc0f258c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8889145228a24fb6bd539a11925e62f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:41.896641 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320278f-4e74-468e-833a-601acc0f258c service nova] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:41.896976 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320278f-4e74-468e-833a-601acc0f258c service nova] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:41.897309 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320278f-4e74-468e-833a-601acc0f258c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:41.920318 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 873/1727] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:29:41 2022] POST /identity/v3/users => generated 300 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:29:41.922004 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d5e04f-e873-441a-a9f5-ca80d6960d2b admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:41.945577 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d5e04f-e873-441a-a9f5-ca80d6960d2b admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:41.953189 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d23da39-5518-45c0-acb3-ed0240b349ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:41.953897 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23da39-5518-45c0-acb3-ed0240b349ac admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:41.954179 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23da39-5518-45c0-acb3-ed0240b349ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:41.954455 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23da39-5518-45c0-acb3-ed0240b349ac admin admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:41.955117 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d23da39-5518-45c0-acb3-ed0240b349ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:29:41.955410 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d23da39-5518-45c0-acb3-ed0240b349ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:41.957828 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d23da39-5518-45c0-acb3-ed0240b349ac admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:41.978138 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 874/1728] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 30 01:29:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:29:41.979296 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d23da39-5518-45c0-acb3-ed0240b349ac admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:42.003109 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d23da39-5518-45c0-acb3-ed0240b349ac admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:42.015609 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704f17e8-2b60-4499-8cb3-80aaf53aed26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:42.016158 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f17e8-2b60-4499-8cb3-80aaf53aed26 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:42.016583 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f17e8-2b60-4499-8cb3-80aaf53aed26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:42.017248 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f17e8-2b60-4499-8cb3-80aaf53aed26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:42.018123 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704f17e8-2b60-4499-8cb3-80aaf53aed26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:42.020759 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704f17e8-2b60-4499-8cb3-80aaf53aed26 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:42.048583 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 875/1729] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:29:41 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:29:42.049594 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704f17e8-2b60-4499-8cb3-80aaf53aed26 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:42.054321 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4320278f-4e74-468e-833a-601acc0f258c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:42.056243 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4320278f-4e74-468e-833a-601acc0f258c service nova] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:42.067697 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 855/1730] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:29:41 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 639 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:29:42.070970 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4320278f-4e74-468e-833a-601acc0f258c service nova] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:42.073786 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704f17e8-2b60-4499-8cb3-80aaf53aed26 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:42.086046 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8779fad4-0ba0-4f02-838f-8fc76f4e2481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:42.087391 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779fad4-0ba0-4f02-838f-8fc76f4e2481 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:42.087701 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779fad4-0ba0-4f02-838f-8fc76f4e2481 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:42.087977 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779fad4-0ba0-4f02-838f-8fc76f4e2481 admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:42.089760 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8779fad4-0ba0-4f02-838f-8fc76f4e2481 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:42.093957 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8779fad4-0ba0-4f02-838f-8fc76f4e2481 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:42.106823 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4320278f-4e74-468e-833a-601acc0f258c service nova] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:42.117106 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb4389-265c-45d3-8fc3-e450c67cec2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:42.120407 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb4389-265c-45d3-8fc3-e450c67cec2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:42.122234 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb4389-265c-45d3-8fc3-e450c67cec2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:42.122886 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb4389-265c-45d3-8fc3-e450c67cec2c admin admin] PATH_INFO: `/v3/projects/5073eb0ac0454ae991b83cbca4b97826/users/f74d9cb3472b4a4c97660b759377e91f/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:42.149257 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=91,keystone:INSERT=6,keystone:DELETE=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:42.163842 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 876/1731] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:29:42 2022] POST /identity/v3/projects => generated 365 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:29:42.168112 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8779fad4-0ba0-4f02-838f-8fc76f4e2481 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:42.197362 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bb4389-265c-45d3-8fc3-e450c67cec2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5073eb0ac0454ae991b83cbca4b97826, user_id=f74d9cb3472b4a4c97660b759377e91f, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:42.200434 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bb4389-265c-45d3-8fc3-e450c67cec2c admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:42.244507 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 856/1732] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:29:42 2022] PUT /identity/v3/projects/5073eb0ac0454ae991b83cbca4b97826/users/f74d9cb3472b4a4c97660b759377e91f/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:29:42.246620 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb4389-265c-45d3-8fc3-e450c67cec2c admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:42.349002 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8779fad4-0ba0-4f02-838f-8fc76f4e2481 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:42.421699 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95359d-b1f7-4088-b17d-f035f20d0e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:42.422854 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95359d-b1f7-4088-b17d-f035f20d0e55 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:42.423125 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95359d-b1f7-4088-b17d-f035f20d0e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:42.423226 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb4389-265c-45d3-8fc3-e450c67cec2c admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:42.423442 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95359d-b1f7-4088-b17d-f035f20d0e55 admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:42.424203 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b95359d-b1f7-4088-b17d-f035f20d0e55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:42.426966 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b95359d-b1f7-4088-b17d-f035f20d0e55 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:42.434840 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bfd438-e5d6-41c3-a09c-4278a7ceb3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:42.436189 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bfd438-e5d6-41c3-a09c-4278a7ceb3b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:42.436575 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bfd438-e5d6-41c3-a09c-4278a7ceb3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:42.437048 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bfd438-e5d6-41c3-a09c-4278a7ceb3b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:42.437868 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bfd438-e5d6-41c3-a09c-4278a7ceb3b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:42.441412 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bfd438-e5d6-41c3-a09c-4278a7ceb3b1 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:42.471298 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 877/1733] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:29:42 2022] POST /identity/v3/users => generated 283 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:29:42.472403 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95359d-b1f7-4088-b17d-f035f20d0e55 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:42.479499 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 857/1734] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:29:42.484123 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bfd438-e5d6-41c3-a09c-4278a7ceb3b1 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:42.492480 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95359d-b1f7-4088-b17d-f035f20d0e55 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:42.497839 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a55cc6-d915-4674-8a92-a1f7f2c3030a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:42.498471 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a55cc6-d915-4674-8a92-a1f7f2c3030a admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:42.498755 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a55cc6-d915-4674-8a92-a1f7f2c3030a admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:42.499032 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a55cc6-d915-4674-8a92-a1f7f2c3030a admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:42.499790 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a55cc6-d915-4674-8a92-a1f7f2c3030a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:42.501610 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a55cc6-d915-4674-8a92-a1f7f2c3030a admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:42.509382 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bfd438-e5d6-41c3-a09c-4278a7ceb3b1 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:42.524535 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2068ec33-195b-4289-a9ed-55137aa065d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:42.528016 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2068ec33-195b-4289-a9ed-55137aa065d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:42.528229 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 878/1735] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:29:42.529185 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a55cc6-d915-4674-8a92-a1f7f2c3030a admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:42.529747 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2068ec33-195b-4289-a9ed-55137aa065d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:42.530440 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2068ec33-195b-4289-a9ed-55137aa065d9 admin admin] PATH_INFO: `/v3/projects/5073eb0ac0454ae991b83cbca4b97826/users/f74d9cb3472b4a4c97660b759377e91f/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:42.535389 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2068ec33-195b-4289-a9ed-55137aa065d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5073eb0ac0454ae991b83cbca4b97826, user_id=f74d9cb3472b4a4c97660b759377e91f, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:42.541433 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a55cc6-d915-4674-8a92-a1f7f2c3030a admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:42.545871 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2068ec33-195b-4289-a9ed-55137aa065d9 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:42.546445 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82847e5-4c38-4bee-98f2-95e964fd378c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:42.547118 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82847e5-4c38-4bee-98f2-95e964fd378c admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:42.547408 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82847e5-4c38-4bee-98f2-95e964fd378c admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:42.548571 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82847e5-4c38-4bee-98f2-95e964fd378c admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:42.549295 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82847e5-4c38-4bee-98f2-95e964fd378c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:42.551105 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82847e5-4c38-4bee-98f2-95e964fd378c admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:42.574539 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 879/1736] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:29:42.575942 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82847e5-4c38-4bee-98f2-95e964fd378c admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:42.589016 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 858/1737] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:29:42 2022] PUT /identity/v3/projects/5073eb0ac0454ae991b83cbca4b97826/users/f74d9cb3472b4a4c97660b759377e91f/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:29:42.589220 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82847e5-4c38-4bee-98f2-95e964fd378c admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:42.599485 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56881888-1f36-40f5-956e-1dacb7798140 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:42.599920 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56881888-1f36-40f5-956e-1dacb7798140 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:42.600296 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56881888-1f36-40f5-956e-1dacb7798140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:42.668144 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-56881888-1f36-40f5-956e-1dacb7798140 None None] MFA Rules not processed for user `f74d9cb3472b4a4c97660b759377e91f`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:42.670046 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-56881888-1f36-40f5-956e-1dacb7798140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:42.707035 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0552b0e3-f866-4d66-a847-045a4c2c45db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:42.707746 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552b0e3-f866-4d66-a847-045a4c2c45db admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:42.709952 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552b0e3-f866-4d66-a847-045a4c2c45db admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:42.710699 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552b0e3-f866-4d66-a847-045a4c2c45db admin admin] PATH_INFO: `/v3/projects/7e67958c37314026ab63c8b17666d0b0/users/2b3dcf67493f4d0cadc1ce99a9f7a2c3/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:42.735734 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0552b0e3-f866-4d66-a847-045a4c2c45db admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e67958c37314026ab63c8b17666d0b0, user_id=2b3dcf67493f4d0cadc1ce99a9f7a2c3, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:42.739324 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0552b0e3-f866-4d66-a847-045a4c2c45db admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:42.751571 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:42.773534 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 880/1738] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:29:42 2022] PUT /identity/v3/projects/7e67958c37314026ab63c8b17666d0b0/users/2b3dcf67493f4d0cadc1ce99a9f7a2c3/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:29:42.774945 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d029469-0f4c-4649-a20a-15c101db3ef1 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:42.776201 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d029469-0f4c-4649-a20a-15c101db3ef1 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:42.776494 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d029469-0f4c-4649-a20a-15c101db3ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:42.790145 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:42.852782 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-7d029469-0f4c-4649-a20a-15c101db3ef1 None None] MFA Rules not processed for user `55904c5143cd4836bf6e3a97e9262eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:42.854391 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-7d029469-0f4c-4649-a20a-15c101db3ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:42.858504 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 859/1739] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:42 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:42.859954 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93cae4-e999-4c7e-ae90-f9e75ed46918 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:42.860239 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93cae4-e999-4c7e-ae90-f9e75ed46918 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:42.860509 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93cae4-e999-4c7e-ae90-f9e75ed46918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:42.925737 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-7e93cae4-e999-4c7e-ae90-f9e75ed46918 None None] MFA Rules not processed for user `2b3dcf67493f4d0cadc1ce99a9f7a2c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:42.927203 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-7e93cae4-e999-4c7e-ae90-f9e75ed46918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:43.141626 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 881/1740] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:43.142689 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d029469-0f4c-4649-a20a-15c101db3ef1 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:43.145189 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-7d029469-0f4c-4649-a20a-15c101db3ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:43.167802 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 860/1741] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:43.172585 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f1c2c-e9fb-493d-8918-904f14d590cc None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:43.172865 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f1c2c-e9fb-493d-8918-904f14d590cc None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:43.173136 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f1c2c-e9fb-493d-8918-904f14d590cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:43.202016 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-9e3f1c2c-e9fb-493d-8918-904f14d590cc None None] MFA Rules not processed for user `55904c5143cd4836bf6e3a97e9262eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:43.203218 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-9e3f1c2c-e9fb-493d-8918-904f14d590cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:43.218295 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 861/1742] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:43.243054 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f1c2c-e9fb-493d-8918-904f14d590cc None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:43.335587 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d029469-0f4c-4649-a20a-15c101db3ef1 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:43.345252 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3cdd53-40b4-4f76-8e2f-3c74e99084c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:43.349211 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3cdd53-40b4-4f76-8e2f-3c74e99084c5 service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:43.350033 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3cdd53-40b4-4f76-8e2f-3c74e99084c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:43.350033 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3cdd53-40b4-4f76-8e2f-3c74e99084c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:43.386891 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f1c2c-e9fb-493d-8918-904f14d590cc None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:43.410367 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc6ba20-1bd6-41f5-b20f-23ee55147193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:43.411210 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6ba20-1bd6-41f5-b20f-23ee55147193 admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:43.411696 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6ba20-1bd6-41f5-b20f-23ee55147193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:43.412107 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6ba20-1bd6-41f5-b20f-23ee55147193 admin admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:43.412889 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc6ba20-1bd6-41f5-b20f-23ee55147193 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:43.417636 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc6ba20-1bd6-41f5-b20f-23ee55147193 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:43.471645 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3cdd53-40b4-4f76-8e2f-3c74e99084c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:43.473953 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3cdd53-40b4-4f76-8e2f-3c74e99084c5 service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:43.508992 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 862/1743] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:29:43 2022] POST /identity/v3/projects => generated 363 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:29:43.508992 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc6ba20-1bd6-41f5-b20f-23ee55147193 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:43.512160 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 882/1744] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:29:43 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:29:43.512874 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3cdd53-40b4-4f76-8e2f-3c74e99084c5 service cinder] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:43.515786 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-2dc6ba20-1bd6-41f5-b20f-23ee55147193 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:43.519284 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-1e3cdd53-40b4-4f76-8e2f-3c74e99084c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:43.566222 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3cdd53-40b4-4f76-8e2f-3c74e99084c5 service cinder] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:43.673216 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:43.687137 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:43.712541 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab1d5c1-2832-4bf5-a55d-e23de8d89034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:43.713423 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1d5c1-2832-4bf5-a55d-e23de8d89034 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:43.713813 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1d5c1-2832-4bf5-a55d-e23de8d89034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:43.714188 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1d5c1-2832-4bf5-a55d-e23de8d89034 admin admin] PATH_INFO: `/v3/users/6328274838c54c288994c93c52bc693b` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:43.716648 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab1d5c1-2832-4bf5-a55d-e23de8d89034 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6328274838c54c288994c93c52bc693b)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:43.718948 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab1d5c1-2832-4bf5-a55d-e23de8d89034 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:43.744461 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc6ba20-1bd6-41f5-b20f-23ee55147193 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:43.759971 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7cf7cb-2455-4576-ab6e-ee88f00bd60b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8889145228a24fb6bd539a11925e62f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:43.761234 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7cf7cb-2455-4576-ab6e-ee88f00bd60b service nova] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:43.761234 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7cf7cb-2455-4576-ab6e-ee88f00bd60b service nova] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:43.761541 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7cf7cb-2455-4576-ab6e-ee88f00bd60b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:43.830161 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-bab1d5c1-2832-4bf5-a55d-e23de8d89034 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6328274838c54c288994c93c52bc693b'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:43.867696 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-bab1d5c1-2832-4bf5-a55d-e23de8d89034 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6328274838c54c288994c93c52bc693b'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:43.868426 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-bab1d5c1-2832-4bf5-a55d-e23de8d89034 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6328274838c54c288994c93c52bc693b'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:43.894403 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7cf7cb-2455-4576-ab6e-ee88f00bd60b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:43.896288 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7cf7cb-2455-4576-ab6e-ee88f00bd60b service nova] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:43.907543 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 863/1745] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:29:43 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:29:43.908628 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7cf7cb-2455-4576-ab6e-ee88f00bd60b service nova] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:43.921082 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7cf7cb-2455-4576-ab6e-ee88f00bd60b service nova] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:43.927771 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da0dff6-bc4b-49fe-9364-92c3205e8258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:43.929015 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0dff6-bc4b-49fe-9364-92c3205e8258 admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:43.929547 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0dff6-bc4b-49fe-9364-92c3205e8258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:43.929931 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-bab1d5c1-2832-4bf5-a55d-e23de8d89034 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6328274838c54c288994c93c52bc693b'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:43.930176 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0dff6-bc4b-49fe-9364-92c3205e8258 admin admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:43.930964 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da0dff6-bc4b-49fe-9364-92c3205e8258 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:43.932870 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-bab1d5c1-2832-4bf5-a55d-e23de8d89034 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6328274838c54c288994c93c52bc693b'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:43.933472 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da0dff6-bc4b-49fe-9364-92c3205e8258 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:43.960064 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 864/1746] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:29:43 2022] POST /identity/v3/users => generated 288 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:29:43.963207 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da0dff6-bc4b-49fe-9364-92c3205e8258 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:43.966127 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-5da0dff6-bc4b-49fe-9364-92c3205e8258 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:43.982050 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da0dff6-bc4b-49fe-9364-92c3205e8258 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:43.982829 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 883/1747] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:29:43 2022] DELETE /identity/v3/users/6328274838c54c288994c93c52bc693b => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:29:43.983982 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab1d5c1-2832-4bf5-a55d-e23de8d89034 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:43.986465 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-bab1d5c1-2832-4bf5-a55d-e23de8d89034 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:44.100964 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e0d92-f96f-40b6-b8d7-2a57acace606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:44.103686 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e0d92-f96f-40b6-b8d7-2a57acace606 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:44.104533 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e0d92-f96f-40b6-b8d7-2a57acace606 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:44.104985 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e0d92-f96f-40b6-b8d7-2a57acace606 admin admin] PATH_INFO: `/v3/users/500e26b758d3412eb6b893de874cc65b` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:44.108146 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55e0d92-f96f-40b6-b8d7-2a57acace606 admin admin] RBAC: Authorizing `identity:delete_user(user_id=500e26b758d3412eb6b893de874cc65b)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:44.114616 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55e0d92-f96f-40b6-b8d7-2a57acace606 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:44.217111 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-e55e0d92-f96f-40b6-b8d7-2a57acace606 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '500e26b758d3412eb6b893de874cc65b'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:44.223788 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab1d5c1-2832-4bf5-a55d-e23de8d89034 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:44.232031 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-e55e0d92-f96f-40b6-b8d7-2a57acace606 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '500e26b758d3412eb6b893de874cc65b'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:44.233960 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-e55e0d92-f96f-40b6-b8d7-2a57acace606 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '500e26b758d3412eb6b893de874cc65b'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:44.235068 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-e55e0d92-f96f-40b6-b8d7-2a57acace606 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '500e26b758d3412eb6b893de874cc65b'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:44.242833 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb39162-43f4-40af-b30f-bac32c2ac9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:44.243690 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb39162-43f4-40af-b30f-bac32c2ac9e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:44.243889 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb39162-43f4-40af-b30f-bac32c2ac9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:44.244314 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb39162-43f4-40af-b30f-bac32c2ac9e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:44.245150 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb39162-43f4-40af-b30f-bac32c2ac9e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:44.246908 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb39162-43f4-40af-b30f-bac32c2ac9e3 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:44.250911 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:44.254108 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-e55e0d92-f96f-40b6-b8d7-2a57acace606 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '500e26b758d3412eb6b893de874cc65b'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:44.277901 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 865/1748] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:29:43 2022] DELETE /identity/v3/users/500e26b758d3412eb6b893de874cc65b => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:29:44.282358 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 884/1749] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:29:44.283028 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179fc1a-1ad0-4028-bcc6-114977f6a7b2 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:44.283389 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179fc1a-1ad0-4028-bcc6-114977f6a7b2 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:44.283769 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179fc1a-1ad0-4028-bcc6-114977f6a7b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:44.285009 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae1d27-650a-4d8d-8052-1bd1b3202d87 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:44.285375 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae1d27-650a-4d8d-8052-1bd1b3202d87 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:44.285737 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae1d27-650a-4d8d-8052-1bd1b3202d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:44.326213 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-b4ae1d27-650a-4d8d-8052-1bd1b3202d87 None None] MFA Rules not processed for user `b9ee91e130434c8c9c7ce081dade1395`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:44.327863 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-b4ae1d27-650a-4d8d-8052-1bd1b3202d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:44.331621 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-c179fc1a-1ad0-4028-bcc6-114977f6a7b2 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:44.334779 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-c179fc1a-1ad0-4028-bcc6-114977f6a7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:44.391705 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:44.437717 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 885/1750] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:44 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:44.439995 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae1d27-650a-4d8d-8052-1bd1b3202d87 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:44.448879 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-b4ae1d27-650a-4d8d-8052-1bd1b3202d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:44.465018 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 866/1751] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:44.466694 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604afcd-8aa0-4bff-b17c-d6eb9af0dded None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:44.467150 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604afcd-8aa0-4bff-b17c-d6eb9af0dded None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:44.467708 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604afcd-8aa0-4bff-b17c-d6eb9af0dded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:44.502871 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-2604afcd-8aa0-4bff-b17c-d6eb9af0dded None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:44.504481 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-2604afcd-8aa0-4bff-b17c-d6eb9af0dded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:44.541781 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 867/1752] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:44.543000 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c6393-bc2a-4322-aaf3-4ef2e259b955 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:44.543302 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c6393-bc2a-4322-aaf3-4ef2e259b955 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:44.543595 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c6393-bc2a-4322-aaf3-4ef2e259b955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:44.607879 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-837c6393-bc2a-4322-aaf3-4ef2e259b955 None None] MFA Rules not processed for user `b9ee91e130434c8c9c7ce081dade1395`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:44.611785 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-837c6393-bc2a-4322-aaf3-4ef2e259b955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:44.630599 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae1d27-650a-4d8d-8052-1bd1b3202d87 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:44.633407 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 868/1753] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:44 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:44.634317 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c6393-bc2a-4322-aaf3-4ef2e259b955 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:44.646467 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd5c34f-fcdd-4f5b-9bf1-0a281263fa4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:44.647061 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-837c6393-bc2a-4322-aaf3-4ef2e259b955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:44.647546 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5c34f-fcdd-4f5b-9bf1-0a281263fa4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:44.647831 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5c34f-fcdd-4f5b-9bf1-0a281263fa4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:44.648143 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5c34f-fcdd-4f5b-9bf1-0a281263fa4b admin admin] PATH_INFO: `/v3/projects/2867edc6a3ec45658c0bb9a2b6ad9a9d/users/9811c02e03a94a16b9e0e9dd88e43514/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:44.687717 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd5c34f-fcdd-4f5b-9bf1-0a281263fa4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2867edc6a3ec45658c0bb9a2b6ad9a9d, user_id=9811c02e03a94a16b9e0e9dd88e43514, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:44.690454 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd5c34f-fcdd-4f5b-9bf1-0a281263fa4b admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:44.725587 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 886/1754] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:29:44 2022] PUT /identity/v3/projects/2867edc6a3ec45658c0bb9a2b6ad9a9d/users/9811c02e03a94a16b9e0e9dd88e43514/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:29:44.726861 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd5c34f-fcdd-4f5b-9bf1-0a281263fa4b admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:44.731817 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-3cd5c34f-fcdd-4f5b-9bf1-0a281263fa4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:44.801141 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c6393-bc2a-4322-aaf3-4ef2e259b955 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:44.832690 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd5c34f-fcdd-4f5b-9bf1-0a281263fa4b admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:44.840359 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3dd457-a734-4dbb-b375-722eccb820d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:44.841062 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3dd457-a734-4dbb-b375-722eccb820d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:44.841336 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3dd457-a734-4dbb-b375-722eccb820d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:44.841606 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3dd457-a734-4dbb-b375-722eccb820d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:44.961953 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3dd457-a734-4dbb-b375-722eccb820d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:44.971823 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3dd457-a734-4dbb-b375-722eccb820d7 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:44.978177 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37930803-a677-48d3-97f3-2cd7d34597bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:44.979015 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37930803-a677-48d3-97f3-2cd7d34597bf service neutron] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:44.979484 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37930803-a677-48d3-97f3-2cd7d34597bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:44.979916 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37930803-a677-48d3-97f3-2cd7d34597bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:44.998342 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 887/1755] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:29:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:29:45.000986 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3dd457-a734-4dbb-b375-722eccb820d7 service neutron] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:45.005987 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37930803-a677-48d3-97f3-2cd7d34597bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:45.010104 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-0e3dd457-a734-4dbb-b375-722eccb820d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:45.012143 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37930803-a677-48d3-97f3-2cd7d34597bf service neutron] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:45.037230 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:45.037994 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 869/1756] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:29:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:29:45.040477 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37930803-a677-48d3-97f3-2cd7d34597bf service neutron] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:45.072788 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37930803-a677-48d3-97f3-2cd7d34597bf service neutron] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:45.089204 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e262e81-1e92-432d-980e-1c1a2e1b8051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:45.090016 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e262e81-1e92-432d-980e-1c1a2e1b8051 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:45.090392 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e262e81-1e92-432d-980e-1c1a2e1b8051 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:45.090762 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e262e81-1e92-432d-980e-1c1a2e1b8051 admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:45.091559 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e262e81-1e92-432d-980e-1c1a2e1b8051 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:45.093341 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e262e81-1e92-432d-980e-1c1a2e1b8051 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:45.124696 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 870/1757] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:29:45.126368 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3196bc19-5ad3-40d9-9f44-e7c1a7809a86 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:45.126769 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3196bc19-5ad3-40d9-9f44-e7c1a7809a86 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:45.127141 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3196bc19-5ad3-40d9-9f44-e7c1a7809a86 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:45.128633 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 871/1758] 10.222.0.60 () {54 vars in 912 bytes} [Tue Aug 30 01:29:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:29:45.129449 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3196bc19-5ad3-40d9-9f44-e7c1a7809a86 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:45.148946 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3196bc19-5ad3-40d9-9f44-e7c1a7809a86 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:45.159299 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56022d05-f397-45db-8391-618b2e6c2ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:45.161042 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56022d05-f397-45db-8391-618b2e6c2ef2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:45.161531 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56022d05-f397-45db-8391-618b2e6c2ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:45.161900 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56022d05-f397-45db-8391-618b2e6c2ef2 admin admin] PATH_INFO: `/v3/projects/2867edc6a3ec45658c0bb9a2b6ad9a9d/users/9811c02e03a94a16b9e0e9dd88e43514/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:45.169075 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56022d05-f397-45db-8391-618b2e6c2ef2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2867edc6a3ec45658c0bb9a2b6ad9a9d, user_id=9811c02e03a94a16b9e0e9dd88e43514, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:45.172030 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56022d05-f397-45db-8391-618b2e6c2ef2 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:45.190388 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3dd457-a734-4dbb-b375-722eccb820d7 service neutron] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:45.208972 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 872/1759] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:29:45 2022] PUT /identity/v3/projects/2867edc6a3ec45658c0bb9a2b6ad9a9d/users/9811c02e03a94a16b9e0e9dd88e43514/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:29:45.210924 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b3133-f032-4f3d-b692-3502464625b3 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:45.211298 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b3133-f032-4f3d-b692-3502464625b3 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:45.211941 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b3133-f032-4f3d-b692-3502464625b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:45.246896 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:45.318220 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-5b4b3133-f032-4f3d-b692-3502464625b3 None None] MFA Rules not processed for user `61e48e00a0c34949a4fffae8c372304e`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:45.318220 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-5b4b3133-f032-4f3d-b692-3502464625b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:45.364262 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aad976-0e71-4241-b403-1db9f25aed18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8889145228a24fb6bd539a11925e62f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:45.364891 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aad976-0e71-4241-b403-1db9f25aed18 service nova] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:45.365167 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aad976-0e71-4241-b403-1db9f25aed18 service nova] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:45.365504 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aad976-0e71-4241-b403-1db9f25aed18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:45.429535 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 873/1760] 10.222.0.60 () {58 vars in 1009 bytes} [Tue Aug 30 01:29:45 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:45.438046 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47501d-fc17-4208-a2c6-ec7b7b8e52ef None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:45.438046 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47501d-fc17-4208-a2c6-ec7b7b8e52ef None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:45.438046 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47501d-fc17-4208-a2c6-ec7b7b8e52ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:45.531236 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-2e47501d-fc17-4208-a2c6-ec7b7b8e52ef None None] MFA Rules not processed for user `9811c02e03a94a16b9e0e9dd88e43514`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:45.533711 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-2e47501d-fc17-4208-a2c6-ec7b7b8e52ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:45.550517 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aad976-0e71-4241-b403-1db9f25aed18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:45.553965 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aad976-0e71-4241-b403-1db9f25aed18 service nova] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:45.588175 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 888/1761] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:29:44 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:29:45.589305 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aad976-0e71-4241-b403-1db9f25aed18 service nova] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:45.591143 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-e5aad976-0e71-4241-b403-1db9f25aed18 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:45.614473 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aad976-0e71-4241-b403-1db9f25aed18 service nova] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:45.627903 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec4c08d-cb8f-49d4-9f00-224602b01ff1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:45.628608 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4c08d-cb8f-49d4-9f00-224602b01ff1 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:45.628862 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4c08d-cb8f-49d4-9f00-224602b01ff1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:45.629621 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4c08d-cb8f-49d4-9f00-224602b01ff1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:45.669336 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec4c08d-cb8f-49d4-9f00-224602b01ff1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:45.669336 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec4c08d-cb8f-49d4-9f00-224602b01ff1 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:45.757803 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 889/1762] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:29:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:29:45.783731 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec4c08d-cb8f-49d4-9f00-224602b01ff1 service neutron] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:45.784483 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 874/1763] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:45 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:45.792778 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-fec4c08d-cb8f-49d4-9f00-224602b01ff1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:45.919958 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:45.969851 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec4c08d-cb8f-49d4-9f00-224602b01ff1 service neutron] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:45.980733 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f77500-19a6-4591-b48f-f000e95c5018 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:45.981372 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f77500-19a6-4591-b48f-f000e95c5018 service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:45.981653 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f77500-19a6-4591-b48f-f000e95c5018 service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:45.981923 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f77500-19a6-4591-b48f-f000e95c5018 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:46.009027 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f77500-19a6-4591-b48f-f000e95c5018 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:46.010578 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f77500-19a6-4591-b48f-f000e95c5018 service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:46.024052 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 890/1764] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:29:45 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:29:46.376328 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f55bd-aa47-48b9-ab41-09ffd6d4f98d None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:46.376840 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f55bd-aa47-48b9-ab41-09ffd6d4f98d None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:46.376950 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f55bd-aa47-48b9-ab41-09ffd6d4f98d None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:46.378716 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 875/1765] 10.222.0.60 () {54 vars in 912 bytes} [Tue Aug 30 01:29:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:29:46.393162 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc0adf-d9ca-4448-8ac1-425d7b712089 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:46.393265 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc0adf-d9ca-4448-8ac1-425d7b712089 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:46.393548 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc0adf-d9ca-4448-8ac1-425d7b712089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:46.470488 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-3ccc0adf-d9ca-4448-8ac1-425d7b712089 None None] MFA Rules not processed for user `61e48e00a0c34949a4fffae8c372304e`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:46.474733 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-3ccc0adf-d9ca-4448-8ac1-425d7b712089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:46.506202 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 891/1766] 10.222.0.60 () {58 vars in 1009 bytes} [Tue Aug 30 01:29:46 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:29:46.515270 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0f55bd-aa47-48b9-ab41-09ffd6d4f98d None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:46.535634 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0f55bd-aa47-48b9-ab41-09ffd6d4f98d None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:46.552187 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a7716c-7722-4d3f-9e3d-74c6d49249ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:46.552835 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7716c-7722-4d3f-9e3d-74c6d49249ba service neutron] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:46.555518 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7716c-7722-4d3f-9e3d-74c6d49249ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:46.556837 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7716c-7722-4d3f-9e3d-74c6d49249ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:46.582015 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a7716c-7722-4d3f-9e3d-74c6d49249ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:46.584046 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a7716c-7722-4d3f-9e3d-74c6d49249ba service neutron] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:46.636886 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 876/1767] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:29:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:29:46.880955 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc0adf-d9ca-4448-8ac1-425d7b712089 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:46.882942 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-3ccc0adf-d9ca-4448-8ac1-425d7b712089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:46.938949 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a7716c-7722-4d3f-9e3d-74c6d49249ba service neutron] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:47.087245 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc0adf-d9ca-4448-8ac1-425d7b712089 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:47.105785 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45565cc6-6102-445f-81a0-79319780239e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8dbb4742c3944b9ad389e9628b5a047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:47.106595 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45565cc6-6102-445f-81a0-79319780239e service placement] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:47.106912 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45565cc6-6102-445f-81a0-79319780239e service placement] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:47.107143 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45565cc6-6102-445f-81a0-79319780239e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:47.110888 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-45565cc6-6102-445f-81a0-79319780239e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:47.112420 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a7716c-7722-4d3f-9e3d-74c6d49249ba service neutron] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:47.125337 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d81fc54-0639-4218-969f-7a4f973180ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:47.126271 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81fc54-0639-4218-969f-7a4f973180ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:47.127283 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81fc54-0639-4218-969f-7a4f973180ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:47.127717 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81fc54-0639-4218-969f-7a4f973180ee admin admin] PATH_INFO: `/v3/users/2b3dcf67493f4d0cadc1ce99a9f7a2c3` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:47.129041 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d81fc54-0639-4218-969f-7a4f973180ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b3dcf67493f4d0cadc1ce99a9f7a2c3)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:47.131193 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d81fc54-0639-4218-969f-7a4f973180ee admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:47.136004 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45565cc6-6102-445f-81a0-79319780239e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:47.145342 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45565cc6-6102-445f-81a0-79319780239e service placement] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:47.167423 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:47.170807 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 892/1768] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:29:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:29:47.177662 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bfa80-5874-4612-8571-5619043e7c3d None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:47.178003 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bfa80-5874-4612-8571-5619043e7c3d None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:47.178513 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bfa80-5874-4612-8571-5619043e7c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:47.231887 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-a92bfa80-5874-4612-8571-5619043e7c3d None None] MFA Rules not processed for user `0648872a9f8648ca803418bc3a3b04b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:47.236714 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-a92bfa80-5874-4612-8571-5619043e7c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:47.242634 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-6d81fc54-0639-4218-969f-7a4f973180ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b3dcf67493f4d0cadc1ce99a9f7a2c3'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:47.271865 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-6d81fc54-0639-4218-969f-7a4f973180ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b3dcf67493f4d0cadc1ce99a9f7a2c3'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:47.272787 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-6d81fc54-0639-4218-969f-7a4f973180ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b3dcf67493f4d0cadc1ce99a9f7a2c3'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:47.274489 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-6d81fc54-0639-4218-969f-7a4f973180ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b3dcf67493f4d0cadc1ce99a9f7a2c3'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:47.321561 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-6d81fc54-0639-4218-969f-7a4f973180ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b3dcf67493f4d0cadc1ce99a9f7a2c3'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:47.358094 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 877/1769] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:29:46 2022] DELETE /identity/v3/users/2b3dcf67493f4d0cadc1ce99a9f7a2c3 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:29:47.359292 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d81fc54-0639-4218-969f-7a4f973180ee admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:47.370486 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-6d81fc54-0639-4218-969f-7a4f973180ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:47.437772 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 893/1770] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:47 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:47.439078 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3d2f8-ee58-4636-9964-98db01f69274 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:47.439371 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3d2f8-ee58-4636-9964-98db01f69274 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:47.439676 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3d2f8-ee58-4636-9964-98db01f69274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:47.504782 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-74a3d2f8-ee58-4636-9964-98db01f69274 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:47.506094 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-74a3d2f8-ee58-4636-9964-98db01f69274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:47.635856 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 894/1771] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:47.666198 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d81fc54-0639-4218-969f-7a4f973180ee admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:47.685531 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6ecdc3-f9f4-4058-bdb2-91709d2f0abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:47.686120 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ecdc3-f9f4-4058-bdb2-91709d2f0abc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:47.686401 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ecdc3-f9f4-4058-bdb2-91709d2f0abc admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:47.686750 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ecdc3-f9f4-4058-bdb2-91709d2f0abc admin admin] PATH_INFO: `/v3/projects/8904118955b54557b1ddf490ff5a35ca` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:47.695542 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6ecdc3-f9f4-4058-bdb2-91709d2f0abc admin admin] RBAC: Authorizing `identity:delete_project(project_id=8904118955b54557b1ddf490ff5a35ca)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:47.705010 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6ecdc3-f9f4-4058-bdb2-91709d2f0abc admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:47.727612 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a3d2f8-ee58-4636-9964-98db01f69274 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:47.729318 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-74a3d2f8-ee58-4636-9964-98db01f69274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:47.752711 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:47.935009 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-2a6ecdc3-f9f4-4058-bdb2-91709d2f0abc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8904118955b54557b1ddf490ff5a35ca', 'request_id': 'req-2a6ecdc3-f9f4-4058-bdb2-91709d2f0abc'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:47.961270 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a3d2f8-ee58-4636-9964-98db01f69274 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:47.963177 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-2a6ecdc3-f9f4-4058-bdb2-91709d2f0abc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8904118955b54557b1ddf490ff5a35ca', 'request_id': 'req-2a6ecdc3-f9f4-4058-bdb2-91709d2f0abc'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:47.987729 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-2a6ecdc3-f9f4-4058-bdb2-91709d2f0abc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8904118955b54557b1ddf490ff5a35ca', 'request_id': 'req-2a6ecdc3-f9f4-4058-bdb2-91709d2f0abc'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:48.039336 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-2a6ecdc3-f9f4-4058-bdb2-91709d2f0abc admin admin] The token cache is being invalidate because project 8904118955b54557b1ddf490ff5a35ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81447) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:29:48.041206 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-2a6ecdc3-f9f4-4058-bdb2-91709d2f0abc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:48.042956 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-2a6ecdc3-f9f4-4058-bdb2-91709d2f0abc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:48.049447 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 878/1772] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:29:47 2022] DELETE /identity/v3/projects/8904118955b54557b1ddf490ff5a35ca => generated 0 bytes in 691 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:29:48.054438 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6ecdc3-f9f4-4058-bdb2-91709d2f0abc admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:48.060350 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-2a6ecdc3-f9f4-4058-bdb2-91709d2f0abc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:48.180338 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:48.190535 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee95a379-5b1d-4b60-a617-774a55678402 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:48.191173 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95a379-5b1d-4b60-a617-774a55678402 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:48.191483 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95a379-5b1d-4b60-a617-774a55678402 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:48.191769 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95a379-5b1d-4b60-a617-774a55678402 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:48.208741 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-ee95a379-5b1d-4b60-a617-774a55678402 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:48.303977 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6ecdc3-f9f4-4058-bdb2-91709d2f0abc admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:48.329370 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01307653-0b40-435e-b916-e38ebd9e2ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:48.330374 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01307653-0b40-435e-b916-e38ebd9e2ca2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:48.330707 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01307653-0b40-435e-b916-e38ebd9e2ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:48.331032 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01307653-0b40-435e-b916-e38ebd9e2ca2 admin admin] PATH_INFO: `/v3/users/f74d9cb3472b4a4c97660b759377e91f` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:48.333516 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01307653-0b40-435e-b916-e38ebd9e2ca2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f74d9cb3472b4a4c97660b759377e91f)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:48.335995 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01307653-0b40-435e-b916-e38ebd9e2ca2 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:48.391961 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee95a379-5b1d-4b60-a617-774a55678402 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:48.399395 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee95a379-5b1d-4b60-a617-774a55678402 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:48.437743 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 895/1773] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:29:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 711 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:29:48.441815 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-01307653-0b40-435e-b916-e38ebd9e2ca2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f74d9cb3472b4a4c97660b759377e91f'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:48.444328 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad567eb-c4eb-42a6-87d2-a448f3da9e0d None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:48.446191 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad567eb-c4eb-42a6-87d2-a448f3da9e0d None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:48.447260 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad567eb-c4eb-42a6-87d2-a448f3da9e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:48.463066 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-01307653-0b40-435e-b916-e38ebd9e2ca2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f74d9cb3472b4a4c97660b759377e91f'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:48.463754 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-01307653-0b40-435e-b916-e38ebd9e2ca2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f74d9cb3472b4a4c97660b759377e91f'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:48.465055 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-01307653-0b40-435e-b916-e38ebd9e2ca2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f74d9cb3472b4a4c97660b759377e91f'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:48.478337 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-7ad567eb-c4eb-42a6-87d2-a448f3da9e0d None None] MFA Rules not processed for user `a991f1a0f804497c91d21d69e33113ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:48.480625 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-7ad567eb-c4eb-42a6-87d2-a448f3da9e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:48.496071 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-01307653-0b40-435e-b916-e38ebd9e2ca2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f74d9cb3472b4a4c97660b759377e91f'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:48.533270 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 879/1774] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:29:48 2022] DELETE /identity/v3/users/f74d9cb3472b4a4c97660b759377e91f => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:29:48.535276 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01307653-0b40-435e-b916-e38ebd9e2ca2 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:48.539754 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-01307653-0b40-435e-b916-e38ebd9e2ca2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:48.682114 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 896/1775] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:48.688629 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c7d39-2166-46cc-a69e-4d25fb061ee0 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:48.689133 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c7d39-2166-46cc-a69e-4d25fb061ee0 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:48.689413 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c7d39-2166-46cc-a69e-4d25fb061ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:48.716523 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01307653-0b40-435e-b916-e38ebd9e2ca2 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:48.724715 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d355636-007c-4bb8-bbe7-550d52a8e6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:48.725645 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d355636-007c-4bb8-bbe7-550d52a8e6d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:48.726644 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d355636-007c-4bb8-bbe7-550d52a8e6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:48.727939 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d355636-007c-4bb8-bbe7-550d52a8e6d5 admin admin] PATH_INFO: `/v3/projects/a78ea5d206df4ed3b6d8852e305aec0b` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:48.732264 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d355636-007c-4bb8-bbe7-550d52a8e6d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a78ea5d206df4ed3b6d8852e305aec0b)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:48.737595 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d355636-007c-4bb8-bbe7-550d52a8e6d5 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:48.740443 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-be2c7d39-2166-46cc-a69e-4d25fb061ee0 None None] MFA Rules not processed for user `b9ee91e130434c8c9c7ce081dade1395`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:48.741745 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-be2c7d39-2166-46cc-a69e-4d25fb061ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:48.769311 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:48.827915 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:48.838608 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-0d355636-007c-4bb8-bbe7-550d52a8e6d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a78ea5d206df4ed3b6d8852e305aec0b', 'request_id': 'req-0d355636-007c-4bb8-bbe7-550d52a8e6d5'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:48.863614 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-0d355636-007c-4bb8-bbe7-550d52a8e6d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a78ea5d206df4ed3b6d8852e305aec0b', 'request_id': 'req-0d355636-007c-4bb8-bbe7-550d52a8e6d5'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:48.883467 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-0d355636-007c-4bb8-bbe7-550d52a8e6d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a78ea5d206df4ed3b6d8852e305aec0b', 'request_id': 'req-0d355636-007c-4bb8-bbe7-550d52a8e6d5'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:48.918646 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-0d355636-007c-4bb8-bbe7-550d52a8e6d5 admin admin] The token cache is being invalidate because project a78ea5d206df4ed3b6d8852e305aec0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81447) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:29:48.921641 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-0d355636-007c-4bb8-bbe7-550d52a8e6d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:48.921795 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 897/1776] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:48 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:48.923904 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-0d355636-007c-4bb8-bbe7-550d52a8e6d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:48.927261 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 880/1777] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:29:48 2022] DELETE /identity/v3/projects/a78ea5d206df4ed3b6d8852e305aec0b => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:29:48.931826 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c7d39-2166-46cc-a69e-4d25fb061ee0 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:48.948443 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c7d39-2166-46cc-a69e-4d25fb061ee0 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:49.207068 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f67937d-4be2-4401-9e1c-fb8accf1e423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:49.222235 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67937d-4be2-4401-9e1c-fb8accf1e423 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:49.227497 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67937d-4be2-4401-9e1c-fb8accf1e423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:49.228387 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67937d-4be2-4401-9e1c-fb8accf1e423 admin admin] PATH_INFO: `/v3/users/b33db6f21e1f4e0d9c86d3a0e0af2b2e` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:49.230173 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f67937d-4be2-4401-9e1c-fb8accf1e423 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b33db6f21e1f4e0d9c86d3a0e0af2b2e)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:49.232529 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f67937d-4be2-4401-9e1c-fb8accf1e423 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:49.421852 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-0f67937d-4be2-4401-9e1c-fb8accf1e423 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b33db6f21e1f4e0d9c86d3a0e0af2b2e'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:49.435322 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d355636-007c-4bb8-bbe7-550d52a8e6d5 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:49.436922 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-0d355636-007c-4bb8-bbe7-550d52a8e6d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:49.453388 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-0f67937d-4be2-4401-9e1c-fb8accf1e423 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b33db6f21e1f4e0d9c86d3a0e0af2b2e'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:49.455556 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-0f67937d-4be2-4401-9e1c-fb8accf1e423 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b33db6f21e1f4e0d9c86d3a0e0af2b2e'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:49.492895 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d355636-007c-4bb8-bbe7-550d52a8e6d5 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:49.516222 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9289f2-eee7-4962-bb47-7af2408c873c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:49.519022 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9289f2-eee7-4962-bb47-7af2408c873c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:49.519592 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-0f67937d-4be2-4401-9e1c-fb8accf1e423 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b33db6f21e1f4e0d9c86d3a0e0af2b2e'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:49.520069 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9289f2-eee7-4962-bb47-7af2408c873c admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:49.522811 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-0f67937d-4be2-4401-9e1c-fb8accf1e423 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b33db6f21e1f4e0d9c86d3a0e0af2b2e'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:49.523598 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9289f2-eee7-4962-bb47-7af2408c873c admin admin] PATH_INFO: `/v3/projects/5073eb0ac0454ae991b83cbca4b97826` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:49.531960 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9289f2-eee7-4962-bb47-7af2408c873c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5073eb0ac0454ae991b83cbca4b97826)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:49.546513 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9289f2-eee7-4962-bb47-7af2408c873c admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:49.565114 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 898/1778] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:29:48 2022] DELETE /identity/v3/users/b33db6f21e1f4e0d9c86d3a0e0af2b2e => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:29:49.737149 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-3b9289f2-eee7-4962-bb47-7af2408c873c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5073eb0ac0454ae991b83cbca4b97826', 'request_id': 'req-3b9289f2-eee7-4962-bb47-7af2408c873c'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:49.759186 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-3b9289f2-eee7-4962-bb47-7af2408c873c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5073eb0ac0454ae991b83cbca4b97826', 'request_id': 'req-3b9289f2-eee7-4962-bb47-7af2408c873c'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:49.785111 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-3b9289f2-eee7-4962-bb47-7af2408c873c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5073eb0ac0454ae991b83cbca4b97826', 'request_id': 'req-3b9289f2-eee7-4962-bb47-7af2408c873c'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:49.817059 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-3b9289f2-eee7-4962-bb47-7af2408c873c admin admin] The token cache is being invalidate because project 5073eb0ac0454ae991b83cbca4b97826 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81447) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:29:49.817363 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-3b9289f2-eee7-4962-bb47-7af2408c873c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:49.822041 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-3b9289f2-eee7-4962-bb47-7af2408c873c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:49.828273 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 881/1779] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:29:49 2022] DELETE /identity/v3/projects/5073eb0ac0454ae991b83cbca4b97826 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:29:49.833923 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f84e3-3b4a-40b2-81fd-9eda2cef40ac None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:49.834285 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f84e3-3b4a-40b2-81fd-9eda2cef40ac None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:49.834827 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f84e3-3b4a-40b2-81fd-9eda2cef40ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:49.880861 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-328f84e3-3b4a-40b2-81fd-9eda2cef40ac None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:49.883612 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-328f84e3-3b4a-40b2-81fd-9eda2cef40ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:50.054843 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:50.129451 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 899/1780] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:50.130782 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6229a98-a7a8-4d61-97c2-132f436a6d2c None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:50.131125 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6229a98-a7a8-4d61-97c2-132f436a6d2c None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:50.131424 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6229a98-a7a8-4d61-97c2-132f436a6d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:50.207018 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-c6229a98-a7a8-4d61-97c2-132f436a6d2c None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:50.208357 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-c6229a98-a7a8-4d61-97c2-132f436a6d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:50.230444 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 882/1781] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:29:50.233817 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328f84e3-3b4a-40b2-81fd-9eda2cef40ac None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:50.260352 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328f84e3-3b4a-40b2-81fd-9eda2cef40ac None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:50.283860 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf94626-afe6-47da-9799-aaea10f46cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:50.286527 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf94626-afe6-47da-9799-aaea10f46cd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:50.286826 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf94626-afe6-47da-9799-aaea10f46cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:50.287110 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf94626-afe6-47da-9799-aaea10f46cd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:50.291766 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf94626-afe6-47da-9799-aaea10f46cd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:29:50.292090 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf94626-afe6-47da-9799-aaea10f46cd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:50.306699 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf94626-afe6-47da-9799-aaea10f46cd8 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:50.368190 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 900/1782] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 30 01:29:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:29:50.373498 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6229a98-a7a8-4d61-97c2-132f436a6d2c None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:50.396670 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6229a98-a7a8-4d61-97c2-132f436a6d2c None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:50.420445 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ef614-e2f3-4cbd-bc4c-4dac25456323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:50.421299 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ef614-e2f3-4cbd-bc4c-4dac25456323 admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:50.421590 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ef614-e2f3-4cbd-bc4c-4dac25456323 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:50.421869 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ef614-e2f3-4cbd-bc4c-4dac25456323 admin admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:50.424793 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ef614-e2f3-4cbd-bc4c-4dac25456323 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:50.426940 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ef614-e2f3-4cbd-bc4c-4dac25456323 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:50.528836 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 883/1783] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:29:50 2022] POST /identity/v3/projects => generated 379 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:29:50.533458 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf94626-afe6-47da-9799-aaea10f46cd8 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:50.554554 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf94626-afe6-47da-9799-aaea10f46cd8 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:50.583355 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ef614-e2f3-4cbd-bc4c-4dac25456323 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:50.585550 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-9d9ef614-e2f3-4cbd-bc4c-4dac25456323 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:50.765328 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af77a4-ca6c-4b92-802e-0f1ffe6ee2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:50.766177 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af77a4-ca6c-4b92-802e-0f1ffe6ee2ed admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:50.766629 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af77a4-ca6c-4b92-802e-0f1ffe6ee2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:50.767258 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af77a4-ca6c-4b92-802e-0f1ffe6ee2ed admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:50.769825 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7af77a4-ca6c-4b92-802e-0f1ffe6ee2ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:50.774955 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7af77a4-ca6c-4b92-802e-0f1ffe6ee2ed admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:50.788978 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ef614-e2f3-4cbd-bc4c-4dac25456323 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:50.795997 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb3baf0-58a2-4012-b154-2dc6cdb78e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:50.797202 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb3baf0-58a2-4012-b154-2dc6cdb78e06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:50.799665 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb3baf0-58a2-4012-b154-2dc6cdb78e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:50.800039 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb3baf0-58a2-4012-b154-2dc6cdb78e06 admin admin] PATH_INFO: `/v3/projects/fa98e7cf466748e4bb8685f0a078ac92` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:50.802571 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb3baf0-58a2-4012-b154-2dc6cdb78e06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa98e7cf466748e4bb8685f0a078ac92)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:50.806272 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb3baf0-58a2-4012-b154-2dc6cdb78e06 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:50.810894 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 901/1784] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:29:50 2022] POST /identity/v3/users => generated 290 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:29:50.811994 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af77a4-ca6c-4b92-802e-0f1ffe6ee2ed admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:50.823772 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af77a4-ca6c-4b92-802e-0f1ffe6ee2ed admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:50.832533 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d48a8-3727-431d-a475-d421bb50b92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:50.833338 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d48a8-3727-431d-a475-d421bb50b92f admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:50.833715 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d48a8-3727-431d-a475-d421bb50b92f admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:50.834177 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d48a8-3727-431d-a475-d421bb50b92f admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:50.835067 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546d48a8-3727-431d-a475-d421bb50b92f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:50.838165 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546d48a8-3727-431d-a475-d421bb50b92f admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:50.859473 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 902/1785] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:29:50 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:29:50.861031 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d48a8-3727-431d-a475-d421bb50b92f admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:50.879906 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:50.903944 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d48a8-3727-431d-a475-d421bb50b92f admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:50.907170 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-0cb3baf0-58a2-4012-b154-2dc6cdb78e06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa98e7cf466748e4bb8685f0a078ac92', 'request_id': 'req-0cb3baf0-58a2-4012-b154-2dc6cdb78e06'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:50.918242 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-0cb3baf0-58a2-4012-b154-2dc6cdb78e06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa98e7cf466748e4bb8685f0a078ac92', 'request_id': 'req-0cb3baf0-58a2-4012-b154-2dc6cdb78e06'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:50.944444 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-0cb3baf0-58a2-4012-b154-2dc6cdb78e06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa98e7cf466748e4bb8685f0a078ac92', 'request_id': 'req-0cb3baf0-58a2-4012-b154-2dc6cdb78e06'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:50.971291 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-0cb3baf0-58a2-4012-b154-2dc6cdb78e06 admin admin] The token cache is being invalidate because project fa98e7cf466748e4bb8685f0a078ac92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81447) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:29:50.971686 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-0cb3baf0-58a2-4012-b154-2dc6cdb78e06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:50.972329 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-0cb3baf0-58a2-4012-b154-2dc6cdb78e06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:50.977669 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 884/1786] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:29:50 2022] DELETE /identity/v3/projects/fa98e7cf466748e4bb8685f0a078ac92 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:29:50.980160 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e1e4c9-b3c4-4c68-8fa0-220d591339bf None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:50.981187 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e1e4c9-b3c4-4c68-8fa0-220d591339bf None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:50.981590 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e1e4c9-b3c4-4c68-8fa0-220d591339bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:51.001325 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e596908e-4861-4ede-9c54-d327a35acf55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:51.001952 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596908e-4861-4ede-9c54-d327a35acf55 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:51.002238 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596908e-4861-4ede-9c54-d327a35acf55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:51.002517 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596908e-4861-4ede-9c54-d327a35acf55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:51.003281 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e596908e-4861-4ede-9c54-d327a35acf55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:51.005000 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e596908e-4861-4ede-9c54-d327a35acf55 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:51.013233 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-d4e1e4c9-b3c4-4c68-8fa0-220d591339bf None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:51.015208 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-d4e1e4c9-b3c4-4c68-8fa0-220d591339bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:51.021886 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 903/1787] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:29:50 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:29:51.022946 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e596908e-4861-4ede-9c54-d327a35acf55 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:51.025916 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-e596908e-4861-4ede-9c54-d327a35acf55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:51.029345 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 885/1788] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:29:51.037657 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8685551-0e23-4e9c-a8cc-f8a19db03491 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:51.038143 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8685551-0e23-4e9c-a8cc-f8a19db03491 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:51.038653 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8685551-0e23-4e9c-a8cc-f8a19db03491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:51.044372 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e596908e-4861-4ede-9c54-d327a35acf55 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:51.050419 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690bbe32-46df-4804-a8ce-ce7a9ac7b91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:51.051725 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690bbe32-46df-4804-a8ce-ce7a9ac7b91f admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:51.051900 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690bbe32-46df-4804-a8ce-ce7a9ac7b91f admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:51.052166 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690bbe32-46df-4804-a8ce-ce7a9ac7b91f admin admin] PATH_INFO: `/v3/projects/b40de929186747d09cfcd22436b81ade/users/ffff7facb21e47b88224a52b89c68391/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:51.065713 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-c8685551-0e23-4e9c-a8cc-f8a19db03491 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:51.067344 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-c8685551-0e23-4e9c-a8cc-f8a19db03491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:51.087699 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 886/1789] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:29:51.088961 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8685551-0e23-4e9c-a8cc-f8a19db03491 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:51.101410 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8685551-0e23-4e9c-a8cc-f8a19db03491 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:51.107218 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21764da-4dcc-42e8-88dc-73e5503acaa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:51.108109 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21764da-4dcc-42e8-88dc-73e5503acaa8 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:51.108563 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21764da-4dcc-42e8-88dc-73e5503acaa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:51.109033 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21764da-4dcc-42e8-88dc-73e5503acaa8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:51.110167 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21764da-4dcc-42e8-88dc-73e5503acaa8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:29:51.110716 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21764da-4dcc-42e8-88dc-73e5503acaa8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:51.111829 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690bbe32-46df-4804-a8ce-ce7a9ac7b91f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b40de929186747d09cfcd22436b81ade, user_id=ffff7facb21e47b88224a52b89c68391, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:51.113048 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21764da-4dcc-42e8-88dc-73e5503acaa8 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:51.121703 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690bbe32-46df-4804-a8ce-ce7a9ac7b91f admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:51.155931 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 904/1790] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:29:51 2022] PUT /identity/v3/projects/b40de929186747d09cfcd22436b81ade/users/ffff7facb21e47b88224a52b89c68391/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:29:51.167289 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c0780e-c2e9-4e9f-b4bd-ae9926c1d9d1 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:51.167841 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c0780e-c2e9-4e9f-b4bd-ae9926c1d9d1 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:51.168558 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c0780e-c2e9-4e9f-b4bd-ae9926c1d9d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:51.187368 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 887/1791] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 30 01:29:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:29:51.191677 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21764da-4dcc-42e8-88dc-73e5503acaa8 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:51.196934 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-f21764da-4dcc-42e8-88dc-73e5503acaa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:51.239914 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21764da-4dcc-42e8-88dc-73e5503acaa8 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:51.297464 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-76c0780e-c2e9-4e9f-b4bd-ae9926c1d9d1 None None] MFA Rules not processed for user `ffff7facb21e47b88224a52b89c68391`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:51.302940 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-76c0780e-c2e9-4e9f-b4bd-ae9926c1d9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:51.334293 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:51.431322 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac61449c-38a4-48a1-9ee7-800b28a5271c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:51.434467 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61449c-38a4-48a1-9ee7-800b28a5271c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:51.436187 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61449c-38a4-48a1-9ee7-800b28a5271c admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:51.437034 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61449c-38a4-48a1-9ee7-800b28a5271c admin admin] PATH_INFO: `/v3/projects/7e67958c37314026ab63c8b17666d0b0` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:51.446287 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac61449c-38a4-48a1-9ee7-800b28a5271c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e67958c37314026ab63c8b17666d0b0)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:51.450761 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac61449c-38a4-48a1-9ee7-800b28a5271c admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:51.548926 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 905/1792] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:51.550130 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c0780e-c2e9-4e9f-b4bd-ae9926c1d9d1 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:51.583944 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c0780e-c2e9-4e9f-b4bd-ae9926c1d9d1 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:51.630602 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-ac61449c-38a4-48a1-9ee7-800b28a5271c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e67958c37314026ab63c8b17666d0b0', 'request_id': 'req-ac61449c-38a4-48a1-9ee7-800b28a5271c'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:51.658257 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-ac61449c-38a4-48a1-9ee7-800b28a5271c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e67958c37314026ab63c8b17666d0b0', 'request_id': 'req-ac61449c-38a4-48a1-9ee7-800b28a5271c'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:51.692044 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-ac61449c-38a4-48a1-9ee7-800b28a5271c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e67958c37314026ab63c8b17666d0b0', 'request_id': 'req-ac61449c-38a4-48a1-9ee7-800b28a5271c'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:51.723380 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-ac61449c-38a4-48a1-9ee7-800b28a5271c admin admin] The token cache is being invalidate because project 7e67958c37314026ab63c8b17666d0b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81447) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:29:51.723880 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-ac61449c-38a4-48a1-9ee7-800b28a5271c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:51.730107 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-ac61449c-38a4-48a1-9ee7-800b28a5271c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:51.735380 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 888/1793] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:29:51 2022] DELETE /identity/v3/projects/7e67958c37314026ab63c8b17666d0b0 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:29:51.735380 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac61449c-38a4-48a1-9ee7-800b28a5271c admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:51.742490 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-ac61449c-38a4-48a1-9ee7-800b28a5271c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:51.820660 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:51.822383 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f068e95e-59b8-45f6-a749-273cfb6a001d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:51.823162 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068e95e-59b8-45f6-a749-273cfb6a001d admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:51.823618 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068e95e-59b8-45f6-a749-273cfb6a001d admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:51.823910 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068e95e-59b8-45f6-a749-273cfb6a001d admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:51.825748 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f068e95e-59b8-45f6-a749-273cfb6a001d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:51.827733 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f068e95e-59b8-45f6-a749-273cfb6a001d admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:51.916514 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 906/1794] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:29:51 2022] POST /identity/v3/projects => generated 377 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:29:51.918122 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f068e95e-59b8-45f6-a749-273cfb6a001d admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:51.920749 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-f068e95e-59b8-45f6-a749-273cfb6a001d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:52.030522 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac61449c-38a4-48a1-9ee7-800b28a5271c admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:52.075450 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f068e95e-59b8-45f6-a749-273cfb6a001d admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:52.088495 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d5f7b-b703-4fe2-89d0-452d287a54ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:52.089576 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d5f7b-b703-4fe2-89d0-452d287a54ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:52.091213 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d5f7b-b703-4fe2-89d0-452d287a54ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:52.091618 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d5f7b-b703-4fe2-89d0-452d287a54ed admin admin] PATH_INFO: `/v3/users/9811c02e03a94a16b9e0e9dd88e43514` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:52.094556 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d5f7b-b703-4fe2-89d0-452d287a54ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=9811c02e03a94a16b9e0e9dd88e43514)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:52.098067 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d5f7b-b703-4fe2-89d0-452d287a54ed admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:52.258800 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6166bb88-7eb0-432d-83e6-1bc43300e979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:52.260781 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166bb88-7eb0-432d-83e6-1bc43300e979 admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:52.261260 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166bb88-7eb0-432d-83e6-1bc43300e979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:52.261498 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166bb88-7eb0-432d-83e6-1bc43300e979 admin admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:52.262531 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6166bb88-7eb0-432d-83e6-1bc43300e979 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:52.265315 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6166bb88-7eb0-432d-83e6-1bc43300e979 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:52.275975 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:52.312315 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-2a6d5f7b-b703-4fe2-89d0-452d287a54ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9811c02e03a94a16b9e0e9dd88e43514'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:52.327826 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 889/1795] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:29:51 2022] POST /identity/v3/projects => generated 379 bytes in 594 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:29:52.329438 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6166bb88-7eb0-432d-83e6-1bc43300e979 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:52.332456 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-6166bb88-7eb0-432d-83e6-1bc43300e979 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:52.343968 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-2a6d5f7b-b703-4fe2-89d0-452d287a54ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9811c02e03a94a16b9e0e9dd88e43514'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:52.345973 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-2a6d5f7b-b703-4fe2-89d0-452d287a54ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9811c02e03a94a16b9e0e9dd88e43514'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:52.400641 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-2a6d5f7b-b703-4fe2-89d0-452d287a54ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9811c02e03a94a16b9e0e9dd88e43514'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:52.403118 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-2a6d5f7b-b703-4fe2-89d0-452d287a54ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9811c02e03a94a16b9e0e9dd88e43514'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:52.444170 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 907/1796] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:29:51 2022] DELETE /identity/v3/users/9811c02e03a94a16b9e0e9dd88e43514 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:29:52.448338 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df008374-3d9b-4b79-8de4-9d4591132564 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:52.450564 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df008374-3d9b-4b79-8de4-9d4591132564 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:52.451170 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df008374-3d9b-4b79-8de4-9d4591132564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:52.503191 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6166bb88-7eb0-432d-83e6-1bc43300e979 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:52.600633 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-df008374-3d9b-4b79-8de4-9d4591132564 None None] MFA Rules not processed for user `edc11f8a9c5843939ec230e63ca7fa3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:52.600633 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-df008374-3d9b-4b79-8de4-9d4591132564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:52.610888 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb597df-1af4-4826-b8ee-d9e12b570eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:52.611803 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb597df-1af4-4826-b8ee-d9e12b570eae admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:52.612175 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb597df-1af4-4826-b8ee-d9e12b570eae admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:52.612702 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb597df-1af4-4826-b8ee-d9e12b570eae admin admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:52.613708 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb597df-1af4-4826-b8ee-d9e12b570eae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:52.615863 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb597df-1af4-4826-b8ee-d9e12b570eae admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:52.627871 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:52.645887 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 890/1797] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:29:52 2022] POST /identity/v3/users => generated 289 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:29:52.650614 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb597df-1af4-4826-b8ee-d9e12b570eae admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:52.653438 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-6cb597df-1af4-4826-b8ee-d9e12b570eae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:52.670160 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb597df-1af4-4826-b8ee-d9e12b570eae admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:52.677202 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63beb09-c526-4186-b5a6-1f6ba3569df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:52.677973 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63beb09-c526-4186-b5a6-1f6ba3569df2 admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:52.678312 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63beb09-c526-4186-b5a6-1f6ba3569df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:52.678734 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63beb09-c526-4186-b5a6-1f6ba3569df2 admin admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:52.679710 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63beb09-c526-4186-b5a6-1f6ba3569df2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:52.682477 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63beb09-c526-4186-b5a6-1f6ba3569df2 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:52.722973 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 891/1798] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:29:52 2022] POST /identity/v3/users => generated 290 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:29:52.724199 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63beb09-c526-4186-b5a6-1f6ba3569df2 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:52.726366 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-b63beb09-c526-4186-b5a6-1f6ba3569df2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:52.742235 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63beb09-c526-4186-b5a6-1f6ba3569df2 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:52.743820 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 908/1799] 10.222.0.60 () {58 vars in 1009 bytes} [Tue Aug 30 01:29:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:52.747004 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df008374-3d9b-4b79-8de4-9d4591132564 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:52.753677 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e3643-caac-44b7-87fa-740faac2fa8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:52.754428 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e3643-caac-44b7-87fa-740faac2fa8c admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:52.754712 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e3643-caac-44b7-87fa-740faac2fa8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:52.754980 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e3643-caac-44b7-87fa-740faac2fa8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:52.755803 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477e3643-caac-44b7-87fa-740faac2fa8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:52.758576 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477e3643-caac-44b7-87fa-740faac2fa8c admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:52.777520 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df008374-3d9b-4b79-8de4-9d4591132564 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:52.788935 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a3f2d-f2ed-4332-ac7a-8eccac3bb3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:52.789798 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a3f2d-f2ed-4332-ac7a-8eccac3bb3c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:52.791125 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a3f2d-f2ed-4332-ac7a-8eccac3bb3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:52.791462 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a3f2d-f2ed-4332-ac7a-8eccac3bb3c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:52.792128 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7a3f2d-f2ed-4332-ac7a-8eccac3bb3c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:52.798522 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7a3f2d-f2ed-4332-ac7a-8eccac3bb3c8 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:52.808667 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 892/1800] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:29:52.816129 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e3643-caac-44b7-87fa-740faac2fa8c admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:52.828772 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 909/1801] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:29:52.835684 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a3f2d-f2ed-4332-ac7a-8eccac3bb3c8 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:52.838461 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e3643-caac-44b7-87fa-740faac2fa8c admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:52.845884 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97399047-ad1b-4135-b29e-c35764aba24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:52.847786 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97399047-ad1b-4135-b29e-c35764aba24c admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:52.849805 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97399047-ad1b-4135-b29e-c35764aba24c admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:52.849805 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97399047-ad1b-4135-b29e-c35764aba24c admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:52.849805 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97399047-ad1b-4135-b29e-c35764aba24c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:52.851733 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97399047-ad1b-4135-b29e-c35764aba24c admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:52.859817 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a3f2d-f2ed-4332-ac7a-8eccac3bb3c8 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:52.868610 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ae9f8-38ca-45cd-91f6-597cca6b8a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:52.869233 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ae9f8-38ca-45cd-91f6-597cca6b8a71 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:52.869517 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ae9f8-38ca-45cd-91f6-597cca6b8a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:52.869919 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ae9f8-38ca-45cd-91f6-597cca6b8a71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:52.870482 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6ae9f8-38ca-45cd-91f6-597cca6b8a71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:52.874899 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6ae9f8-38ca-45cd-91f6-597cca6b8a71 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:52.885904 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 893/1802] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:29:52.888552 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97399047-ad1b-4135-b29e-c35764aba24c admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:52.890250 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 910/1803] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:29:52.891515 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ae9f8-38ca-45cd-91f6-597cca6b8a71 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:52.904281 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97399047-ad1b-4135-b29e-c35764aba24c admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:52.912661 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949f179c-55c5-4680-85c3-e6c11f8d1915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:52.914560 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f179c-55c5-4680-85c3-e6c11f8d1915 admin admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:52.915655 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f179c-55c5-4680-85c3-e6c11f8d1915 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:52.916275 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f179c-55c5-4680-85c3-e6c11f8d1915 admin admin] PATH_INFO: `/v3/projects/08a5016b5c554ba6bcc87b86137a1846/users/ffd15f39b059428089f47a8fcaf39e69/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:52.925727 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ae9f8-38ca-45cd-91f6-597cca6b8a71 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:52.934636 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c394f3e3-70e3-47a7-a633-fb8654296171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:52.936303 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c394f3e3-70e3-47a7-a633-fb8654296171 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:52.936597 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c394f3e3-70e3-47a7-a633-fb8654296171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:52.937066 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c394f3e3-70e3-47a7-a633-fb8654296171 admin admin] PATH_INFO: `/v3/projects/98bf391ced87430c86f6aa3561766dd4/users/1e97354521704b0abb826773d9251293/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:52.959005 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c394f3e3-70e3-47a7-a633-fb8654296171 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98bf391ced87430c86f6aa3561766dd4, user_id=1e97354521704b0abb826773d9251293, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:52.959865 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949f179c-55c5-4680-85c3-e6c11f8d1915 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08a5016b5c554ba6bcc87b86137a1846, user_id=ffd15f39b059428089f47a8fcaf39e69, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:52.962607 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c394f3e3-70e3-47a7-a633-fb8654296171 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:52.966439 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949f179c-55c5-4680-85c3-e6c11f8d1915 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:52.995913 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 911/1804] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:29:52 2022] PUT /identity/v3/projects/98bf391ced87430c86f6aa3561766dd4/users/1e97354521704b0abb826773d9251293/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:29:53.008914 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da32a1-20ec-4f6c-91c4-80dcc9ad3ba4 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:53.009205 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da32a1-20ec-4f6c-91c4-80dcc9ad3ba4 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:53.009531 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da32a1-20ec-4f6c-91c4-80dcc9ad3ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:53.014186 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 894/1805] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:29:52 2022] PUT /identity/v3/projects/08a5016b5c554ba6bcc87b86137a1846/users/ffd15f39b059428089f47a8fcaf39e69/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:29:53.025212 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949f179c-55c5-4680-85c3-e6c11f8d1915 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:53.028043 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-949f179c-55c5-4680-85c3-e6c11f8d1915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:53.106230 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-03da32a1-20ec-4f6c-91c4-80dcc9ad3ba4 None None] MFA Rules not processed for user `1e97354521704b0abb826773d9251293`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:53.107534 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-03da32a1-20ec-4f6c-91c4-80dcc9ad3ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:53.185088 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:53.283821 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 912/1806] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:29:53.285468 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961d02f-3034-42e3-ad32-694684fb7465 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:53.287832 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961d02f-3034-42e3-ad32-694684fb7465 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:53.289538 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961d02f-3034-42e3-ad32-694684fb7465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:53.317133 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949f179c-55c5-4680-85c3-e6c11f8d1915 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:53.323892 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a9e151-5059-494e-8c0d-f74b700442a5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7de1f31ef84d529bf2c53ce0f7e38b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:53.324470 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a9e151-5059-494e-8c0d-f74b700442a5 service swift] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:53.324747 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a9e151-5059-494e-8c0d-f74b700442a5 service swift] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:53.326178 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a9e151-5059-494e-8c0d-f74b700442a5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:53.349576 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-3961d02f-3034-42e3-ad32-694684fb7465 None None] MFA Rules not processed for user `ffd15f39b059428089f47a8fcaf39e69`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:53.351578 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-3961d02f-3034-42e3-ad32-694684fb7465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:53.448501 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a9e151-5059-494e-8c0d-f74b700442a5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:53.455609 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a9e151-5059-494e-8c0d-f74b700442a5 service swift] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:53.489067 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 895/1807] 10.222.0.60 () {60 vars in 1384 bytes} [Tue Aug 30 01:29:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 01:29:53.491295 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a9e151-5059-494e-8c0d-f74b700442a5 service swift] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:53.504621 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:53.625547 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 913/1808] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:53.634114 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3961d02f-3034-42e3-ad32-694684fb7465 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:53.661215 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a9e151-5059-494e-8c0d-f74b700442a5 service swift] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:53.684603 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166885f9-45c3-4194-8325-08f1d579a5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:53.685519 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166885f9-45c3-4194-8325-08f1d579a5b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:53.686037 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166885f9-45c3-4194-8325-08f1d579a5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:53.686408 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166885f9-45c3-4194-8325-08f1d579a5b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:53.687388 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166885f9-45c3-4194-8325-08f1d579a5b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:53.690609 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166885f9-45c3-4194-8325-08f1d579a5b4 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:53.702436 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3961d02f-3034-42e3-ad32-694684fb7465 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:53.742964 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb5baaf-3550-4440-ad90-31641b2aa4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:53.745291 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5baaf-3550-4440-ad90-31641b2aa4fc admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:53.751161 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 896/1809] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:29:53 2022] POST /identity/v3/projects => generated 377 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:29:53.762236 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5baaf-3550-4440-ad90-31641b2aa4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:53.762581 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5baaf-3550-4440-ad90-31641b2aa4fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:53.763253 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb5baaf-3550-4440-ad90-31641b2aa4fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:53.765972 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166885f9-45c3-4194-8325-08f1d579a5b4 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:53.778926 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb5baaf-3550-4440-ad90-31641b2aa4fc admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:53.979882 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 914/1810] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:29:53 2022] POST /identity/v3/projects => generated 373 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:29:53.984464 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb5baaf-3550-4440-ad90-31641b2aa4fc admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:54.118874 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166885f9-45c3-4194-8325-08f1d579a5b4 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:54.443459 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb5baaf-3550-4440-ad90-31641b2aa4fc admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:54.456793 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc9f40e-ac2e-4189-99fa-0a60618008da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:54.457586 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9f40e-ac2e-4189-99fa-0a60618008da admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:54.457950 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9f40e-ac2e-4189-99fa-0a60618008da admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:54.458830 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9f40e-ac2e-4189-99fa-0a60618008da admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:54.462156 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc9f40e-ac2e-4189-99fa-0a60618008da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:54.465912 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc9f40e-ac2e-4189-99fa-0a60618008da admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:54.520152 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 915/1811] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:29:53 2022] POST /identity/v3/users => generated 293 bytes in 536 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:29:54.521217 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc9f40e-ac2e-4189-99fa-0a60618008da admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:54.529050 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-1bc9f40e-ac2e-4189-99fa-0a60618008da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:54.534242 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c520f-8c42-4a0e-8f20-a6e2c3a298b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:54.536013 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c520f-8c42-4a0e-8f20-a6e2c3a298b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:54.539820 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c520f-8c42-4a0e-8f20-a6e2c3a298b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:54.547923 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c520f-8c42-4a0e-8f20-a6e2c3a298b1 admin admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:54.548863 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7c520f-8c42-4a0e-8f20-a6e2c3a298b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:54.553908 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7c520f-8c42-4a0e-8f20-a6e2c3a298b1 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:54.608492 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc9f40e-ac2e-4189-99fa-0a60618008da admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:54.619364 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c93c1-316a-452e-9950-eb85df2a9b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:54.620027 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c93c1-316a-452e-9950-eb85df2a9b16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:54.620359 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c93c1-316a-452e-9950-eb85df2a9b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:54.620653 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c93c1-316a-452e-9950-eb85df2a9b16 admin admin] PATH_INFO: `/v3/projects/2867edc6a3ec45658c0bb9a2b6ad9a9d` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:54.627687 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 897/1812] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:29:53 2022] POST /identity/v3/users => generated 295 bytes in 873 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:29:54.627687 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c520f-8c42-4a0e-8f20-a6e2c3a298b1 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:54.627951 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410c93c1-316a-452e-9950-eb85df2a9b16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2867edc6a3ec45658c0bb9a2b6ad9a9d)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:54.630450 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410c93c1-316a-452e-9950-eb85df2a9b16 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:54.657611 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c520f-8c42-4a0e-8f20-a6e2c3a298b1 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:54.678719 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c8cb4-057e-41f4-85cc-1b5ed4c65ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:54.681144 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c8cb4-057e-41f4-85cc-1b5ed4c65ed2 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:54.681438 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c8cb4-057e-41f4-85cc-1b5ed4c65ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:54.685482 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c8cb4-057e-41f4-85cc-1b5ed4c65ed2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:54.687686 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0c8cb4-057e-41f4-85cc-1b5ed4c65ed2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:54.693458 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:54.693956 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0c8cb4-057e-41f4-85cc-1b5ed4c65ed2 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:54.723935 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 898/1813] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:29:54.724811 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c8cb4-057e-41f4-85cc-1b5ed4c65ed2 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:54.769211 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c8cb4-057e-41f4-85cc-1b5ed4c65ed2 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:54.771032 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-410c93c1-316a-452e-9950-eb85df2a9b16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2867edc6a3ec45658c0bb9a2b6ad9a9d', 'request_id': 'req-410c93c1-316a-452e-9950-eb85df2a9b16'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:54.798899 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-410c93c1-316a-452e-9950-eb85df2a9b16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2867edc6a3ec45658c0bb9a2b6ad9a9d', 'request_id': 'req-410c93c1-316a-452e-9950-eb85df2a9b16'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:54.820945 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-410c93c1-316a-452e-9950-eb85df2a9b16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2867edc6a3ec45658c0bb9a2b6ad9a9d', 'request_id': 'req-410c93c1-316a-452e-9950-eb85df2a9b16'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:54.822742 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:54.848629 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-410c93c1-316a-452e-9950-eb85df2a9b16 admin admin] The token cache is being invalidate because project 2867edc6a3ec45658c0bb9a2b6ad9a9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:29:54.850116 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-410c93c1-316a-452e-9950-eb85df2a9b16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:54.851112 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-410c93c1-316a-452e-9950-eb85df2a9b16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:54.854190 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 916/1814] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:29:54 2022] DELETE /identity/v3/projects/2867edc6a3ec45658c0bb9a2b6ad9a9d => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:29:54.855184 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c93c1-316a-452e-9950-eb85df2a9b16 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:54.859328 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-410c93c1-316a-452e-9950-eb85df2a9b16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:54.977233 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b948f948-27a7-4812-9515-afbf4c0b3f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:54.978023 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948f948-27a7-4812-9515-afbf4c0b3f8d admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:54.979254 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948f948-27a7-4812-9515-afbf4c0b3f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:54.980097 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948f948-27a7-4812-9515-afbf4c0b3f8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:54.982474 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b948f948-27a7-4812-9515-afbf4c0b3f8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:54.986046 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b948f948-27a7-4812-9515-afbf4c0b3f8d admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:55.035705 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 899/1815] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:29:55.039380 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d44aa8-0c20-4bbf-b1dc-bd0e02d521bb None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:55.041315 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d44aa8-0c20-4bbf-b1dc-bd0e02d521bb None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:55.041685 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d44aa8-0c20-4bbf-b1dc-bd0e02d521bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:55.066710 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c93c1-316a-452e-9950-eb85df2a9b16 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:55.087757 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b74c7-632b-44a4-a400-24fb2d11259c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:55.090401 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b74c7-632b-44a4-a400-24fb2d11259c admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:55.090494 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b74c7-632b-44a4-a400-24fb2d11259c admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:55.095313 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b74c7-632b-44a4-a400-24fb2d11259c admin admin] PATH_INFO: `/v3/projects/aa324516fed54823973b46443cec5af1/users/2e9b35a80ad84e918ee2dd6f31c84e74/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:55.149030 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-a0d44aa8-0c20-4bbf-b1dc-bd0e02d521bb None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:55.150227 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-a0d44aa8-0c20-4bbf-b1dc-bd0e02d521bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:55.196919 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b74c7-632b-44a4-a400-24fb2d11259c admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa324516fed54823973b46443cec5af1, user_id=2e9b35a80ad84e918ee2dd6f31c84e74, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:55.201390 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 900/1816] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:55.202244 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d44aa8-0c20-4bbf-b1dc-bd0e02d521bb None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:55.206751 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b74c7-632b-44a4-a400-24fb2d11259c admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:55.225359 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-a0d44aa8-0c20-4bbf-b1dc-bd0e02d521bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:55.239933 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 917/1817] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:29:54 2022] PUT /identity/v3/projects/aa324516fed54823973b46443cec5af1/users/2e9b35a80ad84e918ee2dd6f31c84e74/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:29:55.245311 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd80b60-c6f7-456c-844e-9914e1142d68 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:55.246969 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd80b60-c6f7-456c-844e-9914e1142d68 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:55.247686 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd80b60-c6f7-456c-844e-9914e1142d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:55.282208 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d44aa8-0c20-4bbf-b1dc-bd0e02d521bb None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:55.327942 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-5bd80b60-c6f7-456c-844e-9914e1142d68 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:55.329850 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-5bd80b60-c6f7-456c-844e-9914e1142d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:55.424903 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 918/1818] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:55.424903 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd80b60-c6f7-456c-844e-9914e1142d68 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:55.443280 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd80b60-c6f7-456c-844e-9914e1142d68 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:55.456733 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c0f9cc-14f2-49ad-ab6f-26a01d35f639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:55.458313 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0f9cc-14f2-49ad-ab6f-26a01d35f639 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:55.461092 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0f9cc-14f2-49ad-ab6f-26a01d35f639 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:55.464256 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0f9cc-14f2-49ad-ab6f-26a01d35f639 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:55.465686 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c0f9cc-14f2-49ad-ab6f-26a01d35f639 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:55.469779 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c0f9cc-14f2-49ad-ab6f-26a01d35f639 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:55.504738 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 919/1819] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:29:55.504738 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c0f9cc-14f2-49ad-ab6f-26a01d35f639 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:55.533336 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c0f9cc-14f2-49ad-ab6f-26a01d35f639 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:55.539185 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33438bfb-71b4-496a-8aaa-2364132fded4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:55.540215 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33438bfb-71b4-496a-8aaa-2364132fded4 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:55.540502 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33438bfb-71b4-496a-8aaa-2364132fded4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:55.540782 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33438bfb-71b4-496a-8aaa-2364132fded4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:55.541445 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33438bfb-71b4-496a-8aaa-2364132fded4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:29:55.542335 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33438bfb-71b4-496a-8aaa-2364132fded4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:55.548669 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33438bfb-71b4-496a-8aaa-2364132fded4 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:55.576334 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007c5a4-6430-40db-a8f7-b589b219a133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:55.577040 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007c5a4-6430-40db-a8f7-b589b219a133 admin admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:55.577316 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007c5a4-6430-40db-a8f7-b589b219a133 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:55.577588 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007c5a4-6430-40db-a8f7-b589b219a133 admin admin] PATH_INFO: `/v3/projects/010309df038c4ddcae347f81967ee994/users/30e7061ace2f42ffacf3e057beb2ae72/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:55.585856 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 920/1820] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 30 01:29:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:29:55.592379 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33438bfb-71b4-496a-8aaa-2364132fded4 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:55.607456 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2007c5a4-6430-40db-a8f7-b589b219a133 admin admin] RBAC: Authorizing `identity:create_grant(project_id=010309df038c4ddcae347f81967ee994, user_id=30e7061ace2f42ffacf3e057beb2ae72, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:55.610285 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2007c5a4-6430-40db-a8f7-b589b219a133 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:55.610429 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33438bfb-71b4-496a-8aaa-2364132fded4 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:55.621035 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6243e36d-c34d-4f39-883b-5a9c6ba28cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:55.623554 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6243e36d-c34d-4f39-883b-5a9c6ba28cd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:55.623865 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6243e36d-c34d-4f39-883b-5a9c6ba28cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:55.624421 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6243e36d-c34d-4f39-883b-5a9c6ba28cd7 admin admin] PATH_INFO: `/v3/projects/aa324516fed54823973b46443cec5af1/users/2e9b35a80ad84e918ee2dd6f31c84e74/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:55.629479 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6243e36d-c34d-4f39-883b-5a9c6ba28cd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa324516fed54823973b46443cec5af1, user_id=2e9b35a80ad84e918ee2dd6f31c84e74, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:55.637325 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6243e36d-c34d-4f39-883b-5a9c6ba28cd7 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:55.643133 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 901/1821] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:29:55 2022] PUT /identity/v3/projects/010309df038c4ddcae347f81967ee994/users/30e7061ace2f42ffacf3e057beb2ae72/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:29:55.644137 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007c5a4-6430-40db-a8f7-b589b219a133 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:55.649339 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:55.684067 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 921/1822] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:29:55 2022] PUT /identity/v3/projects/aa324516fed54823973b46443cec5af1/users/2e9b35a80ad84e918ee2dd6f31c84e74/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:29:55.688173 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6243e36d-c34d-4f39-883b-5a9c6ba28cd7 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:55.804649 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007c5a4-6430-40db-a8f7-b589b219a133 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:55.834927 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6243e36d-c34d-4f39-883b-5a9c6ba28cd7 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:55.842193 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad609e6-0e9a-4de1-8852-7803b5224b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:55.843248 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad609e6-0e9a-4de1-8852-7803b5224b1d admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:55.843744 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad609e6-0e9a-4de1-8852-7803b5224b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:55.844213 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad609e6-0e9a-4de1-8852-7803b5224b1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:55.845389 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad609e6-0e9a-4de1-8852-7803b5224b1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:55.848658 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad609e6-0e9a-4de1-8852-7803b5224b1d admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:55.884435 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 922/1823] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:29:55.886359 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d42715-9241-4039-bf20-28ce3fd4db5e None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:55.887117 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d42715-9241-4039-bf20-28ce3fd4db5e None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:55.887500 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d42715-9241-4039-bf20-28ce3fd4db5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:55.917557 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:55.965462 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-79d42715-9241-4039-bf20-28ce3fd4db5e None None] MFA Rules not processed for user `2e9b35a80ad84e918ee2dd6f31c84e74`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:55.967887 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-79d42715-9241-4039-bf20-28ce3fd4db5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:55.989963 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a10c1cd-60e9-4d56-b0e0-70bcabe5688c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:55.992073 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10c1cd-60e9-4d56-b0e0-70bcabe5688c admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:55.995761 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10c1cd-60e9-4d56-b0e0-70bcabe5688c admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:55.997766 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10c1cd-60e9-4d56-b0e0-70bcabe5688c admin admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:55.998591 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a10c1cd-60e9-4d56-b0e0-70bcabe5688c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:56.009202 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a10c1cd-60e9-4d56-b0e0-70bcabe5688c admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:56.093872 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 902/1824] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:29:55 2022] POST /identity/v3/projects => generated 399 bytes in 449 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:29:56.094176 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a10c1cd-60e9-4d56-b0e0-70bcabe5688c admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:56.214134 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 923/1825] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:55 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:56.216757 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d42715-9241-4039-bf20-28ce3fd4db5e None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:56.259146 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d42715-9241-4039-bf20-28ce3fd4db5e None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:56.351126 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a10c1cd-60e9-4d56-b0e0-70bcabe5688c admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:56.367906 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f9501-ebd2-4c35-b4d3-b1c1829e450b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:56.369183 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f9501-ebd2-4c35-b4d3-b1c1829e450b admin admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:56.369459 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f9501-ebd2-4c35-b4d3-b1c1829e450b admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:56.369740 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f9501-ebd2-4c35-b4d3-b1c1829e450b admin admin] PATH_INFO: `/v3/projects/010309df038c4ddcae347f81967ee994/users/30e7061ace2f42ffacf3e057beb2ae72/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:56.372782 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0f9501-ebd2-4c35-b4d3-b1c1829e450b admin admin] RBAC: Authorizing `identity:create_grant(project_id=010309df038c4ddcae347f81967ee994, user_id=30e7061ace2f42ffacf3e057beb2ae72, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:56.377031 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0f9501-ebd2-4c35-b4d3-b1c1829e450b admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:56.422854 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 903/1826] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:29:56 2022] PUT /identity/v3/projects/010309df038c4ddcae347f81967ee994/users/30e7061ace2f42ffacf3e057beb2ae72/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:29:56.423917 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f9501-ebd2-4c35-b4d3-b1c1829e450b admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:56.433096 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-0f0f9501-ebd2-4c35-b4d3-b1c1829e450b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:56.535234 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8c1fac-d384-4ee1-9688-86826bb0b3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:56.553527 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c1fac-d384-4ee1-9688-86826bb0b3bf admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:56.554364 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c1fac-d384-4ee1-9688-86826bb0b3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:56.554649 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c1fac-d384-4ee1-9688-86826bb0b3bf admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:56.555323 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8c1fac-d384-4ee1-9688-86826bb0b3bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:56.563788 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8c1fac-d384-4ee1-9688-86826bb0b3bf admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:56.615516 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 924/1827] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:29:56 2022] POST /identity/v3/users => generated 300 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:29:56.617405 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f9eed-bbd2-464f-86a6-810392835295 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:56.617692 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f9eed-bbd2-464f-86a6-810392835295 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:56.617970 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f9eed-bbd2-464f-86a6-810392835295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:56.641853 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f9501-ebd2-4c35-b4d3-b1c1829e450b admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:56.653324 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:56.664753 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1387c5d3-b452-44ea-a96c-b396647f72f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:56.667751 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1387c5d3-b452-44ea-a96c-b396647f72f0 service cinder] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:56.668703 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1387c5d3-b452-44ea-a96c-b396647f72f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:56.675502 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1387c5d3-b452-44ea-a96c-b396647f72f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:56.684542 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-1387c5d3-b452-44ea-a96c-b396647f72f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:56.707804 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-fe3f9eed-bbd2-464f-86a6-810392835295 None None] MFA Rules not processed for user `30e7061ace2f42ffacf3e057beb2ae72`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:56.709063 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-fe3f9eed-bbd2-464f-86a6-810392835295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:56.874070 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1387c5d3-b452-44ea-a96c-b396647f72f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:56.876477 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1387c5d3-b452-44ea-a96c-b396647f72f0 service cinder] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:56.920322 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 904/1828] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:29:56 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:29:56.921432 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1387c5d3-b452-44ea-a96c-b396647f72f0 service cinder] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:56.931736 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 925/1829] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:56 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:56.943127 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:57.025617 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1387c5d3-b452-44ea-a96c-b396647f72f0 service cinder] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:57.048063 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc19afc-58d7-49e8-a2dc-abe5a4cde525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:57.049466 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc19afc-58d7-49e8-a2dc-abe5a4cde525 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:57.052137 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc19afc-58d7-49e8-a2dc-abe5a4cde525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:57.052137 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc19afc-58d7-49e8-a2dc-abe5a4cde525 admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:57.052137 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc19afc-58d7-49e8-a2dc-abe5a4cde525 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:57.054958 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc19afc-58d7-49e8-a2dc-abe5a4cde525 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:57.078353 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f9eed-bbd2-464f-86a6-810392835295 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:57.080222 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-fe3f9eed-bbd2-464f-86a6-810392835295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:57.107198 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 905/1830] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:29:57.107392 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f9eed-bbd2-464f-86a6-810392835295 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:57.108213 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc19afc-58d7-49e8-a2dc-abe5a4cde525 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:57.121919 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af67c51b-05ec-48db-8541-65a38b685abb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:57.122479 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67c51b-05ec-48db-8541-65a38b685abb service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:57.122769 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67c51b-05ec-48db-8541-65a38b685abb service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:57.123046 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67c51b-05ec-48db-8541-65a38b685abb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:57.130993 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc19afc-58d7-49e8-a2dc-abe5a4cde525 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:57.137536 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af67c51b-05ec-48db-8541-65a38b685abb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:57.139310 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af67c51b-05ec-48db-8541-65a38b685abb service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:57.139653 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d7ff82-55c7-49d6-a725-d67242036a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:57.140806 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d7ff82-55c7-49d6-a725-d67242036a08 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:57.141216 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d7ff82-55c7-49d6-a725-d67242036a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:57.141586 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d7ff82-55c7-49d6-a725-d67242036a08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:57.142455 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d7ff82-55c7-49d6-a725-d67242036a08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:57.145435 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d7ff82-55c7-49d6-a725-d67242036a08 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:57.164800 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 926/1831] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:29:57 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:29:57.165858 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 906/1832] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:29:57 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:29:57.167349 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d7ff82-55c7-49d6-a725-d67242036a08 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:57.193167 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d7ff82-55c7-49d6-a725-d67242036a08 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:57.214132 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40e8ff9-8a59-4605-acd2-cd7cd21ea029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:57.218260 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e8ff9-8a59-4605-acd2-cd7cd21ea029 admin admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:57.219861 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e8ff9-8a59-4605-acd2-cd7cd21ea029 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:57.220220 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e8ff9-8a59-4605-acd2-cd7cd21ea029 admin admin] PATH_INFO: `/v3/projects/8b8127201864412b8d9a1b05125c61f1/users/d48cbf5fb7134845bfb7353df63d73a0/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:57.276345 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40e8ff9-8a59-4605-acd2-cd7cd21ea029 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b8127201864412b8d9a1b05125c61f1, user_id=d48cbf5fb7134845bfb7353df63d73a0, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:57.280870 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40e8ff9-8a59-4605-acd2-cd7cd21ea029 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:57.332984 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 907/1833] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:29:57 2022] PUT /identity/v3/projects/8b8127201864412b8d9a1b05125c61f1/users/d48cbf5fb7134845bfb7353df63d73a0/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:29:57.333224 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa106c8b-4518-4cda-aada-27f2f488da5a None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:57.333224 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa106c8b-4518-4cda-aada-27f2f488da5a None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:57.333224 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa106c8b-4518-4cda-aada-27f2f488da5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:57.341995 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9a22f-88f3-4f52-972b-219171f381c1 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:57.342352 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9a22f-88f3-4f52-972b-219171f381c1 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:57.342575 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9a22f-88f3-4f52-972b-219171f381c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:57.398181 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-07b9a22f-88f3-4f52-972b-219171f381c1 None None] MFA Rules not processed for user `61e48e00a0c34949a4fffae8c372304e`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:57.404932 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-07b9a22f-88f3-4f52-972b-219171f381c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:57.508701 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-aa106c8b-4518-4cda-aada-27f2f488da5a None None] MFA Rules not processed for user `d48cbf5fb7134845bfb7353df63d73a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:57.510562 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-aa106c8b-4518-4cda-aada-27f2f488da5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:57.705421 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 908/1834] 10.222.0.49 () {58 vars in 1015 bytes} [Tue Aug 30 01:29:57 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:57.712170 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b9a22f-88f3-4f52-972b-219171f381c1 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:57.870573 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 927/1835] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:57 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 545 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:29:57.872225 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa106c8b-4518-4cda-aada-27f2f488da5a None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:57.881523 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-aa106c8b-4518-4cda-aada-27f2f488da5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:57.911381 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa106c8b-4518-4cda-aada-27f2f488da5a None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:57.917853 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94641ec2-7d44-4570-ac42-44ff51639996 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:57.918825 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94641ec2-7d44-4570-ac42-44ff51639996 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:57.919317 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94641ec2-7d44-4570-ac42-44ff51639996 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:57.919865 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94641ec2-7d44-4570-ac42-44ff51639996 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:57.929187 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94641ec2-7d44-4570-ac42-44ff51639996 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:57.931165 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94641ec2-7d44-4570-ac42-44ff51639996 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:57.952806 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 928/1836] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:29:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:29:57.954127 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94641ec2-7d44-4570-ac42-44ff51639996 service neutron] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:57.984534 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b9a22f-88f3-4f52-972b-219171f381c1 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:58.000703 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e65491c-15ac-46cf-94ec-06de042e5dbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:58.001390 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65491c-15ac-46cf-94ec-06de042e5dbd service cinder] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:58.001750 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65491c-15ac-46cf-94ec-06de042e5dbd service cinder] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:58.002025 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65491c-15ac-46cf-94ec-06de042e5dbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:58.005406 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-1e65491c-15ac-46cf-94ec-06de042e5dbd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:58.131925 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:58.200249 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:58.212484 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e65491c-15ac-46cf-94ec-06de042e5dbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:58.217800 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e65491c-15ac-46cf-94ec-06de042e5dbd service cinder] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:58.225670 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94641ec2-7d44-4570-ac42-44ff51639996 service neutron] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:58.240033 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ea15d-0381-4d07-aac1-ff7077a5c0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:58.241996 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ea15d-0381-4d07-aac1-ff7077a5c0bd admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:58.241996 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ea15d-0381-4d07-aac1-ff7077a5c0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:58.241996 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ea15d-0381-4d07-aac1-ff7077a5c0bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:58.242284 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875ea15d-0381-4d07-aac1-ff7077a5c0bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:58.244383 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875ea15d-0381-4d07-aac1-ff7077a5c0bd admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:58.259972 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 909/1837] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:29:57 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:29:58.395935 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 929/1838] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:29:57 2022] POST /identity/v3/projects => generated 401 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:29:58.401597 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e65491c-15ac-46cf-94ec-06de042e5dbd service cinder] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:58.424906 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e65491c-15ac-46cf-94ec-06de042e5dbd service cinder] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:58.650031 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d37d4-b077-4975-94c5-c7d79878aac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:58.651829 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d37d4-b077-4975-94c5-c7d79878aac3 admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:58.652099 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d37d4-b077-4975-94c5-c7d79878aac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:58.652376 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d37d4-b077-4975-94c5-c7d79878aac3 admin admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:58.658004 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2d37d4-b077-4975-94c5-c7d79878aac3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:58.664132 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2d37d4-b077-4975-94c5-c7d79878aac3 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:58.753042 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 910/1839] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:29:58 2022] POST /identity/v3/users => generated 307 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:29:58.756436 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ea15d-0381-4d07-aac1-ff7077a5c0bd admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:58.785379 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ea15d-0381-4d07-aac1-ff7077a5c0bd admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:58.805199 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5b524-28fa-42b4-8efc-a3b6c9555f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:58.806356 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5b524-28fa-42b4-8efc-a3b6c9555f01 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:58.806356 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5b524-28fa-42b4-8efc-a3b6c9555f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:58.806584 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5b524-28fa-42b4-8efc-a3b6c9555f01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:58.813181 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a5b524-28fa-42b4-8efc-a3b6c9555f01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:58.819596 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a5b524-28fa-42b4-8efc-a3b6c9555f01 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:58.865584 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 930/1840] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:29:58 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:29:58.869943 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d37d4-b077-4975-94c5-c7d79878aac3 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:58.886004 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d37d4-b077-4975-94c5-c7d79878aac3 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:58.906724 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be8bc6-d55a-4515-bda8-9c5c5366467c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:58.912022 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be8bc6-d55a-4515-bda8-9c5c5366467c admin admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:58.913573 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be8bc6-d55a-4515-bda8-9c5c5366467c admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:58.914009 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be8bc6-d55a-4515-bda8-9c5c5366467c admin admin] PATH_INFO: `/v3/projects/3a0440022f8b45a7bbb6e84d3ad45899/users/54bc5ac7211b42dda62db35e4ce3fc33/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:58.975702 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be8bc6-d55a-4515-bda8-9c5c5366467c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a0440022f8b45a7bbb6e84d3ad45899, user_id=54bc5ac7211b42dda62db35e4ce3fc33, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:58.988463 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be8bc6-d55a-4515-bda8-9c5c5366467c admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:59.028209 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 911/1841] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:29:58 2022] PUT /identity/v3/projects/3a0440022f8b45a7bbb6e84d3ad45899/users/54bc5ac7211b42dda62db35e4ce3fc33/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:29:59.034742 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5b524-28fa-42b4-8efc-a3b6c9555f01 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:59.071501 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5b524-28fa-42b4-8efc-a3b6c9555f01 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:59.284267 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd9f1b-1cf0-4000-981d-104d2359ba70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:59.285009 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd9f1b-1cf0-4000-981d-104d2359ba70 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:59.285213 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd9f1b-1cf0-4000-981d-104d2359ba70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:59.285492 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd9f1b-1cf0-4000-981d-104d2359ba70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:59.287524 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cd9f1b-1cf0-4000-981d-104d2359ba70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:59.289158 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cd9f1b-1cf0-4000-981d-104d2359ba70 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:59.322848 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 931/1842] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:29:59.327961 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be8bc6-d55a-4515-bda8-9c5c5366467c admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:59.340300 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be8bc6-d55a-4515-bda8-9c5c5366467c admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:59.359849 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd73a9-de96-413a-8b16-ff49480176d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:59.359849 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd73a9-de96-413a-8b16-ff49480176d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:59.359849 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd73a9-de96-413a-8b16-ff49480176d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:59.359849 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd73a9-de96-413a-8b16-ff49480176d2 admin admin] PATH_INFO: `/v3/projects/3a0440022f8b45a7bbb6e84d3ad45899/users/54bc5ac7211b42dda62db35e4ce3fc33/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:59.362788 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dd73a9-de96-413a-8b16-ff49480176d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a0440022f8b45a7bbb6e84d3ad45899, user_id=54bc5ac7211b42dda62db35e4ce3fc33, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:59.377082 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dd73a9-de96-413a-8b16-ff49480176d2 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:59.411740 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 912/1843] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:29:59 2022] PUT /identity/v3/projects/3a0440022f8b45a7bbb6e84d3ad45899/users/54bc5ac7211b42dda62db35e4ce3fc33/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:29:59.430015 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08cae3f-b619-4f45-9f34-1883191bf8c9 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:59.434134 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08cae3f-b619-4f45-9f34-1883191bf8c9 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:59.434923 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08cae3f-b619-4f45-9f34-1883191bf8c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:59.560031 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-b08cae3f-b619-4f45-9f34-1883191bf8c9 None None] MFA Rules not processed for user `54bc5ac7211b42dda62db35e4ce3fc33`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:29:59.562971 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-b08cae3f-b619-4f45-9f34-1883191bf8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:59.635248 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd73a9-de96-413a-8b16-ff49480176d2 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:59.637233 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-64dd73a9-de96-413a-8b16-ff49480176d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:29:59.792594 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 932/1844] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:29:59 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:29:59.811661 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd73a9-de96-413a-8b16-ff49480176d2 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:29:59.813498 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08cae3f-b619-4f45-9f34-1883191bf8c9 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:29:59.825939 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f73d1c-cfc2-4a3b-9a0c-755467cd8048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:29:59.827055 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f73d1c-cfc2-4a3b-9a0c-755467cd8048 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:29:59.827412 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f73d1c-cfc2-4a3b-9a0c-755467cd8048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:29:59.828071 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f73d1c-cfc2-4a3b-9a0c-755467cd8048 admin admin] PATH_INFO: `/v3/users/443c30347f6341d6acb3399680c148be` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:29:59.829932 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f73d1c-cfc2-4a3b-9a0c-755467cd8048 admin admin] RBAC: Authorizing `identity:delete_user(user_id=443c30347f6341d6acb3399680c148be)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:29:59.836980 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f73d1c-cfc2-4a3b-9a0c-755467cd8048 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:29:59.916306 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:29:59.945693 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-d3f73d1c-cfc2-4a3b-9a0c-755467cd8048 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '443c30347f6341d6acb3399680c148be'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:59.971008 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-d3f73d1c-cfc2-4a3b-9a0c-755467cd8048 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '443c30347f6341d6acb3399680c148be'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:59.971670 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-d3f73d1c-cfc2-4a3b-9a0c-755467cd8048 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '443c30347f6341d6acb3399680c148be'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:29:59.973805 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-d3f73d1c-cfc2-4a3b-9a0c-755467cd8048 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '443c30347f6341d6acb3399680c148be'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:00.006128 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08cae3f-b619-4f45-9f34-1883191bf8c9 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:00.015315 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-d3f73d1c-cfc2-4a3b-9a0c-755467cd8048 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '443c30347f6341d6acb3399680c148be'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:00.018550 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789575ee-7f61-4d2b-b6e9-bc1778b539d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:00.021606 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789575ee-7f61-4d2b-b6e9-bc1778b539d2 service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:00.021975 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789575ee-7f61-4d2b-b6e9-bc1778b539d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:00.022254 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789575ee-7f61-4d2b-b6e9-bc1778b539d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:00.029454 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-789575ee-7f61-4d2b-b6e9-bc1778b539d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:00.050938 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:00.054669 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 913/1845] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:29:59 2022] DELETE /identity/v3/users/443c30347f6341d6acb3399680c148be => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:30:00.064660 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad50d8a-bdbe-4afd-840a-8f1e2cb28ade None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:00.066437 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad50d8a-bdbe-4afd-840a-8f1e2cb28ade None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:00.066748 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad50d8a-bdbe-4afd-840a-8f1e2cb28ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:00.073410 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789575ee-7f61-4d2b-b6e9-bc1778b539d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:00.077155 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789575ee-7f61-4d2b-b6e9-bc1778b539d2 service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:00.128336 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 933/1846] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:29:59 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:30:00.134087 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-bad50d8a-bdbe-4afd-840a-8f1e2cb28ade None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:00.136121 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-bad50d8a-bdbe-4afd-840a-8f1e2cb28ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:00.254399 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 914/1847] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:00.266267 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789575ee-7f61-4d2b-b6e9-bc1778b539d2 service cinder] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:00.268167 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-789575ee-7f61-4d2b-b6e9-bc1778b539d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:00.298183 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad50d8a-bdbe-4afd-840a-8f1e2cb28ade None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:00.300205 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-bad50d8a-bdbe-4afd-840a-8f1e2cb28ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:00.588169 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789575ee-7f61-4d2b-b6e9-bc1778b539d2 service cinder] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:00.628256 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad50d8a-bdbe-4afd-840a-8f1e2cb28ade None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:00.641532 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39615a4e-67f9-4897-bc19-aa8f5a9f7109 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:00.642709 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39615a4e-67f9-4897-bc19-aa8f5a9f7109 service cinder] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:00.643162 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39615a4e-67f9-4897-bc19-aa8f5a9f7109 service cinder] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:00.643477 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39615a4e-67f9-4897-bc19-aa8f5a9f7109 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:00.648535 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-39615a4e-67f9-4897-bc19-aa8f5a9f7109 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:00.760758 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5a2a5-c9cf-4844-aa42-f3fb3076d6e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:00.762667 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5a2a5-c9cf-4844-aa42-f3fb3076d6e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:00.763053 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5a2a5-c9cf-4844-aa42-f3fb3076d6e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:00.768531 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5a2a5-c9cf-4844-aa42-f3fb3076d6e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:00.807739 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d5a2a5-c9cf-4844-aa42-f3fb3076d6e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:00.813103 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d5a2a5-c9cf-4844-aa42-f3fb3076d6e3 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:00.840638 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 934/1848] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:30:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:30:00.850382 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39615a4e-67f9-4897-bc19-aa8f5a9f7109 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:00.856828 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39615a4e-67f9-4897-bc19-aa8f5a9f7109 service cinder] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:00.897134 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 915/1849] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:30:00 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:30:01.274811 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc41d3-ed47-467d-a7b3-29d2dfce2328 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:01.277009 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc41d3-ed47-467d-a7b3-29d2dfce2328 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:01.288049 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc41d3-ed47-467d-a7b3-29d2dfce2328 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:01.288049 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 935/1850] 10.222.0.60 () {54 vars in 921 bytes} [Tue Aug 30 01:30:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:30:01.296358 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf10ee5-f011-4208-b25c-84c9a11c2ddb None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:01.296576 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf10ee5-f011-4208-b25c-84c9a11c2ddb None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:01.299602 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf10ee5-f011-4208-b25c-84c9a11c2ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:01.354581 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:01.384011 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-5cf10ee5-f011-4208-b25c-84c9a11c2ddb None None] MFA Rules not processed for user `8889145228a24fb6bd539a11925e62f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:01.385244 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-5cf10ee5-f011-4208-b25c-84c9a11c2ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:01.609376 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 916/1851] 10.222.0.60 () {58 vars in 1018 bytes} [Tue Aug 30 01:30:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:01.640569 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bc41d3-ed47-467d-a7b3-29d2dfce2328 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:01.644760 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-d9bc41d3-ed47-467d-a7b3-29d2dfce2328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:01.698895 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bc41d3-ed47-467d-a7b3-29d2dfce2328 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:01.707169 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf10ee5-f011-4208-b25c-84c9a11c2ddb None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:01.708462 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-5cf10ee5-f011-4208-b25c-84c9a11c2ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:01.715737 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc633c66-b2c7-4af3-98d3-fd35d24bdeac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8889145228a24fb6bd539a11925e62f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:01.716440 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc633c66-b2c7-4af3-98d3-fd35d24bdeac service nova] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:01.716682 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc633c66-b2c7-4af3-98d3-fd35d24bdeac service nova] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:01.716955 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc633c66-b2c7-4af3-98d3-fd35d24bdeac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:01.730368 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf10ee5-f011-4208-b25c-84c9a11c2ddb None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:01.739721 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc633c66-b2c7-4af3-98d3-fd35d24bdeac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:01.744381 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3f6d95-2785-41da-aa1e-ae149248e104 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:01.745092 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f6d95-2785-41da-aa1e-ae149248e104 service cinder] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:01.745523 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f6d95-2785-41da-aa1e-ae149248e104 service cinder] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:01.745637 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc633c66-b2c7-4af3-98d3-fd35d24bdeac service nova] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:01.745802 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f6d95-2785-41da-aa1e-ae149248e104 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:01.747734 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-2b3f6d95-2785-41da-aa1e-ae149248e104 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:01.783955 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 936/1852] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:30:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:30:01.919976 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3f6d95-2785-41da-aa1e-ae149248e104 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:01.921941 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3f6d95-2785-41da-aa1e-ae149248e104 service cinder] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:01.952059 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 917/1853] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:30:01 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:30:02.914372 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc633c66-b2c7-4af3-98d3-fd35d24bdeac service nova] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:02.916009 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-dc633c66-b2c7-4af3-98d3-fd35d24bdeac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:02.963734 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc633c66-b2c7-4af3-98d3-fd35d24bdeac service nova] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:02.984106 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a75df-a8f9-4587-9f15-3bd07f8bc718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:02.992707 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a75df-a8f9-4587-9f15-3bd07f8bc718 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:02.995609 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a75df-a8f9-4587-9f15-3bd07f8bc718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:02.996321 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a75df-a8f9-4587-9f15-3bd07f8bc718 admin admin] PATH_INFO: `/v3/users/ffff7facb21e47b88224a52b89c68391` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:03.004981 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4a75df-a8f9-4587-9f15-3bd07f8bc718 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffff7facb21e47b88224a52b89c68391)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:03.019908 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4a75df-a8f9-4587-9f15-3bd07f8bc718 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:03.156178 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-ab4a75df-a8f9-4587-9f15-3bd07f8bc718 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffff7facb21e47b88224a52b89c68391'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:03.171378 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-ab4a75df-a8f9-4587-9f15-3bd07f8bc718 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffff7facb21e47b88224a52b89c68391'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:03.172276 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-ab4a75df-a8f9-4587-9f15-3bd07f8bc718 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffff7facb21e47b88224a52b89c68391'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:03.201897 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-ab4a75df-a8f9-4587-9f15-3bd07f8bc718 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffff7facb21e47b88224a52b89c68391'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:03.202850 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-ab4a75df-a8f9-4587-9f15-3bd07f8bc718 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffff7facb21e47b88224a52b89c68391'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:03.234849 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 937/1854] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:30:02 2022] DELETE /identity/v3/users/ffff7facb21e47b88224a52b89c68391 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:03.237306 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa93dd-e87d-43d8-90e6-1c9b7bd0d594 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:03.237835 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa93dd-e87d-43d8-90e6-1c9b7bd0d594 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:03.238662 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa93dd-e87d-43d8-90e6-1c9b7bd0d594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:03.373611 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-5daa93dd-e87d-43d8-90e6-1c9b7bd0d594 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:03.378637 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-5daa93dd-e87d-43d8-90e6-1c9b7bd0d594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:03.527414 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a75df-a8f9-4587-9f15-3bd07f8bc718 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:03.529055 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-ab4a75df-a8f9-4587-9f15-3bd07f8bc718 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:03.551339 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:03.704895 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 918/1855] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 469 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:30:03.743838 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a75df-a8f9-4587-9f15-3bd07f8bc718 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:03.760602 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548fcf2e-c27b-4108-bc7d-ea11d3ac6273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:03.764738 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548fcf2e-c27b-4108-bc7d-ea11d3ac6273 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:03.765141 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548fcf2e-c27b-4108-bc7d-ea11d3ac6273 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:03.770602 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548fcf2e-c27b-4108-bc7d-ea11d3ac6273 admin admin] PATH_INFO: `/v3/projects/ae3d14a61867486d81248ad64e0977c6` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:03.775567 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548fcf2e-c27b-4108-bc7d-ea11d3ac6273 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae3d14a61867486d81248ad64e0977c6)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:03.779846 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548fcf2e-c27b-4108-bc7d-ea11d3ac6273 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:03.917683 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daa93dd-e87d-43d8-90e6-1c9b7bd0d594 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:03.920880 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-5daa93dd-e87d-43d8-90e6-1c9b7bd0d594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:03.960383 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-548fcf2e-c27b-4108-bc7d-ea11d3ac6273 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae3d14a61867486d81248ad64e0977c6', 'request_id': 'req-548fcf2e-c27b-4108-bc7d-ea11d3ac6273'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:03.971563 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-548fcf2e-c27b-4108-bc7d-ea11d3ac6273 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae3d14a61867486d81248ad64e0977c6', 'request_id': 'req-548fcf2e-c27b-4108-bc7d-ea11d3ac6273'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:03.988031 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-548fcf2e-c27b-4108-bc7d-ea11d3ac6273 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae3d14a61867486d81248ad64e0977c6', 'request_id': 'req-548fcf2e-c27b-4108-bc7d-ea11d3ac6273'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:04.003631 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-548fcf2e-c27b-4108-bc7d-ea11d3ac6273 admin admin] The token cache is being invalidate because project ae3d14a61867486d81248ad64e0977c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:30:04.004229 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-548fcf2e-c27b-4108-bc7d-ea11d3ac6273 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:04.005170 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-548fcf2e-c27b-4108-bc7d-ea11d3ac6273 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:04.014337 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 938/1856] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:30:03 2022] DELETE /identity/v3/projects/ae3d14a61867486d81248ad64e0977c6 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:30:04.035897 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548fcf2e-c27b-4108-bc7d-ea11d3ac6273 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:04.042531 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-548fcf2e-c27b-4108-bc7d-ea11d3ac6273 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:04.053094 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:04.145498 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daa93dd-e87d-43d8-90e6-1c9b7bd0d594 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:04.174145 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548fcf2e-c27b-4108-bc7d-ea11d3ac6273 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:04.182141 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd1ed5-1268-43ac-bb51-1b672b8b9bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:04.183111 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd1ed5-1268-43ac-bb51-1b672b8b9bc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:04.185320 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd1ed5-1268-43ac-bb51-1b672b8b9bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:04.185792 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd1ed5-1268-43ac-bb51-1b672b8b9bc2 admin admin] PATH_INFO: `/v3/users/b7d809bbe9a4447683b2b58e18b13e20` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:04.187990 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bd1ed5-1268-43ac-bb51-1b672b8b9bc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7d809bbe9a4447683b2b58e18b13e20)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:04.190647 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bd1ed5-1268-43ac-bb51-1b672b8b9bc2 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:04.304382 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-b5bd1ed5-1268-43ac-bb51-1b672b8b9bc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7d809bbe9a4447683b2b58e18b13e20'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:04.307718 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:04.310488 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-b5bd1ed5-1268-43ac-bb51-1b672b8b9bc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7d809bbe9a4447683b2b58e18b13e20'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:04.312566 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-b5bd1ed5-1268-43ac-bb51-1b672b8b9bc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7d809bbe9a4447683b2b58e18b13e20'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:04.332257 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e43cd4-0e00-4128-9d81-7dc6461dbac5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:04.333774 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e43cd4-0e00-4128-9d81-7dc6461dbac5 service neutron] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:04.334299 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e43cd4-0e00-4128-9d81-7dc6461dbac5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:04.334833 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e43cd4-0e00-4128-9d81-7dc6461dbac5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:04.361593 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-e1e43cd4-0e00-4128-9d81-7dc6461dbac5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:04.366902 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-b5bd1ed5-1268-43ac-bb51-1b672b8b9bc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7d809bbe9a4447683b2b58e18b13e20'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:04.370545 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-b5bd1ed5-1268-43ac-bb51-1b672b8b9bc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7d809bbe9a4447683b2b58e18b13e20'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:04.419630 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 939/1857] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:30:04 2022] DELETE /identity/v3/users/b7d809bbe9a4447683b2b58e18b13e20 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:04.420707 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e43cd4-0e00-4128-9d81-7dc6461dbac5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:04.422285 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e43cd4-0e00-4128-9d81-7dc6461dbac5 service neutron] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:04.446860 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 919/1858] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:30:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:30:06.751555 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd1ed5-1268-43ac-bb51-1b672b8b9bc2 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:06.751555 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-b5bd1ed5-1268-43ac-bb51-1b672b8b9bc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:06.946474 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e43cd4-0e00-4128-9d81-7dc6461dbac5 service neutron] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:06.948616 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-e1e43cd4-0e00-4128-9d81-7dc6461dbac5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:06.968377 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e43cd4-0e00-4128-9d81-7dc6461dbac5 service neutron] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:07.034665 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd1ed5-1268-43ac-bb51-1b672b8b9bc2 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:07.050462 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa969b-12df-4eb9-b321-1a4fca6c5bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:07.051168 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa969b-12df-4eb9-b321-1a4fca6c5bf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:07.051479 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa969b-12df-4eb9-b321-1a4fca6c5bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:07.051749 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa969b-12df-4eb9-b321-1a4fca6c5bf9 admin admin] PATH_INFO: `/v3/projects/bf155c3a868747c691140033e604f1d3` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:07.057161 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffa969b-12df-4eb9-b321-1a4fca6c5bf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf155c3a868747c691140033e604f1d3)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:07.066670 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffa969b-12df-4eb9-b321-1a4fca6c5bf9 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:07.100923 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515bec76-d190-4c2f-b8b0-fd8add27b1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:07.101613 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515bec76-d190-4c2f-b8b0-fd8add27b1a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:07.101876 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515bec76-d190-4c2f-b8b0-fd8add27b1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:07.103820 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515bec76-d190-4c2f-b8b0-fd8add27b1a0 admin admin] PATH_INFO: `/v3/projects/b40de929186747d09cfcd22436b81ade` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:07.108267 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515bec76-d190-4c2f-b8b0-fd8add27b1a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b40de929186747d09cfcd22436b81ade)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:07.111004 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515bec76-d190-4c2f-b8b0-fd8add27b1a0 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:07.222305 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-6ffa969b-12df-4eb9-b321-1a4fca6c5bf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf155c3a868747c691140033e604f1d3', 'request_id': 'req-6ffa969b-12df-4eb9-b321-1a4fca6c5bf9'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:07.238164 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-515bec76-d190-4c2f-b8b0-fd8add27b1a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b40de929186747d09cfcd22436b81ade', 'request_id': 'req-515bec76-d190-4c2f-b8b0-fd8add27b1a0'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:07.244541 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-6ffa969b-12df-4eb9-b321-1a4fca6c5bf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf155c3a868747c691140033e604f1d3', 'request_id': 'req-6ffa969b-12df-4eb9-b321-1a4fca6c5bf9'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:07.246382 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-515bec76-d190-4c2f-b8b0-fd8add27b1a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b40de929186747d09cfcd22436b81ade', 'request_id': 'req-515bec76-d190-4c2f-b8b0-fd8add27b1a0'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:07.259586 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-515bec76-d190-4c2f-b8b0-fd8add27b1a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b40de929186747d09cfcd22436b81ade', 'request_id': 'req-515bec76-d190-4c2f-b8b0-fd8add27b1a0'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:07.266982 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-6ffa969b-12df-4eb9-b321-1a4fca6c5bf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf155c3a868747c691140033e604f1d3', 'request_id': 'req-6ffa969b-12df-4eb9-b321-1a4fca6c5bf9'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:07.310479 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-6ffa969b-12df-4eb9-b321-1a4fca6c5bf9 admin admin] The token cache is being invalidate because project bf155c3a868747c691140033e604f1d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:30:07.310792 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-515bec76-d190-4c2f-b8b0-fd8add27b1a0 admin admin] The token cache is being invalidate because project b40de929186747d09cfcd22436b81ade was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81447) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:30:07.310914 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-6ffa969b-12df-4eb9-b321-1a4fca6c5bf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:07.311003 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-515bec76-d190-4c2f-b8b0-fd8add27b1a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:07.311089 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-6ffa969b-12df-4eb9-b321-1a4fca6c5bf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:07.311166 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-515bec76-d190-4c2f-b8b0-fd8add27b1a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:07.319989 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 940/1859] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:30:06 2022] DELETE /identity/v3/projects/bf155c3a868747c691140033e604f1d3 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:07.320707 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa969b-12df-4eb9-b321-1a4fca6c5bf9 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:07.327340 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-6ffa969b-12df-4eb9-b321-1a4fca6c5bf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:07.332348 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 920/1860] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:30:06 2022] DELETE /identity/v3/projects/b40de929186747d09cfcd22436b81ade => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:07.346648 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc5a86-b39d-4e25-804e-b5361df904bd None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:07.346648 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc5a86-b39d-4e25-804e-b5361df904bd None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:07.361072 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc5a86-b39d-4e25-804e-b5361df904bd None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:07.366924 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 921/1861] 10.222.0.60 () {54 vars in 921 bytes} [Tue Aug 30 01:30:07 2022] GET /identity => generated 270 bytes in 35 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:30:07.372001 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2502ab74-df65-4c2c-8422-384275f70176 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:07.372001 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2502ab74-df65-4c2c-8422-384275f70176 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:07.375919 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2502ab74-df65-4c2c-8422-384275f70176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:07.411861 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-2502ab74-df65-4c2c-8422-384275f70176 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:07.413605 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-2502ab74-df65-4c2c-8422-384275f70176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:07.455260 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:07.593364 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:07.629871 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa969b-12df-4eb9-b321-1a4fca6c5bf9 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:07.653055 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 922/1862] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:07.653945 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d910b1-a07d-4e32-8394-496edbcff8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:07.655254 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2502ab74-df65-4c2c-8422-384275f70176 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:07.656944 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d910b1-a07d-4e32-8394-496edbcff8c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:07.657239 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d910b1-a07d-4e32-8394-496edbcff8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:07.657964 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d910b1-a07d-4e32-8394-496edbcff8c2 admin admin] PATH_INFO: `/v3/users/d48cbf5fb7134845bfb7353df63d73a0` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:07.659374 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d910b1-a07d-4e32-8394-496edbcff8c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d48cbf5fb7134845bfb7353df63d73a0)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:07.661749 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d910b1-a07d-4e32-8394-496edbcff8c2 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:07.664336 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-2502ab74-df65-4c2c-8422-384275f70176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:07.693811 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2502ab74-df65-4c2c-8422-384275f70176 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:07.708924 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff938c74-ed78-4a49-8a73-bf028998c69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:07.709586 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff938c74-ed78-4a49-8a73-bf028998c69d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:07.711975 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff938c74-ed78-4a49-8a73-bf028998c69d admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:07.712307 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff938c74-ed78-4a49-8a73-bf028998c69d admin admin] PATH_INFO: `/v3/users/1e97354521704b0abb826773d9251293` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:07.715049 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff938c74-ed78-4a49-8a73-bf028998c69d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e97354521704b0abb826773d9251293)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:07.729109 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff938c74-ed78-4a49-8a73-bf028998c69d admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:07.786438 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-48d910b1-a07d-4e32-8394-496edbcff8c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd48cbf5fb7134845bfb7353df63d73a0'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:07.808598 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-48d910b1-a07d-4e32-8394-496edbcff8c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd48cbf5fb7134845bfb7353df63d73a0'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:07.809600 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-48d910b1-a07d-4e32-8394-496edbcff8c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd48cbf5fb7134845bfb7353df63d73a0'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:07.835652 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-48d910b1-a07d-4e32-8394-496edbcff8c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd48cbf5fb7134845bfb7353df63d73a0'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:07.837807 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-48d910b1-a07d-4e32-8394-496edbcff8c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd48cbf5fb7134845bfb7353df63d73a0'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:07.855917 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 941/1863] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:30:07 2022] DELETE /identity/v3/users/d48cbf5fb7134845bfb7353df63d73a0 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:07.857793 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704ff1c-e7fa-4cfc-92d1-c4b2dc1954f2 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:07.858253 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704ff1c-e7fa-4cfc-92d1-c4b2dc1954f2 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:07.859704 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704ff1c-e7fa-4cfc-92d1-c4b2dc1954f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:07.870529 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-ff938c74-ed78-4a49-8a73-bf028998c69d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e97354521704b0abb826773d9251293'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:07.888377 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-9704ff1c-e7fa-4cfc-92d1-c4b2dc1954f2 None None] MFA Rules not processed for user `8889145228a24fb6bd539a11925e62f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:07.888532 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-ff938c74-ed78-4a49-8a73-bf028998c69d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e97354521704b0abb826773d9251293'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:07.890001 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-9704ff1c-e7fa-4cfc-92d1-c4b2dc1954f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:07.890599 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-ff938c74-ed78-4a49-8a73-bf028998c69d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e97354521704b0abb826773d9251293'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:07.891576 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-ff938c74-ed78-4a49-8a73-bf028998c69d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e97354521704b0abb826773d9251293'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:07.932358 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-ff938c74-ed78-4a49-8a73-bf028998c69d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e97354521704b0abb826773d9251293'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:07.951945 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 923/1864] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:30:07 2022] DELETE /identity/v3/users/1e97354521704b0abb826773d9251293 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:07.954379 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11149b34-52b1-4268-ba85-088012fea510 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:07.955023 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11149b34-52b1-4268-ba85-088012fea510 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:07.955492 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11149b34-52b1-4268-ba85-088012fea510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:07.990243 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-11149b34-52b1-4268-ba85-088012fea510 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:07.992364 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-11149b34-52b1-4268-ba85-088012fea510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:08.077406 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 942/1865] 10.222.0.60 () {58 vars in 1018 bytes} [Tue Aug 30 01:30:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:08.079018 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2805af-bcdc-4eff-9739-29600e94d379 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:08.079641 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2805af-bcdc-4eff-9739-29600e94d379 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:08.080225 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2805af-bcdc-4eff-9739-29600e94d379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:08.104609 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-cd2805af-bcdc-4eff-9739-29600e94d379 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:08.106302 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-cd2805af-bcdc-4eff-9739-29600e94d379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:08.109426 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 924/1866] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:08.113647 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11149b34-52b1-4268-ba85-088012fea510 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:08.115472 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 943/1867] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:08.124375 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11149b34-52b1-4268-ba85-088012fea510 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:08.129346 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c237b5de-8f50-47d3-aedc-689c340db377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:08.129644 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c237b5de-8f50-47d3-aedc-689c340db377 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:08.129925 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c237b5de-8f50-47d3-aedc-689c340db377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:08.130240 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c237b5de-8f50-47d3-aedc-689c340db377 admin admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:08.130858 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c237b5de-8f50-47d3-aedc-689c340db377 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:30:08.131159 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c237b5de-8f50-47d3-aedc-689c340db377 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:08.133081 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c237b5de-8f50-47d3-aedc-689c340db377 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:08.136552 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2805af-bcdc-4eff-9739-29600e94d379 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:08.139259 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-cd2805af-bcdc-4eff-9739-29600e94d379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:08.152170 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 925/1868] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 30 01:30:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:30:08.153059 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c237b5de-8f50-47d3-aedc-689c340db377 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:08.166662 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c237b5de-8f50-47d3-aedc-689c340db377 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:08.172466 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf7b6e-ba73-4d51-89dd-614ea04b40ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:08.173173 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf7b6e-ba73-4d51-89dd-614ea04b40ab admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:08.173541 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf7b6e-ba73-4d51-89dd-614ea04b40ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:08.173883 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf7b6e-ba73-4d51-89dd-614ea04b40ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:08.175266 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caf7b6e-ba73-4d51-89dd-614ea04b40ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:08.177667 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caf7b6e-ba73-4d51-89dd-614ea04b40ab admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:08.205754 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:08.220903 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 926/1869] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:30:08 2022] POST /identity/v3/projects => generated 367 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:30:08.222262 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf7b6e-ba73-4d51-89dd-614ea04b40ab admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:08.232751 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2805af-bcdc-4eff-9739-29600e94d379 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:08.243767 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:08.305198 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d4f61-d8a9-4839-90f8-84736d8a3bc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:08.306343 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d4f61-d8a9-4839-90f8-84736d8a3bc0 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:08.306343 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d4f61-d8a9-4839-90f8-84736d8a3bc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:08.306776 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d4f61-d8a9-4839-90f8-84736d8a3bc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:08.310137 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf7b6e-ba73-4d51-89dd-614ea04b40ab admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:08.315749 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dae572-6797-4739-8e8e-b71328152e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:08.316601 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dae572-6797-4739-8e8e-b71328152e23 admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:08.317219 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dae572-6797-4739-8e8e-b71328152e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:08.317780 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dae572-6797-4739-8e8e-b71328152e23 admin admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:08.318633 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dae572-6797-4739-8e8e-b71328152e23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:08.320307 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062d4f61-d8a9-4839-90f8-84736d8a3bc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:08.321726 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dae572-6797-4739-8e8e-b71328152e23 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:08.322480 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062d4f61-d8a9-4839-90f8-84736d8a3bc0 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:08.338893 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 944/1870] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:30:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:30:08.340183 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d4f61-d8a9-4839-90f8-84736d8a3bc0 service neutron] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:08.342470 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-062d4f61-d8a9-4839-90f8-84736d8a3bc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:08.360901 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 927/1871] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:30:08 2022] POST /identity/v3/users => generated 284 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:30:08.361875 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dae572-6797-4739-8e8e-b71328152e23 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:08.379445 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dae572-6797-4739-8e8e-b71328152e23 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:08.389919 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af835b0b-fd2e-482a-aa7b-53edd7232032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:08.391337 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af835b0b-fd2e-482a-aa7b-53edd7232032 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:08.392556 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af835b0b-fd2e-482a-aa7b-53edd7232032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:08.393235 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af835b0b-fd2e-482a-aa7b-53edd7232032 admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:08.394227 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af835b0b-fd2e-482a-aa7b-53edd7232032 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:08.396837 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af835b0b-fd2e-482a-aa7b-53edd7232032 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:08.422192 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 928/1872] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:30:08.423643 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af835b0b-fd2e-482a-aa7b-53edd7232032 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:08.437313 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af835b0b-fd2e-482a-aa7b-53edd7232032 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:08.446370 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e56aa36-1468-40da-97b6-55af62835f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:08.448177 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e56aa36-1468-40da-97b6-55af62835f34 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:08.448652 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e56aa36-1468-40da-97b6-55af62835f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:08.449360 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d4f61-d8a9-4839-90f8-84736d8a3bc0 service neutron] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:08.450002 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e56aa36-1468-40da-97b6-55af62835f34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:08.453490 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e56aa36-1468-40da-97b6-55af62835f34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:08.455372 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572bba34-e8e4-405e-8720-b1f2e504fffb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8889145228a24fb6bd539a11925e62f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:08.456045 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e56aa36-1468-40da-97b6-55af62835f34 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:08.456173 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bba34-e8e4-405e-8720-b1f2e504fffb service nova] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:08.456480 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bba34-e8e4-405e-8720-b1f2e504fffb service nova] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:08.457068 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bba34-e8e4-405e-8720-b1f2e504fffb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:08.467930 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572bba34-e8e4-405e-8720-b1f2e504fffb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:08.469709 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572bba34-e8e4-405e-8720-b1f2e504fffb service nova] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:08.478982 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 929/1873] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:30:08.480162 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e56aa36-1468-40da-97b6-55af62835f34 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:08.483411 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 945/1874] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:30:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:30:08.497886 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e56aa36-1468-40da-97b6-55af62835f34 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:08.516356 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf643e-8e40-46c1-aa69-bac9fd9b1f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:08.517315 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf643e-8e40-46c1-aa69-bac9fd9b1f73 admin admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:08.517697 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf643e-8e40-46c1-aa69-bac9fd9b1f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:08.518129 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf643e-8e40-46c1-aa69-bac9fd9b1f73 admin admin] PATH_INFO: `/v3/projects/3fdca87c008e498c90648ea003012a4a/users/73824b2a0eb144ba9b8a6743c443cd3d/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:08.548198 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacf643e-8e40-46c1-aa69-bac9fd9b1f73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fdca87c008e498c90648ea003012a4a, user_id=73824b2a0eb144ba9b8a6743c443cd3d, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:08.548949 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572bba34-e8e4-405e-8720-b1f2e504fffb service nova] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:08.550713 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacf643e-8e40-46c1-aa69-bac9fd9b1f73 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:08.551520 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-572bba34-e8e4-405e-8720-b1f2e504fffb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:08.575363 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 930/1875] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:30:08 2022] PUT /identity/v3/projects/3fdca87c008e498c90648ea003012a4a/users/73824b2a0eb144ba9b8a6743c443cd3d/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:08.576800 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572bba34-e8e4-405e-8720-b1f2e504fffb service nova] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:08.597936 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5919347-0f2a-423e-bef9-a4494ff69330 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:08.601276 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5919347-0f2a-423e-bef9-a4494ff69330 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:08.601870 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5919347-0f2a-423e-bef9-a4494ff69330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:08.693937 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-d5919347-0f2a-423e-bef9-a4494ff69330 None None] MFA Rules not processed for user `73824b2a0eb144ba9b8a6743c443cd3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:08.697713 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-d5919347-0f2a-423e-bef9-a4494ff69330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:08.710904 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54482e-cc76-484c-9d08-a6666ee3e0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:08.711851 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54482e-cc76-484c-9d08-a6666ee3e0a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:08.712135 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54482e-cc76-484c-9d08-a6666ee3e0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:08.712412 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54482e-cc76-484c-9d08-a6666ee3e0a2 admin admin] PATH_INFO: `/v3/projects/98bf391ced87430c86f6aa3561766dd4` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:08.719570 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc54482e-cc76-484c-9d08-a6666ee3e0a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98bf391ced87430c86f6aa3561766dd4)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:08.721612 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc54482e-cc76-484c-9d08-a6666ee3e0a2 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:08.810523 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 931/1876] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:08.812427 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:08.820313 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5919347-0f2a-423e-bef9-a4494ff69330 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:08.834751 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-cc54482e-cc76-484c-9d08-a6666ee3e0a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98bf391ced87430c86f6aa3561766dd4', 'request_id': 'req-cc54482e-cc76-484c-9d08-a6666ee3e0a2'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:08.843286 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5919347-0f2a-423e-bef9-a4494ff69330 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:08.872476 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-cc54482e-cc76-484c-9d08-a6666ee3e0a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98bf391ced87430c86f6aa3561766dd4', 'request_id': 'req-cc54482e-cc76-484c-9d08-a6666ee3e0a2'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:08.896966 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-cc54482e-cc76-484c-9d08-a6666ee3e0a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98bf391ced87430c86f6aa3561766dd4', 'request_id': 'req-cc54482e-cc76-484c-9d08-a6666ee3e0a2'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:08.939159 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-cc54482e-cc76-484c-9d08-a6666ee3e0a2 admin admin] The token cache is being invalidate because project 98bf391ced87430c86f6aa3561766dd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:30:08.940000 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-cc54482e-cc76-484c-9d08-a6666ee3e0a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:08.945602 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-cc54482e-cc76-484c-9d08-a6666ee3e0a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:08.952851 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 946/1877] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:30:08 2022] DELETE /identity/v3/projects/98bf391ced87430c86f6aa3561766dd4 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:08.953851 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54482e-cc76-484c-9d08-a6666ee3e0a2 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:08.956813 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-cc54482e-cc76-484c-9d08-a6666ee3e0a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:08.958997 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:09.010225 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c3961-0b30-4cd5-8642-a8f0a1ffc7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:09.011011 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c3961-0b30-4cd5-8642-a8f0a1ffc7a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:09.011701 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c3961-0b30-4cd5-8642-a8f0a1ffc7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:09.012105 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c3961-0b30-4cd5-8642-a8f0a1ffc7a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:09.012907 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21c3961-0b30-4cd5-8642-a8f0a1ffc7a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:09.015648 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21c3961-0b30-4cd5-8642-a8f0a1ffc7a6 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:09.093611 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 932/1878] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:30:08 2022] POST /identity/v3/projects => generated 369 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:30:09.094692 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c3961-0b30-4cd5-8642-a8f0a1ffc7a6 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:09.098644 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-e21c3961-0b30-4cd5-8642-a8f0a1ffc7a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:09.135189 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54482e-cc76-484c-9d08-a6666ee3e0a2 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:09.194386 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c3961-0b30-4cd5-8642-a8f0a1ffc7a6 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:09.199625 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c9c4b-9cba-481a-9d55-987362f4bf01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:09.200319 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c9c4b-9cba-481a-9d55-987362f4bf01 admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:09.200669 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c9c4b-9cba-481a-9d55-987362f4bf01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:09.201046 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c9c4b-9cba-481a-9d55-987362f4bf01 admin admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:09.201750 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019c9c4b-9cba-481a-9d55-987362f4bf01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:09.203770 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019c9c4b-9cba-481a-9d55-987362f4bf01 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:09.226377 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c070b-9ddd-4552-86fd-b2048bf0ea08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:09.227303 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c070b-9ddd-4552-86fd-b2048bf0ea08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:09.227752 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c070b-9ddd-4552-86fd-b2048bf0ea08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:09.228030 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c070b-9ddd-4552-86fd-b2048bf0ea08 admin admin] PATH_INFO: `/v3/users/30e7061ace2f42ffacf3e057beb2ae72` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:09.229341 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3c070b-9ddd-4552-86fd-b2048bf0ea08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30e7061ace2f42ffacf3e057beb2ae72)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:09.231319 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3c070b-9ddd-4552-86fd-b2048bf0ea08 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:09.234816 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 933/1879] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:30:09 2022] POST /identity/v3/users => generated 291 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:30:09.234816 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c9c4b-9cba-481a-9d55-987362f4bf01 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:09.235176 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-019c9c4b-9cba-481a-9d55-987362f4bf01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:09.248222 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c9c4b-9cba-481a-9d55-987362f4bf01 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:09.253539 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d3fb5-5a52-45c2-9d2e-f8c5cf842030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:09.254185 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d3fb5-5a52-45c2-9d2e-f8c5cf842030 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:09.254465 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d3fb5-5a52-45c2-9d2e-f8c5cf842030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:09.255064 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d3fb5-5a52-45c2-9d2e-f8c5cf842030 admin admin] PATH_INFO: `/v3/projects/8b8127201864412b8d9a1b05125c61f1` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:09.255970 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d3fb5-5a52-45c2-9d2e-f8c5cf842030 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b8127201864412b8d9a1b05125c61f1)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:09.257954 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d3fb5-5a52-45c2-9d2e-f8c5cf842030 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:09.280200 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-df3c070b-9ddd-4552-86fd-b2048bf0ea08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30e7061ace2f42ffacf3e057beb2ae72'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:09.288320 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-df3c070b-9ddd-4552-86fd-b2048bf0ea08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30e7061ace2f42ffacf3e057beb2ae72'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:09.289032 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-df3c070b-9ddd-4552-86fd-b2048bf0ea08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30e7061ace2f42ffacf3e057beb2ae72'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:09.302488 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-df3c070b-9ddd-4552-86fd-b2048bf0ea08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30e7061ace2f42ffacf3e057beb2ae72'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:09.303243 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-df3c070b-9ddd-4552-86fd-b2048bf0ea08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30e7061ace2f42ffacf3e057beb2ae72'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:09.307600 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-7b3d3fb5-5a52-45c2-9d2e-f8c5cf842030 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b8127201864412b8d9a1b05125c61f1', 'request_id': 'req-7b3d3fb5-5a52-45c2-9d2e-f8c5cf842030'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:09.309669 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:09.315248 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-7b3d3fb5-5a52-45c2-9d2e-f8c5cf842030 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b8127201864412b8d9a1b05125c61f1', 'request_id': 'req-7b3d3fb5-5a52-45c2-9d2e-f8c5cf842030'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:09.318571 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 947/1880] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:30:08 2022] DELETE /identity/v3/users/30e7061ace2f42ffacf3e057beb2ae72 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:09.319470 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c070b-9ddd-4552-86fd-b2048bf0ea08 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:09.323614 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-df3c070b-9ddd-4552-86fd-b2048bf0ea08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:09.324745 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-7b3d3fb5-5a52-45c2-9d2e-f8c5cf842030 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b8127201864412b8d9a1b05125c61f1', 'request_id': 'req-7b3d3fb5-5a52-45c2-9d2e-f8c5cf842030'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:09.340175 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-7b3d3fb5-5a52-45c2-9d2e-f8c5cf842030 admin admin] The token cache is being invalidate because project 8b8127201864412b8d9a1b05125c61f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81447) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:30:09.340531 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-7b3d3fb5-5a52-45c2-9d2e-f8c5cf842030 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:09.341143 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-7b3d3fb5-5a52-45c2-9d2e-f8c5cf842030 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:09.342711 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 934/1881] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:30:09 2022] DELETE /identity/v3/projects/8b8127201864412b8d9a1b05125c61f1 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:09.347423 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d3fb5-5a52-45c2-9d2e-f8c5cf842030 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:09.348849 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-7b3d3fb5-5a52-45c2-9d2e-f8c5cf842030 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:09.397844 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:09.411157 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c070b-9ddd-4552-86fd-b2048bf0ea08 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:09.422816 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9555339-a064-40ac-8531-3126f9f504c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:09.424650 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9555339-a064-40ac-8531-3126f9f504c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:09.425022 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9555339-a064-40ac-8531-3126f9f504c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:09.425490 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9555339-a064-40ac-8531-3126f9f504c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:09.426884 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9555339-a064-40ac-8531-3126f9f504c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:09.429276 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9555339-a064-40ac-8531-3126f9f504c3 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:09.445454 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 948/1882] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:30:09.447386 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d3fb5-5a52-45c2-9d2e-f8c5cf842030 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:09.449929 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9555339-a064-40ac-8531-3126f9f504c3 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:09.452331 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-e9555339-a064-40ac-8531-3126f9f504c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:09.453297 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed144ac-0cdb-43b7-817f-89df2fcd5c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:09.454082 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed144ac-0cdb-43b7-817f-89df2fcd5c8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:09.454408 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed144ac-0cdb-43b7-817f-89df2fcd5c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:09.454682 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed144ac-0cdb-43b7-817f-89df2fcd5c8c admin admin] PATH_INFO: `/v3/users/54bc5ac7211b42dda62db35e4ce3fc33` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:09.455956 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed144ac-0cdb-43b7-817f-89df2fcd5c8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=54bc5ac7211b42dda62db35e4ce3fc33)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:09.457976 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed144ac-0cdb-43b7-817f-89df2fcd5c8c admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:09.472815 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9555339-a064-40ac-8531-3126f9f504c3 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:09.480072 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885f8ea1-8732-4f64-9ac3-6e9a7b983986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:09.481350 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f8ea1-8732-4f64-9ac3-6e9a7b983986 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:09.481638 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f8ea1-8732-4f64-9ac3-6e9a7b983986 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:09.481913 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f8ea1-8732-4f64-9ac3-6e9a7b983986 admin admin] PATH_INFO: `/v3/projects/71c63ea66de44fa28ea950ed6ca135e8/users/5111602b996a4e879f1faf826a90562b/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:09.501130 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885f8ea1-8732-4f64-9ac3-6e9a7b983986 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71c63ea66de44fa28ea950ed6ca135e8, user_id=5111602b996a4e879f1faf826a90562b, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:09.503864 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885f8ea1-8732-4f64-9ac3-6e9a7b983986 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:09.533814 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 949/1883] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:30:09 2022] PUT /identity/v3/projects/71c63ea66de44fa28ea950ed6ca135e8/users/5111602b996a4e879f1faf826a90562b/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:30:09.537143 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-2ed144ac-0cdb-43b7-817f-89df2fcd5c8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54bc5ac7211b42dda62db35e4ce3fc33'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:09.537678 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885f8ea1-8732-4f64-9ac3-6e9a7b983986 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:09.558376 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-2ed144ac-0cdb-43b7-817f-89df2fcd5c8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54bc5ac7211b42dda62db35e4ce3fc33'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:09.560843 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-2ed144ac-0cdb-43b7-817f-89df2fcd5c8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54bc5ac7211b42dda62db35e4ce3fc33'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:09.562171 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-2ed144ac-0cdb-43b7-817f-89df2fcd5c8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54bc5ac7211b42dda62db35e4ce3fc33'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:09.586034 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-2ed144ac-0cdb-43b7-817f-89df2fcd5c8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54bc5ac7211b42dda62db35e4ce3fc33'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:09.617155 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 935/1884] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:30:09 2022] DELETE /identity/v3/users/54bc5ac7211b42dda62db35e4ce3fc33 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:09.625880 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885f8ea1-8732-4f64-9ac3-6e9a7b983986 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:09.691090 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be894711-865e-4452-a097-4bc3acb3952b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:09.691951 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be894711-865e-4452-a097-4bc3acb3952b admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:09.692269 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be894711-865e-4452-a097-4bc3acb3952b admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:09.692729 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be894711-865e-4452-a097-4bc3acb3952b admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:09.693365 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be894711-865e-4452-a097-4bc3acb3952b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:09.695866 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be894711-865e-4452-a097-4bc3acb3952b admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:09.715359 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 950/1885] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:30:09.716757 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed144ac-0cdb-43b7-817f-89df2fcd5c8c admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:09.718306 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-2ed144ac-0cdb-43b7-817f-89df2fcd5c8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:09.732680 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed144ac-0cdb-43b7-817f-89df2fcd5c8c admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:09.737648 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae056cba-febe-48c1-88e6-d4c99d4cdefc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:09.738137 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae056cba-febe-48c1-88e6-d4c99d4cdefc admin admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:09.738537 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae056cba-febe-48c1-88e6-d4c99d4cdefc admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:09.738724 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae056cba-febe-48c1-88e6-d4c99d4cdefc admin admin] PATH_INFO: `/v3/projects/71c63ea66de44fa28ea950ed6ca135e8/users/5111602b996a4e879f1faf826a90562b/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:09.740790 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae056cba-febe-48c1-88e6-d4c99d4cdefc admin admin] RBAC: Authorizing `identity:create_grant(project_id=71c63ea66de44fa28ea950ed6ca135e8, user_id=5111602b996a4e879f1faf826a90562b, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:09.743725 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae056cba-febe-48c1-88e6-d4c99d4cdefc admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:09.759112 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 936/1886] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:30:09 2022] PUT /identity/v3/projects/71c63ea66de44fa28ea950ed6ca135e8/users/5111602b996a4e879f1faf826a90562b/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:09.768855 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7745a-555a-4d8b-aa9b-d151aa09aabc None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:09.769730 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7745a-555a-4d8b-aa9b-d151aa09aabc None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:09.770166 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7745a-555a-4d8b-aa9b-d151aa09aabc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:09.817626 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:09.831110 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-fdb7745a-555a-4d8b-aa9b-d151aa09aabc None None] MFA Rules not processed for user `5111602b996a4e879f1faf826a90562b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:09.832893 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-fdb7745a-555a-4d8b-aa9b-d151aa09aabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:09.932905 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae056cba-febe-48c1-88e6-d4c99d4cdefc admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:09.934999 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-ae056cba-febe-48c1-88e6-d4c99d4cdefc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:09.944754 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 951/1887] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:09 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:09.952929 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb7745a-555a-4d8b-aa9b-d151aa09aabc None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:09.954739 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-fdb7745a-555a-4d8b-aa9b-d151aa09aabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:10.047035 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae056cba-febe-48c1-88e6-d4c99d4cdefc admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:10.063297 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ff512-5f71-4af8-bd6a-079b6612c8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:10.064242 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ff512-5f71-4af8-bd6a-079b6612c8ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:10.064564 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ff512-5f71-4af8-bd6a-079b6612c8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:10.064841 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ff512-5f71-4af8-bd6a-079b6612c8ba admin admin] PATH_INFO: `/v3/projects/3a0440022f8b45a7bbb6e84d3ad45899` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:10.066369 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216ff512-5f71-4af8-bd6a-079b6612c8ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a0440022f8b45a7bbb6e84d3ad45899)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:10.069189 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216ff512-5f71-4af8-bd6a-079b6612c8ba admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:10.070135 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb7745a-555a-4d8b-aa9b-d151aa09aabc None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:10.079181 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb697987-32c3-481b-b227-1ec4fab597cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:10.080089 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb697987-32c3-481b-b227-1ec4fab597cc service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:10.080373 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb697987-32c3-481b-b227-1ec4fab597cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:10.080644 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb697987-32c3-481b-b227-1ec4fab597cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:10.091980 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb697987-32c3-481b-b227-1ec4fab597cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:10.093566 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb697987-32c3-481b-b227-1ec4fab597cc service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:10.106533 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 952/1888] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:30:09 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:30:10.107642 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb697987-32c3-481b-b227-1ec4fab597cc service cinder] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:10.109128 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-bb697987-32c3-481b-b227-1ec4fab597cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:10.126647 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb697987-32c3-481b-b227-1ec4fab597cc service cinder] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:10.134503 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:10.176857 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-216ff512-5f71-4af8-bd6a-079b6612c8ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a0440022f8b45a7bbb6e84d3ad45899', 'request_id': 'req-216ff512-5f71-4af8-bd6a-079b6612c8ba'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:10.210332 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-216ff512-5f71-4af8-bd6a-079b6612c8ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a0440022f8b45a7bbb6e84d3ad45899', 'request_id': 'req-216ff512-5f71-4af8-bd6a-079b6612c8ba'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:10.227250 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-216ff512-5f71-4af8-bd6a-079b6612c8ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a0440022f8b45a7bbb6e84d3ad45899', 'request_id': 'req-216ff512-5f71-4af8-bd6a-079b6612c8ba'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:10.279878 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb2b229-20a9-43f5-a9a2-ad66846a4ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:10.280135 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2b229-20a9-43f5-a9a2-ad66846a4ff1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:10.280357 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2b229-20a9-43f5-a9a2-ad66846a4ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:10.280630 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2b229-20a9-43f5-a9a2-ad66846a4ff1 admin admin] PATH_INFO: `/v3/projects/010309df038c4ddcae347f81967ee994` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:10.282048 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb2b229-20a9-43f5-a9a2-ad66846a4ff1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=010309df038c4ddcae347f81967ee994)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:10.283609 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-216ff512-5f71-4af8-bd6a-079b6612c8ba admin admin] The token cache is being invalidate because project 3a0440022f8b45a7bbb6e84d3ad45899 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81447) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:30:10.283897 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-216ff512-5f71-4af8-bd6a-079b6612c8ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:10.284081 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb2b229-20a9-43f5-a9a2-ad66846a4ff1 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:10.286698 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-216ff512-5f71-4af8-bd6a-079b6612c8ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:10.293146 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 937/1889] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:30:09 2022] DELETE /identity/v3/projects/3a0440022f8b45a7bbb6e84d3ad45899 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:10.297666 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ff512-5f71-4af8-bd6a-079b6612c8ba admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:10.303197 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-216ff512-5f71-4af8-bd6a-079b6612c8ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:10.353526 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:10.363575 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-cfb2b229-20a9-43f5-a9a2-ad66846a4ff1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '010309df038c4ddcae347f81967ee994', 'request_id': 'req-cfb2b229-20a9-43f5-a9a2-ad66846a4ff1'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:10.373138 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-cfb2b229-20a9-43f5-a9a2-ad66846a4ff1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '010309df038c4ddcae347f81967ee994', 'request_id': 'req-cfb2b229-20a9-43f5-a9a2-ad66846a4ff1'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:10.388701 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-cfb2b229-20a9-43f5-a9a2-ad66846a4ff1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '010309df038c4ddcae347f81967ee994', 'request_id': 'req-cfb2b229-20a9-43f5-a9a2-ad66846a4ff1'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:10.409096 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-cfb2b229-20a9-43f5-a9a2-ad66846a4ff1 admin admin] The token cache is being invalidate because project 010309df038c4ddcae347f81967ee994 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:30:10.409924 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-cfb2b229-20a9-43f5-a9a2-ad66846a4ff1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:10.411767 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-cfb2b229-20a9-43f5-a9a2-ad66846a4ff1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:10.419394 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 953/1890] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:30:10 2022] DELETE /identity/v3/projects/010309df038c4ddcae347f81967ee994 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:10.419394 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07a952-90e5-44ee-ae0c-6b44ca36619b None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:10.419394 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07a952-90e5-44ee-ae0c-6b44ca36619b None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:10.419394 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07a952-90e5-44ee-ae0c-6b44ca36619b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:10.431548 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ff512-5f71-4af8-bd6a-079b6612c8ba admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:10.449467 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-2e07a952-90e5-44ee-ae0c-6b44ca36619b None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:10.450911 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-2e07a952-90e5-44ee-ae0c-6b44ca36619b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:10.499175 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccdeba8-51ed-4bab-b766-112df65ad380 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:10.500024 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccdeba8-51ed-4bab-b766-112df65ad380 service cinder] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:10.500927 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccdeba8-51ed-4bab-b766-112df65ad380 service cinder] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:10.501348 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccdeba8-51ed-4bab-b766-112df65ad380 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:10.504604 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-8ccdeba8-51ed-4bab-b766-112df65ad380 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:10.552218 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 954/1891] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:10.553863 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce3a16-9e24-4c2d-bb75-5c98ba0db088 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:10.554348 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce3a16-9e24-4c2d-bb75-5c98ba0db088 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:10.554803 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce3a16-9e24-4c2d-bb75-5c98ba0db088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:10.582639 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccdeba8-51ed-4bab-b766-112df65ad380 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:10.584014 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-d8ce3a16-9e24-4c2d-bb75-5c98ba0db088 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:10.585206 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccdeba8-51ed-4bab-b766-112df65ad380 service cinder] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:10.585937 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-d8ce3a16-9e24-4c2d-bb75-5c98ba0db088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:10.605440 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 955/1892] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:10.605440 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07125dd5-1919-4141-a1d4-38bb99b70d11 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:10.605440 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07125dd5-1919-4141-a1d4-38bb99b70d11 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:10.605440 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07125dd5-1919-4141-a1d4-38bb99b70d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:10.659859 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 938/1893] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:30:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:30:10.661362 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f74b8a-86e4-4c53-bf18-c1113fb775cf None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:10.661650 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f74b8a-86e4-4c53-bf18-c1113fb775cf None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:10.662193 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f74b8a-86e4-4c53-bf18-c1113fb775cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:10.680911 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-07125dd5-1919-4141-a1d4-38bb99b70d11 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:10.683699 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-07125dd5-1919-4141-a1d4-38bb99b70d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:10.699298 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-e6f74b8a-86e4-4c53-bf18-c1113fb775cf None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:10.700877 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-e6f74b8a-86e4-4c53-bf18-c1113fb775cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:10.704977 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 956/1894] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:10.709140 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07125dd5-1919-4141-a1d4-38bb99b70d11 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:10.716415 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 939/1895] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:10.721099 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f74b8a-86e4-4c53-bf18-c1113fb775cf None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:10.732551 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f74b8a-86e4-4c53-bf18-c1113fb775cf None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:10.733530 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07125dd5-1919-4141-a1d4-38bb99b70d11 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:10.737572 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed8a0a-112c-4c74-8bfb-4f601ad1e11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:10.738305 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed8a0a-112c-4c74-8bfb-4f601ad1e11e admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:10.738589 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed8a0a-112c-4c74-8bfb-4f601ad1e11e admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:10.738862 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed8a0a-112c-4c74-8bfb-4f601ad1e11e admin admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:10.739644 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ed8a0a-112c-4c74-8bfb-4f601ad1e11e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:30:10.739973 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ed8a0a-112c-4c74-8bfb-4f601ad1e11e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:10.742269 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ed8a0a-112c-4c74-8bfb-4f601ad1e11e admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:10.752292 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b281cb76-91ac-4aa8-aecb-20e88d418589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:10.753495 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281cb76-91ac-4aa8-aecb-20e88d418589 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:10.754225 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281cb76-91ac-4aa8-aecb-20e88d418589 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:10.754720 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281cb76-91ac-4aa8-aecb-20e88d418589 admin admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:10.755798 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b281cb76-91ac-4aa8-aecb-20e88d418589 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:30:10.756208 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b281cb76-91ac-4aa8-aecb-20e88d418589 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:10.759350 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 940/1896] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 30 01:30:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:30:10.760282 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed8a0a-112c-4c74-8bfb-4f601ad1e11e admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:10.763020 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b281cb76-91ac-4aa8-aecb-20e88d418589 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:10.773309 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed8a0a-112c-4c74-8bfb-4f601ad1e11e admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:10.779558 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8844de-8359-4cb5-b451-9ebd2faaa080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:10.780338 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8844de-8359-4cb5-b451-9ebd2faaa080 admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:10.780634 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8844de-8359-4cb5-b451-9ebd2faaa080 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:10.780911 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8844de-8359-4cb5-b451-9ebd2faaa080 admin admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:10.782021 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8844de-8359-4cb5-b451-9ebd2faaa080 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:10.783974 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8844de-8359-4cb5-b451-9ebd2faaa080 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:10.787509 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 957/1897] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 30 01:30:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:30:10.789853 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b281cb76-91ac-4aa8-aecb-20e88d418589 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:10.800965 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b281cb76-91ac-4aa8-aecb-20e88d418589 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:10.804709 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:10.806585 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0bf86-9691-406f-9ad2-1926d949200b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:10.807756 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0bf86-9691-406f-9ad2-1926d949200b admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:10.808023 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0bf86-9691-406f-9ad2-1926d949200b admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:10.808449 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0bf86-9691-406f-9ad2-1926d949200b admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:10.809627 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f0bf86-9691-406f-9ad2-1926d949200b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:10.812260 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f0bf86-9691-406f-9ad2-1926d949200b admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:10.824304 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 941/1898] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:30:10 2022] POST /identity/v3/projects => generated 373 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:30:10.828768 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8844de-8359-4cb5-b451-9ebd2faaa080 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:10.857672 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 958/1899] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:30:10 2022] POST /identity/v3/projects => generated 367 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:30:10.858471 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0bf86-9691-406f-9ad2-1926d949200b admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:10.918744 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8844de-8359-4cb5-b451-9ebd2faaa080 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:10.982878 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0bf86-9691-406f-9ad2-1926d949200b admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:10.988054 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4fcba-ec84-43d5-a2df-ac23d39041ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:10.988724 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4fcba-ec84-43d5-a2df-ac23d39041ba admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:10.989008 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4fcba-ec84-43d5-a2df-ac23d39041ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:10.989283 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4fcba-ec84-43d5-a2df-ac23d39041ba admin admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:10.989922 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c4fcba-ec84-43d5-a2df-ac23d39041ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:10.990167 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a7a23-b08d-443d-821d-4cbba587a1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:10.991331 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a7a23-b08d-443d-821d-4cbba587a1c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:10.991656 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a7a23-b08d-443d-821d-4cbba587a1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:10.992125 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a7a23-b08d-443d-821d-4cbba587a1c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:10.992647 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c4fcba-ec84-43d5-a2df-ac23d39041ba admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:10.992759 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85a7a23-b08d-443d-821d-4cbba587a1c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:10.994705 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85a7a23-b08d-443d-821d-4cbba587a1c7 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:11.022465 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 942/1900] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:30:10 2022] POST /identity/v3/users => generated 287 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:30:11.023783 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4fcba-ec84-43d5-a2df-ac23d39041ba admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:11.031517 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 959/1901] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:30:10 2022] POST /identity/v3/users => generated 284 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:30:11.038568 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a7a23-b08d-443d-821d-4cbba587a1c7 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:11.042448 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4fcba-ec84-43d5-a2df-ac23d39041ba admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:11.048823 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581477c7-aab2-4e50-a11b-554821beaf6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:11.049393 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a7a23-b08d-443d-821d-4cbba587a1c7 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:11.049489 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581477c7-aab2-4e50-a11b-554821beaf6b admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:11.049593 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581477c7-aab2-4e50-a11b-554821beaf6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:11.049826 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581477c7-aab2-4e50-a11b-554821beaf6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:11.050521 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581477c7-aab2-4e50-a11b-554821beaf6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:11.052225 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581477c7-aab2-4e50-a11b-554821beaf6b admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:11.055719 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c3b1dc-d1e9-468b-9567-6300b025e229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:11.056317 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c3b1dc-d1e9-468b-9567-6300b025e229 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:11.056707 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c3b1dc-d1e9-468b-9567-6300b025e229 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:11.057099 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c3b1dc-d1e9-468b-9567-6300b025e229 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:11.057648 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c3b1dc-d1e9-468b-9567-6300b025e229 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:11.059342 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c3b1dc-d1e9-468b-9567-6300b025e229 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:11.066035 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 943/1902] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:30:11 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:30:11.066169 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:11.068680 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581477c7-aab2-4e50-a11b-554821beaf6b admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:11.071466 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 960/1903] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:30:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:30:11.074699 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c3b1dc-d1e9-468b-9567-6300b025e229 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:11.079635 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581477c7-aab2-4e50-a11b-554821beaf6b admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:11.085077 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f311c24f-9045-45ea-8d3d-2f0b93bde50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:11.085682 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311c24f-9045-45ea-8d3d-2f0b93bde50d admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:11.085811 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c3b1dc-d1e9-468b-9567-6300b025e229 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:11.085965 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311c24f-9045-45ea-8d3d-2f0b93bde50d admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:11.086495 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311c24f-9045-45ea-8d3d-2f0b93bde50d admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:11.087143 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f311c24f-9045-45ea-8d3d-2f0b93bde50d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:11.088915 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f311c24f-9045-45ea-8d3d-2f0b93bde50d admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:11.090759 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff8fb92-f89d-419a-8ea8-21aad08d6563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:11.091740 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8fb92-f89d-419a-8ea8-21aad08d6563 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:11.092018 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8fb92-f89d-419a-8ea8-21aad08d6563 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:11.092286 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8fb92-f89d-419a-8ea8-21aad08d6563 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:11.092926 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff8fb92-f89d-419a-8ea8-21aad08d6563 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:11.094530 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff8fb92-f89d-419a-8ea8-21aad08d6563 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:11.099903 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 944/1904] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:30:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:30:11.104505 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f311c24f-9045-45ea-8d3d-2f0b93bde50d admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:11.107462 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 961/1905] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:30:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:30:11.109732 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff8fb92-f89d-419a-8ea8-21aad08d6563 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:11.114497 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f311c24f-9045-45ea-8d3d-2f0b93bde50d admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:11.120238 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8214e77-01e5-4e28-ab4a-739b436a2a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:11.120391 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff8fb92-f89d-419a-8ea8-21aad08d6563 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:11.120896 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8214e77-01e5-4e28-ab4a-739b436a2a6b admin admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:11.121179 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8214e77-01e5-4e28-ab4a-739b436a2a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:11.121454 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8214e77-01e5-4e28-ab4a-739b436a2a6b admin admin] PATH_INFO: `/v3/projects/eeffa5b7e8da4c30abc5024b986bd968/users/0a4f4df5233f481393fb28f3316c3b69/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:11.125075 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda007a-2950-474a-9823-4364b9801276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:11.125724 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda007a-2950-474a-9823-4364b9801276 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:11.126057 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda007a-2950-474a-9823-4364b9801276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:11.126275 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda007a-2950-474a-9823-4364b9801276 admin admin] PATH_INFO: `/v3/projects/aa317f9f02484b88979af3077cd8f802/users/94595535866e44d8ac03ebb70c893410/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:11.137512 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8214e77-01e5-4e28-ab4a-739b436a2a6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeffa5b7e8da4c30abc5024b986bd968, user_id=0a4f4df5233f481393fb28f3316c3b69, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:11.140244 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8214e77-01e5-4e28-ab4a-739b436a2a6b admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:11.141379 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dda007a-2950-474a-9823-4364b9801276 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa317f9f02484b88979af3077cd8f802, user_id=94595535866e44d8ac03ebb70c893410, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:11.144157 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dda007a-2950-474a-9823-4364b9801276 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:11.153842 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 945/1906] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:30:11 2022] PUT /identity/v3/projects/eeffa5b7e8da4c30abc5024b986bd968/users/0a4f4df5233f481393fb28f3316c3b69/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:30:11.157452 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 962/1907] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:30:11 2022] PUT /identity/v3/projects/aa317f9f02484b88979af3077cd8f802/users/94595535866e44d8ac03ebb70c893410/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:11.167007 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55002300-0a8d-4295-a0f5-cc617b119e84 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:11.167300 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55002300-0a8d-4295-a0f5-cc617b119e84 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:11.167614 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55002300-0a8d-4295-a0f5-cc617b119e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:11.167792 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27feeb37-534d-4999-ba95-b2b1c0c41658 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:11.168079 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27feeb37-534d-4999-ba95-b2b1c0c41658 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:11.168355 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27feeb37-534d-4999-ba95-b2b1c0c41658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:11.196084 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-55002300-0a8d-4295-a0f5-cc617b119e84 None None] MFA Rules not processed for user `0a4f4df5233f481393fb28f3316c3b69`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:11.196612 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-27feeb37-534d-4999-ba95-b2b1c0c41658 None None] MFA Rules not processed for user `94595535866e44d8ac03ebb70c893410`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:11.197311 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-55002300-0a8d-4295-a0f5-cc617b119e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:11.197799 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-27feeb37-534d-4999-ba95-b2b1c0c41658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:11.231833 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:11.269505 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 963/1908] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:30:11.273896 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27feeb37-534d-4999-ba95-b2b1c0c41658 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:11.277010 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 946/1909] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:11.289525 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55002300-0a8d-4295-a0f5-cc617b119e84 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:11.357449 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27feeb37-534d-4999-ba95-b2b1c0c41658 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:11.361625 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55002300-0a8d-4295-a0f5-cc617b119e84 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:11.362020 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc1121-5a04-4334-9eaa-160673a99e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:11.362685 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc1121-5a04-4334-9eaa-160673a99e84 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:11.362905 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc1121-5a04-4334-9eaa-160673a99e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:11.363238 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc1121-5a04-4334-9eaa-160673a99e84 admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:11.363848 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dc1121-5a04-4334-9eaa-160673a99e84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:11.367270 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dc1121-5a04-4334-9eaa-160673a99e84 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:11.368426 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c8f74e-1ca0-4242-a7be-1628007be6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:11.369042 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8f74e-1ca0-4242-a7be-1628007be6b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:11.369389 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8f74e-1ca0-4242-a7be-1628007be6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:11.369731 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8f74e-1ca0-4242-a7be-1628007be6b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:11.370910 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c8f74e-1ca0-4242-a7be-1628007be6b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:11.372513 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c8f74e-1ca0-4242-a7be-1628007be6b6 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:11.401634 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 964/1910] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:30:11 2022] POST /identity/v3/projects => generated 365 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:30:11.405582 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc1121-5a04-4334-9eaa-160673a99e84 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:11.412029 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 947/1911] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:30:11 2022] POST /identity/v3/projects => generated 375 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:30:11.413595 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c8f74e-1ca0-4242-a7be-1628007be6b6 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:11.515376 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:11.534471 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c8f74e-1ca0-4242-a7be-1628007be6b6 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:11.550001 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1991d9d1-466b-49ad-98da-8c443b04a16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:11.550643 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991d9d1-466b-49ad-98da-8c443b04a16e admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:11.553169 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991d9d1-466b-49ad-98da-8c443b04a16e admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:11.553529 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991d9d1-466b-49ad-98da-8c443b04a16e admin admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:11.557413 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1991d9d1-466b-49ad-98da-8c443b04a16e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:11.560275 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1991d9d1-466b-49ad-98da-8c443b04a16e admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:11.575384 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc1121-5a04-4334-9eaa-160673a99e84 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:11.606347 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 948/1912] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:30:11 2022] POST /identity/v3/users => generated 294 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:30:11.606617 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702956c-9ce5-4de5-bee5-e3633ca6a492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:11.606617 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702956c-9ce5-4de5-bee5-e3633ca6a492 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:11.606617 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702956c-9ce5-4de5-bee5-e3633ca6a492 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:11.606617 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702956c-9ce5-4de5-bee5-e3633ca6a492 admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:11.606891 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e702956c-9ce5-4de5-bee5-e3633ca6a492 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:11.607584 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1991d9d1-466b-49ad-98da-8c443b04a16e admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:11.614175 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e702956c-9ce5-4de5-bee5-e3633ca6a492 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:11.621515 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1991d9d1-466b-49ad-98da-8c443b04a16e admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:11.636444 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ef255-7677-4710-bbd3-d7ecb7eb3ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:11.637158 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ef255-7677-4710-bbd3-d7ecb7eb3ff4 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:11.637505 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ef255-7677-4710-bbd3-d7ecb7eb3ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:11.637834 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ef255-7677-4710-bbd3-d7ecb7eb3ff4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:11.638592 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62ef255-7677-4710-bbd3-d7ecb7eb3ff4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:11.640369 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62ef255-7677-4710-bbd3-d7ecb7eb3ff4 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:11.660559 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 949/1913] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:30:11 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:30:11.664348 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ef255-7677-4710-bbd3-d7ecb7eb3ff4 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:11.664772 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 965/1914] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:30:11 2022] POST /identity/v3/users => generated 289 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:30:11.665769 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702956c-9ce5-4de5-bee5-e3633ca6a492 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:11.677432 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ef255-7677-4710-bbd3-d7ecb7eb3ff4 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:11.683241 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46774c73-03eb-488f-9deb-f370b61e79b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:11.684039 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46774c73-03eb-488f-9deb-f370b61e79b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:11.684363 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46774c73-03eb-488f-9deb-f370b61e79b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:11.684630 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46774c73-03eb-488f-9deb-f370b61e79b3 admin admin] PATH_INFO: `/v3/projects/370ca26f0e7a4ddd91ec2fef108f6ea6/users/42df6d51c695425aae22331a09f18f0a/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:11.687040 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702956c-9ce5-4de5-bee5-e3633ca6a492 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:11.700523 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e4737-5b8f-4be9-b360-9cf0f9dbc9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:11.701713 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e4737-5b8f-4be9-b360-9cf0f9dbc9b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:11.703186 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e4737-5b8f-4be9-b360-9cf0f9dbc9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:11.703560 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e4737-5b8f-4be9-b360-9cf0f9dbc9b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:11.705397 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437e4737-5b8f-4be9-b360-9cf0f9dbc9b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:11.707123 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437e4737-5b8f-4be9-b360-9cf0f9dbc9b6 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:11.707249 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46774c73-03eb-488f-9deb-f370b61e79b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=370ca26f0e7a4ddd91ec2fef108f6ea6, user_id=42df6d51c695425aae22331a09f18f0a, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:11.711055 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46774c73-03eb-488f-9deb-f370b61e79b3 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:11.735778 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 950/1915] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:30:11 2022] PUT /identity/v3/projects/370ca26f0e7a4ddd91ec2fef108f6ea6/users/42df6d51c695425aae22331a09f18f0a/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:11.736720 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 966/1916] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:30:11 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:30:11.740491 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46774c73-03eb-488f-9deb-f370b61e79b3 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:11.743116 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e4737-5b8f-4be9-b360-9cf0f9dbc9b6 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:11.755916 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:11.767235 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e4737-5b8f-4be9-b360-9cf0f9dbc9b6 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:11.859640 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46774c73-03eb-488f-9deb-f370b61e79b3 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:11.863313 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca0b3e9-9594-4663-9533-dcf62ff90ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:11.863950 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0b3e9-9594-4663-9533-dcf62ff90ba5 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:11.864299 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0b3e9-9594-4663-9533-dcf62ff90ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:11.864698 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0b3e9-9594-4663-9533-dcf62ff90ba5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:11.865217 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca0b3e9-9594-4663-9533-dcf62ff90ba5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:11.866892 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca0b3e9-9594-4663-9533-dcf62ff90ba5 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:11.872465 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aaec7c-0cf8-4d31-9b58-4384ff9fa451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:11.873307 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aaec7c-0cf8-4d31-9b58-4384ff9fa451 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:11.873702 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aaec7c-0cf8-4d31-9b58-4384ff9fa451 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:11.874042 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aaec7c-0cf8-4d31-9b58-4384ff9fa451 admin admin] PATH_INFO: `/v3/projects/ce47bfbc294b445aa7e6b3d46bdea88e/users/1a35b336b26043dcb78baa7bda80bb25/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:11.884084 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 951/1917] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:30:11 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:30:11.888310 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca0b3e9-9594-4663-9533-dcf62ff90ba5 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:11.894792 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aaec7c-0cf8-4d31-9b58-4384ff9fa451 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce47bfbc294b445aa7e6b3d46bdea88e, user_id=1a35b336b26043dcb78baa7bda80bb25, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:11.899848 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aaec7c-0cf8-4d31-9b58-4384ff9fa451 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:11.906823 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca0b3e9-9594-4663-9533-dcf62ff90ba5 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:11.917760 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8903ccdb-e74f-4163-ad9d-39c8592f95f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:11.918364 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903ccdb-e74f-4163-ad9d-39c8592f95f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:11.918646 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903ccdb-e74f-4163-ad9d-39c8592f95f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:11.918916 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903ccdb-e74f-4163-ad9d-39c8592f95f8 admin admin] PATH_INFO: `/v3/projects/370ca26f0e7a4ddd91ec2fef108f6ea6/users/42df6d51c695425aae22331a09f18f0a/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:11.928997 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 967/1918] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:30:11 2022] PUT /identity/v3/projects/ce47bfbc294b445aa7e6b3d46bdea88e/users/1a35b336b26043dcb78baa7bda80bb25/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:11.929154 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8903ccdb-e74f-4163-ad9d-39c8592f95f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=370ca26f0e7a4ddd91ec2fef108f6ea6, user_id=42df6d51c695425aae22331a09f18f0a, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:11.930439 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aaec7c-0cf8-4d31-9b58-4384ff9fa451 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:11.931491 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8903ccdb-e74f-4163-ad9d-39c8592f95f8 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:11.957192 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 952/1919] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:30:11 2022] PUT /identity/v3/projects/370ca26f0e7a4ddd91ec2fef108f6ea6/users/42df6d51c695425aae22331a09f18f0a/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:30:11.968688 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704853f3-d2be-4096-93c9-fb5cfd4af964 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:11.969502 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704853f3-d2be-4096-93c9-fb5cfd4af964 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:11.969502 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704853f3-d2be-4096-93c9-fb5cfd4af964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:12.014945 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-704853f3-d2be-4096-93c9-fb5cfd4af964 None None] MFA Rules not processed for user `42df6d51c695425aae22331a09f18f0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:12.021572 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-704853f3-d2be-4096-93c9-fb5cfd4af964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:12.025608 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aaec7c-0cf8-4d31-9b58-4384ff9fa451 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:12.091161 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:12.106993 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b02740-0ece-44c2-b0e1-2e2f5609e38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:12.107843 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b02740-0ece-44c2-b0e1-2e2f5609e38d admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:12.108006 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b02740-0ece-44c2-b0e1-2e2f5609e38d admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:12.108402 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b02740-0ece-44c2-b0e1-2e2f5609e38d admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:12.109591 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b02740-0ece-44c2-b0e1-2e2f5609e38d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:12.112095 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b02740-0ece-44c2-b0e1-2e2f5609e38d admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:12.138055 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 968/1920] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:30:11 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:30:12.144493 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b02740-0ece-44c2-b0e1-2e2f5609e38d admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:12.162699 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b02740-0ece-44c2-b0e1-2e2f5609e38d admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:12.164515 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 953/1921] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:11 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:30:12.178027 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704853f3-d2be-4096-93c9-fb5cfd4af964 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:12.179739 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-704853f3-d2be-4096-93c9-fb5cfd4af964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:12.183329 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ba50b6-18f1-4a48-8df0-d3367e94d22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:12.184232 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba50b6-18f1-4a48-8df0-d3367e94d22f admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:12.184514 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba50b6-18f1-4a48-8df0-d3367e94d22f admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:12.184781 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba50b6-18f1-4a48-8df0-d3367e94d22f admin admin] PATH_INFO: `/v3/projects/ce47bfbc294b445aa7e6b3d46bdea88e/users/1a35b336b26043dcb78baa7bda80bb25/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:12.187732 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ba50b6-18f1-4a48-8df0-d3367e94d22f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce47bfbc294b445aa7e6b3d46bdea88e, user_id=1a35b336b26043dcb78baa7bda80bb25, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:12.196162 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ba50b6-18f1-4a48-8df0-d3367e94d22f admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:12.216463 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 969/1922] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:30:12 2022] PUT /identity/v3/projects/ce47bfbc294b445aa7e6b3d46bdea88e/users/1a35b336b26043dcb78baa7bda80bb25/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:30:12.229021 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970547e1-b6d1-40d5-8f78-f9e6c51289ab None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:12.229382 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970547e1-b6d1-40d5-8f78-f9e6c51289ab None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:12.230343 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970547e1-b6d1-40d5-8f78-f9e6c51289ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:12.258291 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704853f3-d2be-4096-93c9-fb5cfd4af964 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:12.272062 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-970547e1-b6d1-40d5-8f78-f9e6c51289ab None None] MFA Rules not processed for user `1a35b336b26043dcb78baa7bda80bb25`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:12.273485 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-970547e1-b6d1-40d5-8f78-f9e6c51289ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:12.301223 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:12.321616 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047dfcd2-50d2-4f77-8967-186837421713 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:12.322238 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047dfcd2-50d2-4f77-8967-186837421713 service cinder] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:12.322518 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047dfcd2-50d2-4f77-8967-186837421713 service cinder] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:12.322798 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047dfcd2-50d2-4f77-8967-186837421713 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:12.361100 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 970/1923] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:12 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:30:12.397652 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047dfcd2-50d2-4f77-8967-186837421713 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:12.399703 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047dfcd2-50d2-4f77-8967-186837421713 service cinder] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:12.410162 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 954/1924] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:30:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:30:12.552605 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970547e1-b6d1-40d5-8f78-f9e6c51289ab None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:12.555241 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-970547e1-b6d1-40d5-8f78-f9e6c51289ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:12.574085 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970547e1-b6d1-40d5-8f78-f9e6c51289ab None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:12.585600 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433f975b-deb4-4a2e-a9da-80e76b2ea880 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:12.586497 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f975b-deb4-4a2e-a9da-80e76b2ea880 service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:12.586785 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f975b-deb4-4a2e-a9da-80e76b2ea880 service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:12.600923 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f975b-deb4-4a2e-a9da-80e76b2ea880 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:12.628787 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433f975b-deb4-4a2e-a9da-80e76b2ea880 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:12.630253 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433f975b-deb4-4a2e-a9da-80e76b2ea880 service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:12.674498 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 971/1925] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:30:12 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:30:12.872736 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047dfcd2-50d2-4f77-8967-186837421713 service cinder] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:12.885874 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047dfcd2-50d2-4f77-8967-186837421713 service cinder] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:12.893091 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4786145-2cc5-4507-b11a-c01e4387761e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:12.894083 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4786145-2cc5-4507-b11a-c01e4387761e service cinder] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:12.894521 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4786145-2cc5-4507-b11a-c01e4387761e service cinder] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:12.894921 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4786145-2cc5-4507-b11a-c01e4387761e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:13.006704 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4786145-2cc5-4507-b11a-c01e4387761e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:13.008666 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4786145-2cc5-4507-b11a-c01e4387761e service cinder] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:13.022819 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 955/1926] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:30:12 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:30:13.796520 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433f975b-deb4-4a2e-a9da-80e76b2ea880 service cinder] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:13.798028 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-433f975b-deb4-4a2e-a9da-80e76b2ea880 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:13.882127 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433f975b-deb4-4a2e-a9da-80e76b2ea880 service cinder] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:13.886762 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a4f313-d149-4471-b183-4f203f5cbb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:13.887609 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a4f313-d149-4471-b183-4f203f5cbb70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:13.887901 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a4f313-d149-4471-b183-4f203f5cbb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:13.888139 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a4f313-d149-4471-b183-4f203f5cbb70 admin admin] PATH_INFO: `/v3/users/73824b2a0eb144ba9b8a6743c443cd3d` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:13.889298 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a4f313-d149-4471-b183-4f203f5cbb70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73824b2a0eb144ba9b8a6743c443cd3d)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:13.891279 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a4f313-d149-4471-b183-4f203f5cbb70 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:13.951545 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:13.954037 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-d3a4f313-d149-4471-b183-4f203f5cbb70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73824b2a0eb144ba9b8a6743c443cd3d'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:13.965608 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-d3a4f313-d149-4471-b183-4f203f5cbb70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73824b2a0eb144ba9b8a6743c443cd3d'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:13.966675 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-d3a4f313-d149-4471-b183-4f203f5cbb70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73824b2a0eb144ba9b8a6743c443cd3d'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:13.986940 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-d3a4f313-d149-4471-b183-4f203f5cbb70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73824b2a0eb144ba9b8a6743c443cd3d'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:13.988668 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-d3a4f313-d149-4471-b183-4f203f5cbb70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73824b2a0eb144ba9b8a6743c443cd3d'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:14.006253 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 972/1927] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:30:13 2022] DELETE /identity/v3/users/73824b2a0eb144ba9b8a6743c443cd3d => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:14.010981 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378894e9-222d-4b1b-9dcb-16034eb389b5 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:14.011530 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378894e9-222d-4b1b-9dcb-16034eb389b5 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:14.012158 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378894e9-222d-4b1b-9dcb-16034eb389b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:14.032732 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-378894e9-222d-4b1b-9dcb-16034eb389b5 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:14.034271 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-378894e9-222d-4b1b-9dcb-16034eb389b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:14.110360 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 956/1928] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:14.131384 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a4f313-d149-4471-b183-4f203f5cbb70 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:14.137568 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-d3a4f313-d149-4471-b183-4f203f5cbb70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:14.208704 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a4f313-d149-4471-b183-4f203f5cbb70 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:14.212586 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea452fd-54c9-4f47-a49b-fefedd9aaf11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:14.213187 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea452fd-54c9-4f47-a49b-fefedd9aaf11 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:14.213564 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea452fd-54c9-4f47-a49b-fefedd9aaf11 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:14.213850 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea452fd-54c9-4f47-a49b-fefedd9aaf11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:14.223222 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea452fd-54c9-4f47-a49b-fefedd9aaf11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:14.224709 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea452fd-54c9-4f47-a49b-fefedd9aaf11 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:14.235880 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 973/1929] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:30:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:30:14.949340 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f218e-5dc5-4582-9360-45f9fe02fee7 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:14.949675 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f218e-5dc5-4582-9360-45f9fe02fee7 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:14.949905 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f218e-5dc5-4582-9360-45f9fe02fee7 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:14.951497 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 957/1930] 10.222.0.60 () {54 vars in 921 bytes} [Tue Aug 30 01:30:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:30:14.979630 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5957e-0d2c-45bd-a3ca-c3bca0cdf0cc None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:14.980697 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5957e-0d2c-45bd-a3ca-c3bca0cdf0cc None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:14.981551 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5957e-0d2c-45bd-a3ca-c3bca0cdf0cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:15.018544 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-f3b5957e-0d2c-45bd-a3ca-c3bca0cdf0cc None None] MFA Rules not processed for user `8889145228a24fb6bd539a11925e62f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:15.024697 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54f218e-5dc5-4582-9360-45f9fe02fee7 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:15.027408 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-d54f218e-5dc5-4582-9360-45f9fe02fee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:15.037717 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-f3b5957e-0d2c-45bd-a3ca-c3bca0cdf0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:15.060605 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54f218e-5dc5-4582-9360-45f9fe02fee7 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:15.071091 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b4699-3e80-46aa-aefc-d35759514e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:15.071937 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b4699-3e80-46aa-aefc-d35759514e03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:15.072393 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b4699-3e80-46aa-aefc-d35759514e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:15.072854 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b4699-3e80-46aa-aefc-d35759514e03 admin admin] PATH_INFO: `/v3/projects/3fdca87c008e498c90648ea003012a4a` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:15.077676 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004b4699-3e80-46aa-aefc-d35759514e03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fdca87c008e498c90648ea003012a4a)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:15.080883 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004b4699-3e80-46aa-aefc-d35759514e03 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:15.138064 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:15.164118 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 974/1931] 10.222.0.60 () {58 vars in 1018 bytes} [Tue Aug 30 01:30:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:15.177324 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-004b4699-3e80-46aa-aefc-d35759514e03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fdca87c008e498c90648ea003012a4a', 'request_id': 'req-004b4699-3e80-46aa-aefc-d35759514e03'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:15.188846 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-004b4699-3e80-46aa-aefc-d35759514e03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fdca87c008e498c90648ea003012a4a', 'request_id': 'req-004b4699-3e80-46aa-aefc-d35759514e03'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:15.199035 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b5957e-0d2c-45bd-a3ca-c3bca0cdf0cc None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:15.200780 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-f3b5957e-0d2c-45bd-a3ca-c3bca0cdf0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:15.206958 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-004b4699-3e80-46aa-aefc-d35759514e03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fdca87c008e498c90648ea003012a4a', 'request_id': 'req-004b4699-3e80-46aa-aefc-d35759514e03'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:15.223345 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-004b4699-3e80-46aa-aefc-d35759514e03 admin admin] The token cache is being invalidate because project 3fdca87c008e498c90648ea003012a4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81447) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:30:15.227752 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-004b4699-3e80-46aa-aefc-d35759514e03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:15.228622 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-004b4699-3e80-46aa-aefc-d35759514e03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:15.230458 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b5957e-0d2c-45bd-a3ca-c3bca0cdf0cc None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:15.233336 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 958/1932] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:30:15 2022] DELETE /identity/v3/projects/3fdca87c008e498c90648ea003012a4a => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:15.237111 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b4699-3e80-46aa-aefc-d35759514e03 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:15.238539 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-004b4699-3e80-46aa-aefc-d35759514e03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:15.355858 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:15.384231 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4416256a-f3b4-4c75-9c15-defcf9f34318 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8889145228a24fb6bd539a11925e62f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:15.384852 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416256a-f3b4-4c75-9c15-defcf9f34318 service nova] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:15.385129 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416256a-f3b4-4c75-9c15-defcf9f34318 service nova] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:15.385397 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416256a-f3b4-4c75-9c15-defcf9f34318 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:15.392295 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-4416256a-f3b4-4c75-9c15-defcf9f34318 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:15.413064 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4416256a-f3b4-4c75-9c15-defcf9f34318 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:15.413295 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b4699-3e80-46aa-aefc-d35759514e03 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:15.414041 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4416256a-f3b4-4c75-9c15-defcf9f34318 service nova] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:15.426770 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab9f36c-4aba-4f8d-bfe9-2d54ab3c0fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:15.427159 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 975/1933] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:30:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:30:15.427470 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9f36c-4aba-4f8d-bfe9-2d54ab3c0fce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:15.427746 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9f36c-4aba-4f8d-bfe9-2d54ab3c0fce admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:15.428025 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9f36c-4aba-4f8d-bfe9-2d54ab3c0fce admin admin] PATH_INFO: `/v3/users/5111602b996a4e879f1faf826a90562b` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:15.428874 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4416256a-f3b4-4c75-9c15-defcf9f34318 service nova] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:15.431009 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-4416256a-f3b4-4c75-9c15-defcf9f34318 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:15.435078 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab9f36c-4aba-4f8d-bfe9-2d54ab3c0fce admin admin] RBAC: Authorizing `identity:delete_user(user_id=5111602b996a4e879f1faf826a90562b)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:15.438241 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab9f36c-4aba-4f8d-bfe9-2d54ab3c0fce admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:15.460035 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4416256a-f3b4-4c75-9c15-defcf9f34318 service nova] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:15.477888 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d46fac-1e17-4fa6-a65f-1990ed5b348a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:15.479005 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d46fac-1e17-4fa6-a65f-1990ed5b348a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:15.480423 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d46fac-1e17-4fa6-a65f-1990ed5b348a admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:15.480713 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d46fac-1e17-4fa6-a65f-1990ed5b348a admin admin] PATH_INFO: `/v3/users/0a4f4df5233f481393fb28f3316c3b69` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:15.485589 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d46fac-1e17-4fa6-a65f-1990ed5b348a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a4f4df5233f481393fb28f3316c3b69)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:15.494827 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d46fac-1e17-4fa6-a65f-1990ed5b348a admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:15.520929 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-9ab9f36c-4aba-4f8d-bfe9-2d54ab3c0fce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5111602b996a4e879f1faf826a90562b'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:15.533402 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-9ab9f36c-4aba-4f8d-bfe9-2d54ab3c0fce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5111602b996a4e879f1faf826a90562b'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:15.534321 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-9ab9f36c-4aba-4f8d-bfe9-2d54ab3c0fce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5111602b996a4e879f1faf826a90562b'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:15.535271 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-9ab9f36c-4aba-4f8d-bfe9-2d54ab3c0fce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5111602b996a4e879f1faf826a90562b'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:15.580456 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-9ab9f36c-4aba-4f8d-bfe9-2d54ab3c0fce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5111602b996a4e879f1faf826a90562b'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:15.603907 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-68d46fac-1e17-4fa6-a65f-1990ed5b348a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a4f4df5233f481393fb28f3316c3b69'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:15.608114 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 959/1934] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:30:15 2022] DELETE /identity/v3/users/5111602b996a4e879f1faf826a90562b => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:30:15.633248 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-68d46fac-1e17-4fa6-a65f-1990ed5b348a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a4f4df5233f481393fb28f3316c3b69'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:15.634163 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-68d46fac-1e17-4fa6-a65f-1990ed5b348a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a4f4df5233f481393fb28f3316c3b69'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:15.654167 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-68d46fac-1e17-4fa6-a65f-1990ed5b348a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a4f4df5233f481393fb28f3316c3b69'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:15.655057 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-68d46fac-1e17-4fa6-a65f-1990ed5b348a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a4f4df5233f481393fb28f3316c3b69'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:15.675979 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 976/1935] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:30:15 2022] DELETE /identity/v3/users/0a4f4df5233f481393fb28f3316c3b69 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:15.677730 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1122277-7bff-4440-aaf7-70e9b415a29d None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:15.678019 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1122277-7bff-4440-aaf7-70e9b415a29d None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:15.678870 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1122277-7bff-4440-aaf7-70e9b415a29d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:15.703982 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-b1122277-7bff-4440-aaf7-70e9b415a29d None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:15.705333 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-b1122277-7bff-4440-aaf7-70e9b415a29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:15.743861 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:15.783984 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 960/1936] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:15.811275 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d46fac-1e17-4fa6-a65f-1990ed5b348a admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:15.813142 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-68d46fac-1e17-4fa6-a65f-1990ed5b348a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:15.920862 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d46fac-1e17-4fa6-a65f-1990ed5b348a admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:15.924796 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd8b094-38a9-4840-8c38-c59ac3bfa74b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:15.925256 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8b094-38a9-4840-8c38-c59ac3bfa74b service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:15.925538 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8b094-38a9-4840-8c38-c59ac3bfa74b service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:15.925812 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8b094-38a9-4840-8c38-c59ac3bfa74b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:15.937886 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd8b094-38a9-4840-8c38-c59ac3bfa74b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:15.940096 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd8b094-38a9-4840-8c38-c59ac3bfa74b service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:15.953123 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 977/1937] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:30:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:30:16.551872 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1122277-7bff-4440-aaf7-70e9b415a29d None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:16.554267 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-b1122277-7bff-4440-aaf7-70e9b415a29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:16.579611 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1122277-7bff-4440-aaf7-70e9b415a29d None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:16.599016 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1ad7cc-14ea-45d7-97fc-3bce4ed80fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:16.600624 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ad7cc-14ea-45d7-97fc-3bce4ed80fca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:16.601114 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ad7cc-14ea-45d7-97fc-3bce4ed80fca admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:16.601694 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ad7cc-14ea-45d7-97fc-3bce4ed80fca admin admin] PATH_INFO: `/v3/projects/71c63ea66de44fa28ea950ed6ca135e8` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:16.603116 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1ad7cc-14ea-45d7-97fc-3bce4ed80fca admin admin] RBAC: Authorizing `identity:delete_project(project_id=71c63ea66de44fa28ea950ed6ca135e8)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:16.605866 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1ad7cc-14ea-45d7-97fc-3bce4ed80fca admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:16.735757 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-dc1ad7cc-14ea-45d7-97fc-3bce4ed80fca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71c63ea66de44fa28ea950ed6ca135e8', 'request_id': 'req-dc1ad7cc-14ea-45d7-97fc-3bce4ed80fca'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:16.747496 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-dc1ad7cc-14ea-45d7-97fc-3bce4ed80fca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71c63ea66de44fa28ea950ed6ca135e8', 'request_id': 'req-dc1ad7cc-14ea-45d7-97fc-3bce4ed80fca'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:16.758229 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-dc1ad7cc-14ea-45d7-97fc-3bce4ed80fca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71c63ea66de44fa28ea950ed6ca135e8', 'request_id': 'req-dc1ad7cc-14ea-45d7-97fc-3bce4ed80fca'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:16.773836 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-dc1ad7cc-14ea-45d7-97fc-3bce4ed80fca admin admin] The token cache is being invalidate because project 71c63ea66de44fa28ea950ed6ca135e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81447) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:30:16.774540 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-dc1ad7cc-14ea-45d7-97fc-3bce4ed80fca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:16.775670 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-dc1ad7cc-14ea-45d7-97fc-3bce4ed80fca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:16.777623 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 961/1938] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:30:16 2022] DELETE /identity/v3/projects/71c63ea66de44fa28ea950ed6ca135e8 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:16.782835 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83ebf3-432f-4315-ab03-99c5943d7d58 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:16.783825 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83ebf3-432f-4315-ab03-99c5943d7d58 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:16.784254 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83ebf3-432f-4315-ab03-99c5943d7d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:16.828365 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1ad7cc-14ea-45d7-97fc-3bce4ed80fca admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:16.829907 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-dc1ad7cc-14ea-45d7-97fc-3bce4ed80fca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:16.832805 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-ef83ebf3-432f-4315-ab03-99c5943d7d58 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:16.836057 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-ef83ebf3-432f-4315-ab03-99c5943d7d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:16.938031 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:16.953981 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 978/1939] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:16.962597 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec6783-dcef-4436-8b2b-a2e08a35ac29 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:16.962911 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec6783-dcef-4436-8b2b-a2e08a35ac29 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:16.963261 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec6783-dcef-4436-8b2b-a2e08a35ac29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:16.967251 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1ad7cc-14ea-45d7-97fc-3bce4ed80fca admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:16.977101 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229064f3-5b1a-4b77-a780-bda0b6a0d00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:16.977762 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229064f3-5b1a-4b77-a780-bda0b6a0d00c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:16.978388 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229064f3-5b1a-4b77-a780-bda0b6a0d00c admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:16.978669 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229064f3-5b1a-4b77-a780-bda0b6a0d00c admin admin] PATH_INFO: `/v3/projects/eeffa5b7e8da4c30abc5024b986bd968` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:16.981123 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229064f3-5b1a-4b77-a780-bda0b6a0d00c admin admin] RBAC: Authorizing `identity:delete_project(project_id=eeffa5b7e8da4c30abc5024b986bd968)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:16.995131 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-10ec6783-dcef-4436-8b2b-a2e08a35ac29 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:16.997332 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-10ec6783-dcef-4436-8b2b-a2e08a35ac29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:16.997734 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229064f3-5b1a-4b77-a780-bda0b6a0d00c admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:17.012593 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 979/1940] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:30:17.013456 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec6783-dcef-4436-8b2b-a2e08a35ac29 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:17.022618 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec6783-dcef-4436-8b2b-a2e08a35ac29 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:17.029656 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96422a5e-5cb4-4b22-be3d-5b59d6283ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:17.030281 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96422a5e-5cb4-4b22-be3d-5b59d6283ccc admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:17.030559 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96422a5e-5cb4-4b22-be3d-5b59d6283ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:17.030826 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96422a5e-5cb4-4b22-be3d-5b59d6283ccc admin admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:17.031521 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96422a5e-5cb4-4b22-be3d-5b59d6283ccc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:30:17.031827 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96422a5e-5cb4-4b22-be3d-5b59d6283ccc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:17.033460 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96422a5e-5cb4-4b22-be3d-5b59d6283ccc admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:17.054822 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 980/1941] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 30 01:30:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:30:17.061939 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96422a5e-5cb4-4b22-be3d-5b59d6283ccc admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:17.081086 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-229064f3-5b1a-4b77-a780-bda0b6a0d00c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eeffa5b7e8da4c30abc5024b986bd968', 'request_id': 'req-229064f3-5b1a-4b77-a780-bda0b6a0d00c'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:17.093500 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96422a5e-5cb4-4b22-be3d-5b59d6283ccc admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:17.095948 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-229064f3-5b1a-4b77-a780-bda0b6a0d00c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eeffa5b7e8da4c30abc5024b986bd968', 'request_id': 'req-229064f3-5b1a-4b77-a780-bda0b6a0d00c'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:17.104063 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:17.118587 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-229064f3-5b1a-4b77-a780-bda0b6a0d00c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eeffa5b7e8da4c30abc5024b986bd968', 'request_id': 'req-229064f3-5b1a-4b77-a780-bda0b6a0d00c'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:17.144664 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-229064f3-5b1a-4b77-a780-bda0b6a0d00c admin admin] The token cache is being invalidate because project eeffa5b7e8da4c30abc5024b986bd968 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81447) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:30:17.144969 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-229064f3-5b1a-4b77-a780-bda0b6a0d00c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:17.146999 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-229064f3-5b1a-4b77-a780-bda0b6a0d00c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:17.152388 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 962/1942] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:30:16 2022] DELETE /identity/v3/projects/eeffa5b7e8da4c30abc5024b986bd968 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:17.160603 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229064f3-5b1a-4b77-a780-bda0b6a0d00c admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:17.161941 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-229064f3-5b1a-4b77-a780-bda0b6a0d00c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:17.212229 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc70597-6bcc-4cda-b807-6103362a3452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:17.213754 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc70597-6bcc-4cda-b807-6103362a3452 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:17.214896 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc70597-6bcc-4cda-b807-6103362a3452 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:17.215405 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc70597-6bcc-4cda-b807-6103362a3452 admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:17.216479 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc70597-6bcc-4cda-b807-6103362a3452 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:17.220055 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc70597-6bcc-4cda-b807-6103362a3452 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:17.263488 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229064f3-5b1a-4b77-a780-bda0b6a0d00c admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:17.272947 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93151150-217c-4b53-8d56-5d4c04839e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:17.273642 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93151150-217c-4b53-8d56-5d4c04839e5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:17.273973 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93151150-217c-4b53-8d56-5d4c04839e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:17.274254 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93151150-217c-4b53-8d56-5d4c04839e5a admin admin] PATH_INFO: `/v3/users/42df6d51c695425aae22331a09f18f0a` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:17.275813 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93151150-217c-4b53-8d56-5d4c04839e5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=42df6d51c695425aae22331a09f18f0a)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:17.278861 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93151150-217c-4b53-8d56-5d4c04839e5a admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:17.292765 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 981/1943] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:30:17 2022] POST /identity/v3/projects => generated 381 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:30:17.294005 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc70597-6bcc-4cda-b807-6103362a3452 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:17.296888 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-acc70597-6bcc-4cda-b807-6103362a3452 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:17.372455 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-93151150-217c-4b53-8d56-5d4c04839e5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42df6d51c695425aae22331a09f18f0a'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:17.389149 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-93151150-217c-4b53-8d56-5d4c04839e5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42df6d51c695425aae22331a09f18f0a'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:17.389944 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-93151150-217c-4b53-8d56-5d4c04839e5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42df6d51c695425aae22331a09f18f0a'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:17.390668 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-93151150-217c-4b53-8d56-5d4c04839e5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42df6d51c695425aae22331a09f18f0a'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:17.423378 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-93151150-217c-4b53-8d56-5d4c04839e5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42df6d51c695425aae22331a09f18f0a'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:17.457256 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 963/1944] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:30:17 2022] DELETE /identity/v3/users/42df6d51c695425aae22331a09f18f0a => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:17.481693 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc70597-6bcc-4cda-b807-6103362a3452 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:17.566374 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93151150-217c-4b53-8d56-5d4c04839e5a admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:17.568094 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-93151150-217c-4b53-8d56-5d4c04839e5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:17.611055 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d5285-b3f6-4bfe-bd36-c151b017f855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:17.611708 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d5285-b3f6-4bfe-bd36-c151b017f855 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:17.611987 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d5285-b3f6-4bfe-bd36-c151b017f855 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:17.612314 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d5285-b3f6-4bfe-bd36-c151b017f855 admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:17.612884 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468d5285-b3f6-4bfe-bd36-c151b017f855 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:17.621407 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468d5285-b3f6-4bfe-bd36-c151b017f855 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:17.663307 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:17.671609 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 982/1945] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:30:17 2022] POST /identity/v3/users => generated 291 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:30:17.675289 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d5285-b3f6-4bfe-bd36-c151b017f855 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:17.686849 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-468d5285-b3f6-4bfe-bd36-c151b017f855 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:17.696260 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93151150-217c-4b53-8d56-5d4c04839e5a admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:17.706640 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d5285-b3f6-4bfe-bd36-c151b017f855 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:17.713929 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5dd797-f2f9-4869-8bfc-f1153c4dacd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:17.714738 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5dd797-f2f9-4869-8bfc-f1153c4dacd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:17.716513 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5dd797-f2f9-4869-8bfc-f1153c4dacd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:17.716958 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5dd797-f2f9-4869-8bfc-f1153c4dacd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:17.718322 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5dd797-f2f9-4869-8bfc-f1153c4dacd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:17.721426 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5dd797-f2f9-4869-8bfc-f1153c4dacd0 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:17.728580 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62643b9-065d-4911-aca2-fa5b33a0664a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:17.729118 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62643b9-065d-4911-aca2-fa5b33a0664a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:17.729383 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62643b9-065d-4911-aca2-fa5b33a0664a admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:17.729663 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62643b9-065d-4911-aca2-fa5b33a0664a admin admin] PATH_INFO: `/v3/users/ffd15f39b059428089f47a8fcaf39e69` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:17.731084 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62643b9-065d-4911-aca2-fa5b33a0664a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffd15f39b059428089f47a8fcaf39e69)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:17.733231 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62643b9-065d-4911-aca2-fa5b33a0664a admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:17.748872 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:17.754481 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 983/1946] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:30:17 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:30:17.757303 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5dd797-f2f9-4869-8bfc-f1153c4dacd0 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:17.787520 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5dd797-f2f9-4869-8bfc-f1153c4dacd0 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:17.795604 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ecd6b-23be-4734-9271-1e5b5d0f5822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:17.804546 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ecd6b-23be-4734-9271-1e5b5d0f5822 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:17.809395 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ecd6b-23be-4734-9271-1e5b5d0f5822 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:17.809807 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ecd6b-23be-4734-9271-1e5b5d0f5822 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:17.813344 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023ecd6b-23be-4734-9271-1e5b5d0f5822 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:17.815870 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023ecd6b-23be-4734-9271-1e5b5d0f5822 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:17.838523 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-a62643b9-065d-4911-aca2-fa5b33a0664a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffd15f39b059428089f47a8fcaf39e69'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:17.855402 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 984/1947] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:30:17 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:30:17.859827 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ecd6b-23be-4734-9271-1e5b5d0f5822 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:17.860703 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-a62643b9-065d-4911-aca2-fa5b33a0664a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffd15f39b059428089f47a8fcaf39e69'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:17.862633 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-a62643b9-065d-4911-aca2-fa5b33a0664a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffd15f39b059428089f47a8fcaf39e69'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:17.864037 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-a62643b9-065d-4911-aca2-fa5b33a0664a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffd15f39b059428089f47a8fcaf39e69'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:17.865614 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-023ecd6b-23be-4734-9271-1e5b5d0f5822 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:17.889808 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-a62643b9-065d-4911-aca2-fa5b33a0664a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffd15f39b059428089f47a8fcaf39e69'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:17.910596 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 964/1948] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:30:17 2022] DELETE /identity/v3/users/ffd15f39b059428089f47a8fcaf39e69 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:17.912136 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ecd6b-23be-4734-9271-1e5b5d0f5822 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:17.915562 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab2e61-b063-4960-a8d2-5c77ddf1dbb0 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:17.915700 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab2e61-b063-4960-a8d2-5c77ddf1dbb0 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:17.915946 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab2e61-b063-4960-a8d2-5c77ddf1dbb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:17.943115 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-ddab2e61-b063-4960-a8d2-5c77ddf1dbb0 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:17.944538 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-ddab2e61-b063-4960-a8d2-5c77ddf1dbb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:18.023577 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a14eef-ac91-420f-a3e3-0b12553994b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:18.024493 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a14eef-ac91-420f-a3e3-0b12553994b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:18.024843 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a14eef-ac91-420f-a3e3-0b12553994b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:18.025227 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a14eef-ac91-420f-a3e3-0b12553994b1 admin admin] PATH_INFO: `/v3/projects/4a1f569e67f14cde8de0c51666cb20b7/users/44ae74d0146646e99710d253ead17168/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:18.053682 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a14eef-ac91-420f-a3e3-0b12553994b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a1f569e67f14cde8de0c51666cb20b7, user_id=44ae74d0146646e99710d253ead17168, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:18.057000 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 965/1949] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:18.057254 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a14eef-ac91-420f-a3e3-0b12553994b1 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:18.068319 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab2e61-b063-4960-a8d2-5c77ddf1dbb0 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:18.072985 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-ddab2e61-b063-4960-a8d2-5c77ddf1dbb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:18.091494 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 985/1950] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:30:17 2022] PUT /identity/v3/projects/4a1f569e67f14cde8de0c51666cb20b7/users/44ae74d0146646e99710d253ead17168/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:30:18.097050 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb254c-c68f-4c25-b2d2-fd79bc8c62ed None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:18.097561 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb254c-c68f-4c25-b2d2-fd79bc8c62ed None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:18.097971 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb254c-c68f-4c25-b2d2-fd79bc8c62ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:18.139640 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-fadb254c-c68f-4c25-b2d2-fd79bc8c62ed None None] MFA Rules not processed for user `44ae74d0146646e99710d253ead17168`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:18.142161 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-fadb254c-c68f-4c25-b2d2-fd79bc8c62ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:18.182159 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab2e61-b063-4960-a8d2-5c77ddf1dbb0 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:18.252692 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 986/1951] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:18.259087 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb254c-c68f-4c25-b2d2-fd79bc8c62ed None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:18.273893 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:18.296320 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec9def-77a8-4ff4-86f7-5d31fa488254 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:18.297883 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec9def-77a8-4ff4-86f7-5d31fa488254 service neutron] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:18.298173 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec9def-77a8-4ff4-86f7-5d31fa488254 service neutron] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:18.299214 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec9def-77a8-4ff4-86f7-5d31fa488254 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:18.365725 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:18.415234 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb254c-c68f-4c25-b2d2-fd79bc8c62ed None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:18.426564 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b629f-e683-4035-b3f1-60c9347d1a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:18.427796 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b629f-e683-4035-b3f1-60c9347d1a60 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:18.428123 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b629f-e683-4035-b3f1-60c9347d1a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:18.428623 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b629f-e683-4035-b3f1-60c9347d1a60 admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:18.430605 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049b629f-e683-4035-b3f1-60c9347d1a60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:18.438231 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049b629f-e683-4035-b3f1-60c9347d1a60 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:18.540357 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 987/1952] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:30:18 2022] POST /identity/v3/projects => generated 381 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:30:18.541958 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b629f-e683-4035-b3f1-60c9347d1a60 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:18.591756 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cec9def-77a8-4ff4-86f7-5d31fa488254 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:18.594013 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cec9def-77a8-4ff4-86f7-5d31fa488254 service neutron] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:18.608165 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 966/1953] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:30:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:30:18.653649 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec9def-77a8-4ff4-86f7-5d31fa488254 service neutron] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:18.655333 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-9cec9def-77a8-4ff4-86f7-5d31fa488254 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:18.672583 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b629f-e683-4035-b3f1-60c9347d1a60 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:18.678505 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268db9d7-e3ef-4781-b431-3b2aca7f51f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:18.679425 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268db9d7-e3ef-4781-b431-3b2aca7f51f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:18.679819 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec9def-77a8-4ff4-86f7-5d31fa488254 service neutron] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:18.680139 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268db9d7-e3ef-4781-b431-3b2aca7f51f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:18.680678 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268db9d7-e3ef-4781-b431-3b2aca7f51f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:18.681606 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268db9d7-e3ef-4781-b431-3b2aca7f51f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:18.684324 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268db9d7-e3ef-4781-b431-3b2aca7f51f1 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:18.695771 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb90923-f085-4579-8d5e-a9c02e3c0722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:18.697057 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb90923-f085-4579-8d5e-a9c02e3c0722 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:18.697810 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb90923-f085-4579-8d5e-a9c02e3c0722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:18.697810 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb90923-f085-4579-8d5e-a9c02e3c0722 admin admin] PATH_INFO: `/v3/projects/370ca26f0e7a4ddd91ec2fef108f6ea6` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:18.699895 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb90923-f085-4579-8d5e-a9c02e3c0722 admin admin] RBAC: Authorizing `identity:delete_project(project_id=370ca26f0e7a4ddd91ec2fef108f6ea6)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:18.702018 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb90923-f085-4579-8d5e-a9c02e3c0722 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:18.723124 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 988/1954] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:30:18 2022] POST /identity/v3/users => generated 297 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:30:18.727056 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268db9d7-e3ef-4781-b431-3b2aca7f51f1 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:18.738493 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268db9d7-e3ef-4781-b431-3b2aca7f51f1 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:18.760436 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec36b022-92b2-42e6-9c3b-fc64eac8b1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:18.762895 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36b022-92b2-42e6-9c3b-fc64eac8b1d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:18.763410 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36b022-92b2-42e6-9c3b-fc64eac8b1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:18.763971 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36b022-92b2-42e6-9c3b-fc64eac8b1d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:18.764920 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec36b022-92b2-42e6-9c3b-fc64eac8b1d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:18.767457 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec36b022-92b2-42e6-9c3b-fc64eac8b1d4 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:18.781823 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 989/1955] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:30:18.785452 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec36b022-92b2-42e6-9c3b-fc64eac8b1d4 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:18.820974 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec36b022-92b2-42e6-9c3b-fc64eac8b1d4 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:18.832405 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-5bb90923-f085-4579-8d5e-a9c02e3c0722 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '370ca26f0e7a4ddd91ec2fef108f6ea6', 'request_id': 'req-5bb90923-f085-4579-8d5e-a9c02e3c0722'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:18.848272 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-5bb90923-f085-4579-8d5e-a9c02e3c0722 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '370ca26f0e7a4ddd91ec2fef108f6ea6', 'request_id': 'req-5bb90923-f085-4579-8d5e-a9c02e3c0722'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:18.860844 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-5bb90923-f085-4579-8d5e-a9c02e3c0722 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '370ca26f0e7a4ddd91ec2fef108f6ea6', 'request_id': 'req-5bb90923-f085-4579-8d5e-a9c02e3c0722'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:18.892712 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-5bb90923-f085-4579-8d5e-a9c02e3c0722 admin admin] The token cache is being invalidate because project 370ca26f0e7a4ddd91ec2fef108f6ea6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81447) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:30:18.894060 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-5bb90923-f085-4579-8d5e-a9c02e3c0722 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:18.897933 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-5bb90923-f085-4579-8d5e-a9c02e3c0722 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:18.901377 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 967/1956] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:30:18 2022] DELETE /identity/v3/projects/370ca26f0e7a4ddd91ec2fef108f6ea6 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:30:18.906852 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78478f7-98c2-4c35-b878-55dbaf702671 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:18.907271 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78478f7-98c2-4c35-b878-55dbaf702671 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:18.907760 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78478f7-98c2-4c35-b878-55dbaf702671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:18.961534 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4bc092-d5be-4c17-b37e-95b1ba8b2d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:18.962393 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4bc092-d5be-4c17-b37e-95b1ba8b2d89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:18.962818 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4bc092-d5be-4c17-b37e-95b1ba8b2d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:18.963469 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4bc092-d5be-4c17-b37e-95b1ba8b2d89 admin admin] PATH_INFO: `/v3/projects/69921c83ea1749d791f3b9b5ce100559/users/6287c1c2b59244699e88103c0e10943d/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:18.977901 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-f78478f7-98c2-4c35-b878-55dbaf702671 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:18.979271 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-f78478f7-98c2-4c35-b878-55dbaf702671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:18.987312 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4bc092-d5be-4c17-b37e-95b1ba8b2d89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69921c83ea1749d791f3b9b5ce100559, user_id=6287c1c2b59244699e88103c0e10943d, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:18.991884 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4bc092-d5be-4c17-b37e-95b1ba8b2d89 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:19.014160 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 990/1957] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:30:18 2022] PUT /identity/v3/projects/69921c83ea1749d791f3b9b5ce100559/users/6287c1c2b59244699e88103c0e10943d/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:19.017105 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 968/1958] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:19.023986 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4bc092-d5be-4c17-b37e-95b1ba8b2d89 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:19.025956 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de708f9-1190-4ec6-ad6a-451df2ca0308 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:19.026241 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de708f9-1190-4ec6-ad6a-451df2ca0308 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:19.026513 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de708f9-1190-4ec6-ad6a-451df2ca0308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:19.027865 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-8a4bc092-d5be-4c17-b37e-95b1ba8b2d89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:19.098919 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:19.117868 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-6de708f9-1190-4ec6-ad6a-451df2ca0308 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:19.124943 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-6de708f9-1190-4ec6-ad6a-451df2ca0308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:19.222505 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4bc092-d5be-4c17-b37e-95b1ba8b2d89 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:19.251190 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3246f5e2-9e8c-4c31-be71-5a28678b1c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:19.251874 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3246f5e2-9e8c-4c31-be71-5a28678b1c12 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:19.277700 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3246f5e2-9e8c-4c31-be71-5a28678b1c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:19.278013 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3246f5e2-9e8c-4c31-be71-5a28678b1c12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:19.278712 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3246f5e2-9e8c-4c31-be71-5a28678b1c12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:19.280380 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3246f5e2-9e8c-4c31-be71-5a28678b1c12 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:19.322421 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 991/1959] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:30:19 2022] GET /identity/v3/roles => generated 1420 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:30:19.327064 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3246f5e2-9e8c-4c31-be71-5a28678b1c12 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:19.346714 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3246f5e2-9e8c-4c31-be71-5a28678b1c12 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:19.359992 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836e762-79a2-4b2e-b4a1-5fffbdb3ffc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:19.360829 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836e762-79a2-4b2e-b4a1-5fffbdb3ffc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:19.361233 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836e762-79a2-4b2e-b4a1-5fffbdb3ffc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:19.361598 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836e762-79a2-4b2e-b4a1-5fffbdb3ffc2 admin admin] PATH_INFO: `/v3/projects/69921c83ea1749d791f3b9b5ce100559/users/6287c1c2b59244699e88103c0e10943d/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:19.369995 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0836e762-79a2-4b2e-b4a1-5fffbdb3ffc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69921c83ea1749d791f3b9b5ce100559, user_id=6287c1c2b59244699e88103c0e10943d, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:19.376323 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0836e762-79a2-4b2e-b4a1-5fffbdb3ffc2 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:19.408238 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 992/1960] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:30:19 2022] PUT /identity/v3/projects/69921c83ea1749d791f3b9b5ce100559/users/6287c1c2b59244699e88103c0e10943d/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:19.420231 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e803b96-fc0a-432b-8e40-c38caa3ce7d2 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:19.420651 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e803b96-fc0a-432b-8e40-c38caa3ce7d2 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:19.421037 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e803b96-fc0a-432b-8e40-c38caa3ce7d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:19.481406 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-8e803b96-fc0a-432b-8e40-c38caa3ce7d2 None None] MFA Rules not processed for user `6287c1c2b59244699e88103c0e10943d`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:19.482805 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-8e803b96-fc0a-432b-8e40-c38caa3ce7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:19.514918 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 969/1961] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 487 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:19.525463 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de708f9-1190-4ec6-ad6a-451df2ca0308 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:19.552881 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de708f9-1190-4ec6-ad6a-451df2ca0308 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:19.574780 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:19.683403 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 993/1962] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:19 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:30:19.683403 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e803b96-fc0a-432b-8e40-c38caa3ce7d2 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:19.701521 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-8e803b96-fc0a-432b-8e40-c38caa3ce7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:19.820042 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a492a5-ae62-4539-ada9-19a9c64709a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:19.821224 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a492a5-ae62-4539-ada9-19a9c64709a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:19.821641 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a492a5-ae62-4539-ada9-19a9c64709a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:19.822060 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a492a5-ae62-4539-ada9-19a9c64709a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:19.822869 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a492a5-ae62-4539-ada9-19a9c64709a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:30:19.823320 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a492a5-ae62-4539-ada9-19a9c64709a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:19.825123 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a492a5-ae62-4539-ada9-19a9c64709a9 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:19.883535 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 970/1963] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 30 01:30:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:30:19.884293 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a492a5-ae62-4539-ada9-19a9c64709a9 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:19.890501 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-55a492a5-ae62-4539-ada9-19a9c64709a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:19.930337 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e803b96-fc0a-432b-8e40-c38caa3ce7d2 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:19.953326 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d5848c-97cf-47b8-a7b8-d62e6abaf173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:19.960279 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5848c-97cf-47b8-a7b8-d62e6abaf173 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:19.962027 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5848c-97cf-47b8-a7b8-d62e6abaf173 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:19.963419 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5848c-97cf-47b8-a7b8-d62e6abaf173 admin admin] PATH_INFO: `/v3/users/94595535866e44d8ac03ebb70c893410` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:19.969075 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d5848c-97cf-47b8-a7b8-d62e6abaf173 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94595535866e44d8ac03ebb70c893410)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:19.990300 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d5848c-97cf-47b8-a7b8-d62e6abaf173 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:20.085163 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a492a5-ae62-4539-ada9-19a9c64709a9 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:20.089631 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0931da3b-6a3e-4441-9c46-2d388fd32d44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:20.090227 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931da3b-6a3e-4441-9c46-2d388fd32d44 service cinder] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:20.090519 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931da3b-6a3e-4441-9c46-2d388fd32d44 service cinder] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:20.090784 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931da3b-6a3e-4441-9c46-2d388fd32d44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:20.092722 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-85d5848c-97cf-47b8-a7b8-d62e6abaf173 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94595535866e44d8ac03ebb70c893410'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:20.094918 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:20.105179 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-85d5848c-97cf-47b8-a7b8-d62e6abaf173 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94595535866e44d8ac03ebb70c893410'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:20.105880 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0931da3b-6a3e-4441-9c46-2d388fd32d44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:20.105992 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-85d5848c-97cf-47b8-a7b8-d62e6abaf173 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94595535866e44d8ac03ebb70c893410'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:20.107681 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0931da3b-6a3e-4441-9c46-2d388fd32d44 service cinder] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:20.124380 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 971/1964] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:30:19 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:30:20.127611 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0931da3b-6a3e-4441-9c46-2d388fd32d44 service cinder] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:20.133584 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-85d5848c-97cf-47b8-a7b8-d62e6abaf173 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94595535866e44d8ac03ebb70c893410'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:20.134586 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-85d5848c-97cf-47b8-a7b8-d62e6abaf173 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94595535866e44d8ac03ebb70c893410'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:20.146011 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0931da3b-6a3e-4441-9c46-2d388fd32d44 service cinder] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:20.161421 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 994/1965] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:30:19 2022] DELETE /identity/v3/users/94595535866e44d8ac03ebb70c893410 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:20.165062 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d5848c-97cf-47b8-a7b8-d62e6abaf173 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:20.165062 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-85d5848c-97cf-47b8-a7b8-d62e6abaf173 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:20.172475 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd80432-0f15-46ea-916e-eba7c91e5c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:20.173988 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd80432-0f15-46ea-916e-eba7c91e5c12 admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:20.174456 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd80432-0f15-46ea-916e-eba7c91e5c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:20.174943 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd80432-0f15-46ea-916e-eba7c91e5c12 admin admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:20.175999 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd80432-0f15-46ea-916e-eba7c91e5c12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:20.181332 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd80432-0f15-46ea-916e-eba7c91e5c12 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:20.261124 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 972/1966] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:30:20 2022] POST /identity/v3/projects => generated 375 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:30:20.261124 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2b413-a28a-44db-8ccc-44ed7964fa2a None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:20.261373 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2b413-a28a-44db-8ccc-44ed7964fa2a None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:20.261545 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2b413-a28a-44db-8ccc-44ed7964fa2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:20.289790 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-c6b2b413-a28a-44db-8ccc-44ed7964fa2a None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:20.291159 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-c6b2b413-a28a-44db-8ccc-44ed7964fa2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:20.298160 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d5848c-97cf-47b8-a7b8-d62e6abaf173 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:20.362537 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aff3cdf-9a6d-44c6-98c9-50aa8411ba0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:20.363264 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff3cdf-9a6d-44c6-98c9-50aa8411ba0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:20.363832 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff3cdf-9a6d-44c6-98c9-50aa8411ba0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:20.364034 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff3cdf-9a6d-44c6-98c9-50aa8411ba0f admin admin] PATH_INFO: `/v3/projects/08a5016b5c554ba6bcc87b86137a1846` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:20.365159 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aff3cdf-9a6d-44c6-98c9-50aa8411ba0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=08a5016b5c554ba6bcc87b86137a1846)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:20.367743 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aff3cdf-9a6d-44c6-98c9-50aa8411ba0f admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:20.367934 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 973/1967] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:20.368895 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b2b413-a28a-44db-8ccc-44ed7964fa2a None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:20.370262 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-c6b2b413-a28a-44db-8ccc-44ed7964fa2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:20.385311 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b2b413-a28a-44db-8ccc-44ed7964fa2a None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:20.390036 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549fe691-0b98-4815-ad76-3c02e34688bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:20.390652 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549fe691-0b98-4815-ad76-3c02e34688bf admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:20.390933 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549fe691-0b98-4815-ad76-3c02e34688bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:20.391236 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549fe691-0b98-4815-ad76-3c02e34688bf admin admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:20.391874 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549fe691-0b98-4815-ad76-3c02e34688bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:20.393912 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549fe691-0b98-4815-ad76-3c02e34688bf admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:20.420231 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 974/1968] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:30:20 2022] POST /identity/v3/users => generated 288 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:30:20.420231 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549fe691-0b98-4815-ad76-3c02e34688bf admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:20.422045 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-549fe691-0b98-4815-ad76-3c02e34688bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:20.426673 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-0aff3cdf-9a6d-44c6-98c9-50aa8411ba0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08a5016b5c554ba6bcc87b86137a1846', 'request_id': 'req-0aff3cdf-9a6d-44c6-98c9-50aa8411ba0f'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:20.432669 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:20.433503 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-0aff3cdf-9a6d-44c6-98c9-50aa8411ba0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08a5016b5c554ba6bcc87b86137a1846', 'request_id': 'req-0aff3cdf-9a6d-44c6-98c9-50aa8411ba0f'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:20.442599 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-0aff3cdf-9a6d-44c6-98c9-50aa8411ba0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08a5016b5c554ba6bcc87b86137a1846', 'request_id': 'req-0aff3cdf-9a6d-44c6-98c9-50aa8411ba0f'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:20.457260 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-0aff3cdf-9a6d-44c6-98c9-50aa8411ba0f admin admin] The token cache is being invalidate because project 08a5016b5c554ba6bcc87b86137a1846 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:30:20.457550 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-0aff3cdf-9a6d-44c6-98c9-50aa8411ba0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:20.458349 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-0aff3cdf-9a6d-44c6-98c9-50aa8411ba0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:20.460419 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 995/1969] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:30:20 2022] DELETE /identity/v3/projects/08a5016b5c554ba6bcc87b86137a1846 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:20.464318 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aff3cdf-9a6d-44c6-98c9-50aa8411ba0f admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:20.466170 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-0aff3cdf-9a6d-44c6-98c9-50aa8411ba0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:20.471984 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:20.493837 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549fe691-0b98-4815-ad76-3c02e34688bf admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:20.534362 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aff3cdf-9a6d-44c6-98c9-50aa8411ba0f admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:20.538914 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4549bcf-8439-444d-975c-3a624a960061 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:20.539598 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4549bcf-8439-444d-975c-3a624a960061 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:20.539877 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4549bcf-8439-444d-975c-3a624a960061 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:20.540157 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4549bcf-8439-444d-975c-3a624a960061 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:20.542179 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-d4549bcf-8439-444d-975c-3a624a960061 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:20.557913 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df75d25d-76ef-466c-b6a4-7eca8037980e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:20.557913 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df75d25d-76ef-466c-b6a4-7eca8037980e service cinder] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:20.557913 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df75d25d-76ef-466c-b6a4-7eca8037980e service cinder] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:20.558267 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df75d25d-76ef-466c-b6a4-7eca8037980e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:20.561434 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-df75d25d-76ef-466c-b6a4-7eca8037980e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:20.632638 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4549bcf-8439-444d-975c-3a624a960061 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:20.635412 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4549bcf-8439-444d-975c-3a624a960061 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:20.648829 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 996/1970] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:30:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:30:20.649575 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4549bcf-8439-444d-975c-3a624a960061 service neutron] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:20.652086 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-d4549bcf-8439-444d-975c-3a624a960061 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:20.653850 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df75d25d-76ef-466c-b6a4-7eca8037980e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:20.655511 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df75d25d-76ef-466c-b6a4-7eca8037980e service cinder] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:20.668245 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4549bcf-8439-444d-975c-3a624a960061 service neutron] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:20.669120 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 975/1971] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:30:20 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:30:20.670221 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df75d25d-76ef-466c-b6a4-7eca8037980e service cinder] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:20.672450 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-df75d25d-76ef-466c-b6a4-7eca8037980e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:20.690252 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4bb36b-cb26-4a97-93bc-2697da837c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:20.690889 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4bb36b-cb26-4a97-93bc-2697da837c26 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:20.691013 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df75d25d-76ef-466c-b6a4-7eca8037980e service cinder] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:20.691169 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4bb36b-cb26-4a97-93bc-2697da837c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:20.691474 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4bb36b-cb26-4a97-93bc-2697da837c26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:20.694972 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4bb36b-cb26-4a97-93bc-2697da837c26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:20.699169 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f66016e-31ca-4b1d-849a-02288eb1d265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:20.699905 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66016e-31ca-4b1d-849a-02288eb1d265 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:20.700284 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66016e-31ca-4b1d-849a-02288eb1d265 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:20.700719 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66016e-31ca-4b1d-849a-02288eb1d265 admin admin] PATH_INFO: `/v3/users/2e9b35a80ad84e918ee2dd6f31c84e74` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:20.701949 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f66016e-31ca-4b1d-849a-02288eb1d265 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e9b35a80ad84e918ee2dd6f31c84e74)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:20.702673 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4bb36b-cb26-4a97-93bc-2697da837c26 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:20.704534 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f66016e-31ca-4b1d-849a-02288eb1d265 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:20.742941 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 997/1972] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:30:20 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:30:20.746120 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4bb36b-cb26-4a97-93bc-2697da837c26 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:20.774503 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4bb36b-cb26-4a97-93bc-2697da837c26 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:20.789167 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9159fc5a-3b87-4d65-8937-b65e4a976f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:20.790503 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9159fc5a-3b87-4d65-8937-b65e4a976f6c admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:20.790891 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9159fc5a-3b87-4d65-8937-b65e4a976f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:20.792242 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9159fc5a-3b87-4d65-8937-b65e4a976f6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:20.793072 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9159fc5a-3b87-4d65-8937-b65e4a976f6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:20.796622 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9159fc5a-3b87-4d65-8937-b65e4a976f6c admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:20.800014 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-1f66016e-31ca-4b1d-849a-02288eb1d265 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e9b35a80ad84e918ee2dd6f31c84e74'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:20.822827 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 998/1973] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:30:20 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:30:20.823137 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-1f66016e-31ca-4b1d-849a-02288eb1d265 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e9b35a80ad84e918ee2dd6f31c84e74'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:20.824384 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-1f66016e-31ca-4b1d-849a-02288eb1d265 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e9b35a80ad84e918ee2dd6f31c84e74'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:20.825043 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-1f66016e-31ca-4b1d-849a-02288eb1d265 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e9b35a80ad84e918ee2dd6f31c84e74'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:20.828170 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9159fc5a-3b87-4d65-8937-b65e4a976f6c admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:20.833475 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-9159fc5a-3b87-4d65-8937-b65e4a976f6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:20.853906 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-1f66016e-31ca-4b1d-849a-02288eb1d265 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e9b35a80ad84e918ee2dd6f31c84e74'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:20.855221 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:20.859733 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9159fc5a-3b87-4d65-8937-b65e4a976f6c admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:20.869909 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756469c7-1f53-4338-94f9-b4113d9fde0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:20.871245 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756469c7-1f53-4338-94f9-b4113d9fde0e admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:20.871571 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756469c7-1f53-4338-94f9-b4113d9fde0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:20.872150 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756469c7-1f53-4338-94f9-b4113d9fde0e admin admin] PATH_INFO: `/v3/projects/ed2a58250713470ea653dfa8ab496c9e/users/01fab6012a614edfbf28d44356292901/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:20.889143 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 976/1974] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:30:20 2022] DELETE /identity/v3/users/2e9b35a80ad84e918ee2dd6f31c84e74 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:20.897339 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756469c7-1f53-4338-94f9-b4113d9fde0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed2a58250713470ea653dfa8ab496c9e, user_id=01fab6012a614edfbf28d44356292901, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:20.901311 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756469c7-1f53-4338-94f9-b4113d9fde0e admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:20.947017 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 999/1975] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:30:20 2022] PUT /identity/v3/projects/ed2a58250713470ea653dfa8ab496c9e/users/01fab6012a614edfbf28d44356292901/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:20.948443 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eeb167-51fb-4a44-afe3-83811c529045 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:20.950178 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eeb167-51fb-4a44-afe3-83811c529045 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:20.950474 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eeb167-51fb-4a44-afe3-83811c529045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:21.055150 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-18eeb167-51fb-4a44-afe3-83811c529045 None None] MFA Rules not processed for user `01fab6012a614edfbf28d44356292901`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:21.078890 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-18eeb167-51fb-4a44-afe3-83811c529045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:21.215692 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 977/1976] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:30:21.229607 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756469c7-1f53-4338-94f9-b4113d9fde0e admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:21.238969 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-756469c7-1f53-4338-94f9-b4113d9fde0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:21.294184 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eeb167-51fb-4a44-afe3-83811c529045 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:21.295761 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-18eeb167-51fb-4a44-afe3-83811c529045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:21.395739 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756469c7-1f53-4338-94f9-b4113d9fde0e admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:21.402449 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed49755-8b3a-4ec0-bcf5-1af6143642ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:21.403822 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed49755-8b3a-4ec0-bcf5-1af6143642ca service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:21.404102 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed49755-8b3a-4ec0-bcf5-1af6143642ca service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:21.404375 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed49755-8b3a-4ec0-bcf5-1af6143642ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:21.422150 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed49755-8b3a-4ec0-bcf5-1af6143642ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:21.423360 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed49755-8b3a-4ec0-bcf5-1af6143642ca service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:21.441411 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1000/1977] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:30:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:30:21.480811 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eeb167-51fb-4a44-afe3-83811c529045 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:21.493702 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb311800-d2ee-4b63-b203-8cee35b1759e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:21.494470 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb311800-d2ee-4b63-b203-8cee35b1759e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:21.495404 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb311800-d2ee-4b63-b203-8cee35b1759e admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:21.495827 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb311800-d2ee-4b63-b203-8cee35b1759e admin admin] PATH_INFO: `/v3/projects/aa317f9f02484b88979af3077cd8f802` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:21.497634 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb311800-d2ee-4b63-b203-8cee35b1759e admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa317f9f02484b88979af3077cd8f802)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:21.500112 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb311800-d2ee-4b63-b203-8cee35b1759e admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:21.564926 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-fb311800-d2ee-4b63-b203-8cee35b1759e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa317f9f02484b88979af3077cd8f802', 'request_id': 'req-fb311800-d2ee-4b63-b203-8cee35b1759e'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:21.573987 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-fb311800-d2ee-4b63-b203-8cee35b1759e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa317f9f02484b88979af3077cd8f802', 'request_id': 'req-fb311800-d2ee-4b63-b203-8cee35b1759e'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:21.584027 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-fb311800-d2ee-4b63-b203-8cee35b1759e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa317f9f02484b88979af3077cd8f802', 'request_id': 'req-fb311800-d2ee-4b63-b203-8cee35b1759e'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:21.600920 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed49755-8b3a-4ec0-bcf5-1af6143642ca service cinder] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:21.602506 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-fed49755-8b3a-4ec0-bcf5-1af6143642ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:21.622534 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-fb311800-d2ee-4b63-b203-8cee35b1759e admin admin] The token cache is being invalidate because project aa317f9f02484b88979af3077cd8f802 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81447) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:30:21.625537 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-fb311800-d2ee-4b63-b203-8cee35b1759e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:21.626741 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-fb311800-d2ee-4b63-b203-8cee35b1759e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:21.631480 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 978/1978] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:30:21 2022] DELETE /identity/v3/projects/aa317f9f02484b88979af3077cd8f802 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:21.636396 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb311800-d2ee-4b63-b203-8cee35b1759e admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:21.638656 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-fb311800-d2ee-4b63-b203-8cee35b1759e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:21.652420 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed49755-8b3a-4ec0-bcf5-1af6143642ca service cinder] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:21.673850 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:21.677365 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:21.772638 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa8089-0982-4c3e-aba7-e4ec0d0a2f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:21.773502 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa8089-0982-4c3e-aba7-e4ec0d0a2f5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:21.773940 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa8089-0982-4c3e-aba7-e4ec0d0a2f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:21.774216 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa8089-0982-4c3e-aba7-e4ec0d0a2f5d admin admin] PATH_INFO: `/v3/projects/aa324516fed54823973b46443cec5af1` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:21.775659 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa8089-0982-4c3e-aba7-e4ec0d0a2f5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa324516fed54823973b46443cec5af1)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:21.779515 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa8089-0982-4c3e-aba7-e4ec0d0a2f5d admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:21.827471 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb311800-d2ee-4b63-b203-8cee35b1759e admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:21.843692 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d2d49d-81b5-40b4-94b7-7d77021f26b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:21.844484 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2d49d-81b5-40b4-94b7-7d77021f26b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:21.844790 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2d49d-81b5-40b4-94b7-7d77021f26b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:21.845094 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2d49d-81b5-40b4-94b7-7d77021f26b5 admin admin] PATH_INFO: `/v3/users/1a35b336b26043dcb78baa7bda80bb25` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:21.846503 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d2d49d-81b5-40b4-94b7-7d77021f26b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a35b336b26043dcb78baa7bda80bb25)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:21.850792 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d2d49d-81b5-40b4-94b7-7d77021f26b5 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:21.884565 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-1aaa8089-0982-4c3e-aba7-e4ec0d0a2f5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa324516fed54823973b46443cec5af1', 'request_id': 'req-1aaa8089-0982-4c3e-aba7-e4ec0d0a2f5d'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:21.899987 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-1aaa8089-0982-4c3e-aba7-e4ec0d0a2f5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa324516fed54823973b46443cec5af1', 'request_id': 'req-1aaa8089-0982-4c3e-aba7-e4ec0d0a2f5d'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:21.908716 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-1aaa8089-0982-4c3e-aba7-e4ec0d0a2f5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa324516fed54823973b46443cec5af1', 'request_id': 'req-1aaa8089-0982-4c3e-aba7-e4ec0d0a2f5d'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:21.922539 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-1aaa8089-0982-4c3e-aba7-e4ec0d0a2f5d admin admin] The token cache is being invalidate because project aa324516fed54823973b46443cec5af1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:30:21.922925 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-1aaa8089-0982-4c3e-aba7-e4ec0d0a2f5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:21.924448 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-1aaa8089-0982-4c3e-aba7-e4ec0d0a2f5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:21.926086 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1001/1979] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:30:21 2022] DELETE /identity/v3/projects/aa324516fed54823973b46443cec5af1 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:30:21.931037 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ce30b-f485-4154-9f63-8a162c2c2fa2 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:21.931506 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ce30b-f485-4154-9f63-8a162c2c2fa2 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:21.931852 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ce30b-f485-4154-9f63-8a162c2c2fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:21.934662 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-48d2d49d-81b5-40b4-94b7-7d77021f26b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a35b336b26043dcb78baa7bda80bb25'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:21.946840 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-48d2d49d-81b5-40b4-94b7-7d77021f26b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a35b336b26043dcb78baa7bda80bb25'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:21.947708 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-48d2d49d-81b5-40b4-94b7-7d77021f26b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a35b336b26043dcb78baa7bda80bb25'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:21.948443 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-48d2d49d-81b5-40b4-94b7-7d77021f26b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a35b336b26043dcb78baa7bda80bb25'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:21.965822 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-914ce30b-f485-4154-9f63-8a162c2c2fa2 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:21.967425 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-914ce30b-f485-4154-9f63-8a162c2c2fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:21.982766 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-48d2d49d-81b5-40b4-94b7-7d77021f26b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a35b336b26043dcb78baa7bda80bb25'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:22.012899 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 979/1980] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:30:21 2022] DELETE /identity/v3/users/1a35b336b26043dcb78baa7bda80bb25 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:22.057461 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1002/1981] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:30:22.066761 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb5cf6-cac5-440f-b588-c765d80202a0 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:22.067055 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb5cf6-cac5-440f-b588-c765d80202a0 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:22.067333 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb5cf6-cac5-440f-b588-c765d80202a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:22.109306 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-69bb5cf6-cac5-440f-b588-c765d80202a0 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:22.110624 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-69bb5cf6-cac5-440f-b588-c765d80202a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:22.239932 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 980/1982] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:22.245466 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914ce30b-f485-4154-9f63-8a162c2c2fa2 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:22.262348 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914ce30b-f485-4154-9f63-8a162c2c2fa2 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:22.269567 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60986ba0-3455-44e2-bca4-02ab01353ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:22.270193 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60986ba0-3455-44e2-bca4-02ab01353ad1 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:22.270472 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60986ba0-3455-44e2-bca4-02ab01353ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:22.270749 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60986ba0-3455-44e2-bca4-02ab01353ad1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:22.272063 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60986ba0-3455-44e2-bca4-02ab01353ad1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:30:22.272063 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60986ba0-3455-44e2-bca4-02ab01353ad1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:22.273476 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60986ba0-3455-44e2-bca4-02ab01353ad1 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:22.290407 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1003/1983] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 30 01:30:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:30:22.295017 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb5cf6-cac5-440f-b588-c765d80202a0 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:22.305200 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb5cf6-cac5-440f-b588-c765d80202a0 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:22.309898 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c944f4-9d42-4175-8ecd-a882a770ba8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:22.310517 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c944f4-9d42-4175-8ecd-a882a770ba8a admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:22.310798 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c944f4-9d42-4175-8ecd-a882a770ba8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:22.311072 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c944f4-9d42-4175-8ecd-a882a770ba8a admin admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:22.311767 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c944f4-9d42-4175-8ecd-a882a770ba8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:22.313725 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c944f4-9d42-4175-8ecd-a882a770ba8a admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:22.348461 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 981/1984] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:30:22 2022] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:30:22.350751 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60986ba0-3455-44e2-bca4-02ab01353ad1 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:22.365986 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60986ba0-3455-44e2-bca4-02ab01353ad1 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:22.426735 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:22.473655 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632465ef-9b97-446a-9a58-97ab9064fa87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:22.474458 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632465ef-9b97-446a-9a58-97ab9064fa87 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:22.475717 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632465ef-9b97-446a-9a58-97ab9064fa87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:22.476138 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632465ef-9b97-446a-9a58-97ab9064fa87 admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:22.476957 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632465ef-9b97-446a-9a58-97ab9064fa87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:22.480377 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632465ef-9b97-446a-9a58-97ab9064fa87 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:22.532977 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1004/1985] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:30:22 2022] POST /identity/v3/users => generated 291 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:30:22.538698 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c944f4-9d42-4175-8ecd-a882a770ba8a admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:22.554620 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c944f4-9d42-4175-8ecd-a882a770ba8a admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:22.559527 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c14ac6-53ed-4737-8436-b782f2f00e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:22.560455 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c14ac6-53ed-4737-8436-b782f2f00e0c admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:22.560859 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c14ac6-53ed-4737-8436-b782f2f00e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:22.561201 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c14ac6-53ed-4737-8436-b782f2f00e0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:22.561867 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c14ac6-53ed-4737-8436-b782f2f00e0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:22.564448 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c14ac6-53ed-4737-8436-b782f2f00e0c admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:22.565474 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:22.577328 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 982/1986] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:30:22 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:30:22.581181 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632465ef-9b97-446a-9a58-97ab9064fa87 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:22.593367 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632465ef-9b97-446a-9a58-97ab9064fa87 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:22.603132 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c14ac6-53ed-4737-8436-b782f2f00e0c admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:22.603132 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-f0c14ac6-53ed-4737-8436-b782f2f00e0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:22.608358 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa9c01-13ae-4eb2-8e32-a919cff9cff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:22.610706 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa9c01-13ae-4eb2-8e32-a919cff9cff3 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:22.611048 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa9c01-13ae-4eb2-8e32-a919cff9cff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:22.614395 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa9c01-13ae-4eb2-8e32-a919cff9cff3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:22.615075 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa9c01-13ae-4eb2-8e32-a919cff9cff3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:22.617351 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa9c01-13ae-4eb2-8e32-a919cff9cff3 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:22.629354 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1005/1987] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:30:22 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:30:22.634053 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa9c01-13ae-4eb2-8e32-a919cff9cff3 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:22.641409 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c14ac6-53ed-4737-8436-b782f2f00e0c admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:22.645254 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa9c01-13ae-4eb2-8e32-a919cff9cff3 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:22.646397 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c1244-210f-424a-bd29-0110665e78d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:22.647219 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c1244-210f-424a-bd29-0110665e78d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:22.647641 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c1244-210f-424a-bd29-0110665e78d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:22.648074 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c1244-210f-424a-bd29-0110665e78d0 admin admin] PATH_INFO: `/v3/projects/ce47bfbc294b445aa7e6b3d46bdea88e` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:22.649854 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2c1244-210f-424a-bd29-0110665e78d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce47bfbc294b445aa7e6b3d46bdea88e)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:22.651959 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2c1244-210f-424a-bd29-0110665e78d0 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:22.652289 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec5e68e-b81e-4beb-b8cd-226e8c70e078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:22.653142 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec5e68e-b81e-4beb-b8cd-226e8c70e078 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:22.653558 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec5e68e-b81e-4beb-b8cd-226e8c70e078 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:22.653985 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec5e68e-b81e-4beb-b8cd-226e8c70e078 admin admin] PATH_INFO: `/v3/projects/059960932a7b4d28bea100cbcf331d5c/users/fcad38c49c2c483da2ba5faf4d4a626a/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:22.674120 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec5e68e-b81e-4beb-b8cd-226e8c70e078 admin admin] RBAC: Authorizing `identity:create_grant(project_id=059960932a7b4d28bea100cbcf331d5c, user_id=fcad38c49c2c483da2ba5faf4d4a626a, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:22.677120 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec5e68e-b81e-4beb-b8cd-226e8c70e078 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:22.705529 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1006/1988] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:30:22 2022] PUT /identity/v3/projects/059960932a7b4d28bea100cbcf331d5c/users/fcad38c49c2c483da2ba5faf4d4a626a/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:30:22.717825 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c533cc-9a6f-4ce0-bc43-2ffbd62f909f None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:22.718133 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c533cc-9a6f-4ce0-bc43-2ffbd62f909f None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:22.718531 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c533cc-9a6f-4ce0-bc43-2ffbd62f909f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:22.720574 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-fb2c1244-210f-424a-bd29-0110665e78d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce47bfbc294b445aa7e6b3d46bdea88e', 'request_id': 'req-fb2c1244-210f-424a-bd29-0110665e78d0'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:22.727705 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-fb2c1244-210f-424a-bd29-0110665e78d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce47bfbc294b445aa7e6b3d46bdea88e', 'request_id': 'req-fb2c1244-210f-424a-bd29-0110665e78d0'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:22.737514 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-fb2c1244-210f-424a-bd29-0110665e78d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce47bfbc294b445aa7e6b3d46bdea88e', 'request_id': 'req-fb2c1244-210f-424a-bd29-0110665e78d0'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:22.751977 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-82c533cc-9a6f-4ce0-bc43-2ffbd62f909f None None] MFA Rules not processed for user `fcad38c49c2c483da2ba5faf4d4a626a`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:22.753137 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-82c533cc-9a6f-4ce0-bc43-2ffbd62f909f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:22.754854 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-fb2c1244-210f-424a-bd29-0110665e78d0 admin admin] The token cache is being invalidate because project ce47bfbc294b445aa7e6b3d46bdea88e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81447) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:30:22.755270 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-fb2c1244-210f-424a-bd29-0110665e78d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:22.756346 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-fb2c1244-210f-424a-bd29-0110665e78d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:22.759183 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 983/1989] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:30:22 2022] DELETE /identity/v3/projects/ce47bfbc294b445aa7e6b3d46bdea88e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:30:22.764351 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83331af7-e852-48f9-b1e3-f8d5942154ad None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:22.765159 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83331af7-e852-48f9-b1e3-f8d5942154ad None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:22.765636 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83331af7-e852-48f9-b1e3-f8d5942154ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:22.796266 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-83331af7-e852-48f9-b1e3-f8d5942154ad None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:22.798647 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-83331af7-e852-48f9-b1e3-f8d5942154ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:22.838879 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1007/1990] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:30:22.840286 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c533cc-9a6f-4ce0-bc43-2ffbd62f909f None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:22.841888 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-82c533cc-9a6f-4ce0-bc43-2ffbd62f909f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:22.885163 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 984/1991] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:30:22.893318 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8b7ca-fe31-4a16-bfe4-c7f410379fde None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:22.893537 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8b7ca-fe31-4a16-bfe4-c7f410379fde None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:22.893685 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8b7ca-fe31-4a16-bfe4-c7f410379fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:22.915311 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-04f8b7ca-fe31-4a16-bfe4-c7f410379fde None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:22.916580 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-04f8b7ca-fe31-4a16-bfe4-c7f410379fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:22.917445 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c533cc-9a6f-4ce0-bc43-2ffbd62f909f None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:22.922005 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b91058-dbb5-41de-af08-0c4bfa53739c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:22.922671 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b91058-dbb5-41de-af08-0c4bfa53739c admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:22.923077 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b91058-dbb5-41de-af08-0c4bfa53739c admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:22.923491 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b91058-dbb5-41de-af08-0c4bfa53739c admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:22.924193 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b91058-dbb5-41de-af08-0c4bfa53739c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:22.924893 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 985/1992] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:22.926482 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b91058-dbb5-41de-af08-0c4bfa53739c admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:22.929617 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f8b7ca-fe31-4a16-bfe4-c7f410379fde None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:22.947613 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f8b7ca-fe31-4a16-bfe4-c7f410379fde None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:22.949711 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:22.954139 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb24267-fd55-422e-8bd3-8871156ecd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:22.955001 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb24267-fd55-422e-8bd3-8871156ecd59 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:22.955335 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb24267-fd55-422e-8bd3-8871156ecd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:22.955772 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb24267-fd55-422e-8bd3-8871156ecd59 admin admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:22.956614 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb24267-fd55-422e-8bd3-8871156ecd59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:30:22.956725 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb24267-fd55-422e-8bd3-8871156ecd59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:22.958349 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb24267-fd55-422e-8bd3-8871156ecd59 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:22.968032 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1008/1993] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:30:22 2022] POST /identity/v3/projects => generated 379 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:30:22.969411 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b91058-dbb5-41de-af08-0c4bfa53739c admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:22.975501 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 986/1994] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 30 01:30:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:30:22.977378 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb24267-fd55-422e-8bd3-8871156ecd59 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:22.988322 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb24267-fd55-422e-8bd3-8871156ecd59 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:23.052948 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b91058-dbb5-41de-af08-0c4bfa53739c admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:23.057842 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cedd8c-8ebf-4546-a4d5-d1cb36f4655c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:23.058455 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cedd8c-8ebf-4546-a4d5-d1cb36f4655c admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:23.058844 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ce150-589e-4d00-a206-3d90cbca1095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:23.058975 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cedd8c-8ebf-4546-a4d5-d1cb36f4655c admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:23.059129 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cedd8c-8ebf-4546-a4d5-d1cb36f4655c admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:23.059658 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ce150-589e-4d00-a206-3d90cbca1095 admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:23.059800 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cedd8c-8ebf-4546-a4d5-d1cb36f4655c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:23.060057 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ce150-589e-4d00-a206-3d90cbca1095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:23.060562 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ce150-589e-4d00-a206-3d90cbca1095 admin admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:23.061399 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899ce150-589e-4d00-a206-3d90cbca1095 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:23.061773 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cedd8c-8ebf-4546-a4d5-d1cb36f4655c admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:23.063576 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899ce150-589e-4d00-a206-3d90cbca1095 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:23.068986 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:23.087784 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1009/1995] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:30:22 2022] POST /identity/v3/users => generated 296 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:30:23.092117 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cedd8c-8ebf-4546-a4d5-d1cb36f4655c admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:23.112168 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cedd8c-8ebf-4546-a4d5-d1cb36f4655c admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:23.122385 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 987/1996] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:30:22 2022] POST /identity/v3/projects => generated 377 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:30:23.128069 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ce150-589e-4d00-a206-3d90cbca1095 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:23.185863 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79ea176-57cf-4aee-b2b7-27bfff420670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:23.186689 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ea176-57cf-4aee-b2b7-27bfff420670 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:23.186983 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ea176-57cf-4aee-b2b7-27bfff420670 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:23.187254 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ea176-57cf-4aee-b2b7-27bfff420670 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:23.188057 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79ea176-57cf-4aee-b2b7-27bfff420670 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:23.189863 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79ea176-57cf-4aee-b2b7-27bfff420670 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:23.207597 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1010/1997] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:30:23.212096 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79ea176-57cf-4aee-b2b7-27bfff420670 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:23.223853 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79ea176-57cf-4aee-b2b7-27bfff420670 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:23.229939 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eefa824-6442-4a4e-973d-d37eda8f6a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:23.230724 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eefa824-6442-4a4e-973d-d37eda8f6a92 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:23.231009 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eefa824-6442-4a4e-973d-d37eda8f6a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:23.231281 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eefa824-6442-4a4e-973d-d37eda8f6a92 admin admin] PATH_INFO: `/v3/projects/9d1a5146a78d4e118fcaf67078a6c612/users/e51cd04076b34f88bdb436334dea1012/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:23.265016 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eefa824-6442-4a4e-973d-d37eda8f6a92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d1a5146a78d4e118fcaf67078a6c612, user_id=e51cd04076b34f88bdb436334dea1012, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:23.271072 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eefa824-6442-4a4e-973d-d37eda8f6a92 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:23.291403 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ce150-589e-4d00-a206-3d90cbca1095 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:23.302176 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1011/1998] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:30:23 2022] PUT /identity/v3/projects/9d1a5146a78d4e118fcaf67078a6c612/users/e51cd04076b34f88bdb436334dea1012/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:23.304333 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eefa824-6442-4a4e-973d-d37eda8f6a92 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:23.406339 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c8dd1-8fa9-4daa-a0ba-d1af84cbf663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:23.407691 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c8dd1-8fa9-4daa-a0ba-d1af84cbf663 admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:23.408382 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c8dd1-8fa9-4daa-a0ba-d1af84cbf663 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:23.408979 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c8dd1-8fa9-4daa-a0ba-d1af84cbf663 admin admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:23.410769 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7c8dd1-8fa9-4daa-a0ba-d1af84cbf663 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:23.419206 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7c8dd1-8fa9-4daa-a0ba-d1af84cbf663 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:23.431389 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:23.437729 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eefa824-6442-4a4e-973d-d37eda8f6a92 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:23.451639 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe21609-cd83-430b-88fc-f1a9646acab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:23.452719 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe21609-cd83-430b-88fc-f1a9646acab7 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:23.453195 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe21609-cd83-430b-88fc-f1a9646acab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:23.453474 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe21609-cd83-430b-88fc-f1a9646acab7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:23.454235 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe21609-cd83-430b-88fc-f1a9646acab7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:23.456305 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe21609-cd83-430b-88fc-f1a9646acab7 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:23.459734 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 988/1999] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:30:23 2022] POST /identity/v3/users => generated 289 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:30:23.464794 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c8dd1-8fa9-4daa-a0ba-d1af84cbf663 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:23.480860 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1012/2000] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:30:23.483055 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe21609-cd83-430b-88fc-f1a9646acab7 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:23.483540 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c8dd1-8fa9-4daa-a0ba-d1af84cbf663 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:23.489202 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c2223-2de2-4360-a3e2-0f510dff5754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:23.490199 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c2223-2de2-4360-a3e2-0f510dff5754 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:23.490863 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c2223-2de2-4360-a3e2-0f510dff5754 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:23.491284 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c2223-2de2-4360-a3e2-0f510dff5754 admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:23.492278 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1c2223-2de2-4360-a3e2-0f510dff5754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:23.495133 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1c2223-2de2-4360-a3e2-0f510dff5754 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:23.500560 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe21609-cd83-430b-88fc-f1a9646acab7 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:23.505958 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d4bff-7243-45d5-b95a-be1c850486d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:23.506735 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d4bff-7243-45d5-b95a-be1c850486d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:23.507110 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d4bff-7243-45d5-b95a-be1c850486d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:23.507876 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 989/2001] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:30:23.509194 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d4bff-7243-45d5-b95a-be1c850486d2 admin admin] PATH_INFO: `/v3/projects/9d1a5146a78d4e118fcaf67078a6c612/users/e51cd04076b34f88bdb436334dea1012/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:23.511294 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025d4bff-7243-45d5-b95a-be1c850486d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d1a5146a78d4e118fcaf67078a6c612, user_id=e51cd04076b34f88bdb436334dea1012, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:23.514740 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025d4bff-7243-45d5-b95a-be1c850486d2 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:23.524773 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c2223-2de2-4360-a3e2-0f510dff5754 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:23.538041 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1013/2002] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:30:23 2022] PUT /identity/v3/projects/9d1a5146a78d4e118fcaf67078a6c612/users/e51cd04076b34f88bdb436334dea1012/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:23.539781 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba19da4-a021-4385-b8e0-2e27c0f274f3 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:23.540164 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba19da4-a021-4385-b8e0-2e27c0f274f3 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:23.540531 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba19da4-a021-4385-b8e0-2e27c0f274f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:23.549391 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c2223-2de2-4360-a3e2-0f510dff5754 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:23.573358 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-8ba19da4-a021-4385-b8e0-2e27c0f274f3 None None] MFA Rules not processed for user `e51cd04076b34f88bdb436334dea1012`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:23.575551 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-8ba19da4-a021-4385-b8e0-2e27c0f274f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:23.745837 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05227bd-1921-4489-9583-36295ee3827f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:23.746599 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05227bd-1921-4489-9583-36295ee3827f admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:23.747013 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05227bd-1921-4489-9583-36295ee3827f admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:23.747641 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05227bd-1921-4489-9583-36295ee3827f admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:23.748413 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05227bd-1921-4489-9583-36295ee3827f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:23.750134 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05227bd-1921-4489-9583-36295ee3827f admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:23.761301 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1014/2003] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:23 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:23.762246 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba19da4-a021-4385-b8e0-2e27c0f274f3 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:23.763884 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-8ba19da4-a021-4385-b8e0-2e27c0f274f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:23.764241 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 990/2004] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:30:23.773016 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05227bd-1921-4489-9583-36295ee3827f admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:23.785464 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05227bd-1921-4489-9583-36295ee3827f admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:23.790919 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def5a30-94c0-4349-b791-aed67a6dc7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:23.791833 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def5a30-94c0-4349-b791-aed67a6dc7b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:23.792180 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def5a30-94c0-4349-b791-aed67a6dc7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:23.792395 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def5a30-94c0-4349-b791-aed67a6dc7b8 admin admin] PATH_INFO: `/v3/projects/1183f0aa17f246749868bece11129236/users/56642d70686d49568b06ed9e7e533161/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:23.794479 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba19da4-a021-4385-b8e0-2e27c0f274f3 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:23.796384 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:23.806356 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86be68c9-1ebd-40f8-a1dc-1d42a777027e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:23.808827 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be68c9-1ebd-40f8-a1dc-1d42a777027e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:23.809413 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be68c9-1ebd-40f8-a1dc-1d42a777027e admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:23.810556 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be68c9-1ebd-40f8-a1dc-1d42a777027e admin admin] PATH_INFO: `/v3/users/44ae74d0146646e99710d253ead17168` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:23.812612 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86be68c9-1ebd-40f8-a1dc-1d42a777027e admin admin] RBAC: Authorizing `identity:delete_user(user_id=44ae74d0146646e99710d253ead17168)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:23.816412 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1def5a30-94c0-4349-b791-aed67a6dc7b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1183f0aa17f246749868bece11129236, user_id=56642d70686d49568b06ed9e7e533161, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:23.820815 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1def5a30-94c0-4349-b791-aed67a6dc7b8 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:23.824130 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86be68c9-1ebd-40f8-a1dc-1d42a777027e admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:23.868510 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 991/2005] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:30:23 2022] PUT /identity/v3/projects/1183f0aa17f246749868bece11129236/users/56642d70686d49568b06ed9e7e533161/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:23.869535 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def5a30-94c0-4349-b791-aed67a6dc7b8 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:23.871464 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-1def5a30-94c0-4349-b791-aed67a6dc7b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:23.900200 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-86be68c9-1ebd-40f8-a1dc-1d42a777027e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44ae74d0146646e99710d253ead17168'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:23.913158 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-86be68c9-1ebd-40f8-a1dc-1d42a777027e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44ae74d0146646e99710d253ead17168'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:23.914335 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-86be68c9-1ebd-40f8-a1dc-1d42a777027e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44ae74d0146646e99710d253ead17168'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:23.949405 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def5a30-94c0-4349-b791-aed67a6dc7b8 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:23.953991 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6971120d-9012-4b7f-a22a-efab7a0e6854 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:23.954662 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971120d-9012-4b7f-a22a-efab7a0e6854 service cinder] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:23.954950 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971120d-9012-4b7f-a22a-efab7a0e6854 service cinder] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:23.955718 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971120d-9012-4b7f-a22a-efab7a0e6854 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:23.966927 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-86be68c9-1ebd-40f8-a1dc-1d42a777027e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44ae74d0146646e99710d253ead17168'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:23.967897 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-86be68c9-1ebd-40f8-a1dc-1d42a777027e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44ae74d0146646e99710d253ead17168'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:23.996323 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1015/2006] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:30:23 2022] DELETE /identity/v3/users/44ae74d0146646e99710d253ead17168 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:23.997637 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc70a375-0023-4185-bc7f-32abbe595a78 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:24.000438 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc70a375-0023-4185-bc7f-32abbe595a78 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:24.000714 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc70a375-0023-4185-bc7f-32abbe595a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:24.047057 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-bc70a375-0023-4185-bc7f-32abbe595a78 None None] MFA Rules not processed for user `56642d70686d49568b06ed9e7e533161`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:24.048451 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-bc70a375-0023-4185-bc7f-32abbe595a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:24.073736 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6971120d-9012-4b7f-a22a-efab7a0e6854 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:24.075495 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6971120d-9012-4b7f-a22a-efab7a0e6854 service cinder] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:24.082990 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:24.089624 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 992/2007] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:30:23 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:30:24.091404 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035b538-152b-4960-9def-2909527b8e7c None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:24.091782 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035b538-152b-4960-9def-2909527b8e7c None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:24.092188 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035b538-152b-4960-9def-2909527b8e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:24.112661 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-e035b538-152b-4960-9def-2909527b8e7c None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:24.113866 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-e035b538-152b-4960-9def-2909527b8e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:24.149150 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1016/2008] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:24.173961 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc70a375-0023-4185-bc7f-32abbe595a78 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:24.178150 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-bc70a375-0023-4185-bc7f-32abbe595a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:24.213864 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 993/2009] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:24.231609 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e035b538-152b-4960-9def-2909527b8e7c None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:24.233270 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-e035b538-152b-4960-9def-2909527b8e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:24.268250 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc70a375-0023-4185-bc7f-32abbe595a78 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:24.273553 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e73764-20a3-47ea-b431-b5bff7a887e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:24.274713 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e73764-20a3-47ea-b431-b5bff7a887e6 service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:24.274713 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e73764-20a3-47ea-b431-b5bff7a887e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:24.275072 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e73764-20a3-47ea-b431-b5bff7a887e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:24.286111 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e73764-20a3-47ea-b431-b5bff7a887e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:24.287946 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e73764-20a3-47ea-b431-b5bff7a887e6 service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:24.299343 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:24.302595 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1017/2010] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:30:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:30:24.331250 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e035b538-152b-4960-9def-2909527b8e7c None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:24.336438 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af8cee2-f0c4-4267-8fcc-9733408067ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:24.337072 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8cee2-f0c4-4267-8fcc-9733408067ce service neutron] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:24.338052 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8cee2-f0c4-4267-8fcc-9733408067ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:24.338339 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8cee2-f0c4-4267-8fcc-9733408067ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:24.349092 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af8cee2-f0c4-4267-8fcc-9733408067ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:24.351704 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af8cee2-f0c4-4267-8fcc-9733408067ce service neutron] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:24.363800 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 994/2011] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:30:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:30:24.838007 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e73764-20a3-47ea-b431-b5bff7a887e6 service cinder] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:24.839586 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-04e73764-20a3-47ea-b431-b5bff7a887e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:24.868090 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e73764-20a3-47ea-b431-b5bff7a887e6 service cinder] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:24.879337 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14422547-f061-4ea7-a8a5-bf63ac357ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:24.880026 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14422547-f061-4ea7-a8a5-bf63ac357ea4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:24.880353 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14422547-f061-4ea7-a8a5-bf63ac357ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:24.880564 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14422547-f061-4ea7-a8a5-bf63ac357ea4 admin admin] PATH_INFO: `/v3/projects/4a1f569e67f14cde8de0c51666cb20b7` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:24.885209 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14422547-f061-4ea7-a8a5-bf63ac357ea4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a1f569e67f14cde8de0c51666cb20b7)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:24.894213 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14422547-f061-4ea7-a8a5-bf63ac357ea4 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:24.895806 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af8cee2-f0c4-4267-8fcc-9733408067ce service neutron] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:24.898542 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-3af8cee2-f0c4-4267-8fcc-9733408067ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:25.005978 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-14422547-f061-4ea7-a8a5-bf63ac357ea4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a1f569e67f14cde8de0c51666cb20b7', 'request_id': 'req-14422547-f061-4ea7-a8a5-bf63ac357ea4'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:25.013933 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af8cee2-f0c4-4267-8fcc-9733408067ce service neutron] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:25.036272 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-14422547-f061-4ea7-a8a5-bf63ac357ea4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a1f569e67f14cde8de0c51666cb20b7', 'request_id': 'req-14422547-f061-4ea7-a8a5-bf63ac357ea4'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:25.057740 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-14422547-f061-4ea7-a8a5-bf63ac357ea4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a1f569e67f14cde8de0c51666cb20b7', 'request_id': 'req-14422547-f061-4ea7-a8a5-bf63ac357ea4'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:25.081062 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-14422547-f061-4ea7-a8a5-bf63ac357ea4 admin admin] The token cache is being invalidate because project 4a1f569e67f14cde8de0c51666cb20b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:30:25.081384 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-14422547-f061-4ea7-a8a5-bf63ac357ea4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:25.082123 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-14422547-f061-4ea7-a8a5-bf63ac357ea4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:25.084834 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1018/2012] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:30:24 2022] DELETE /identity/v3/projects/4a1f569e67f14cde8de0c51666cb20b7 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:25.088886 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14422547-f061-4ea7-a8a5-bf63ac357ea4 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:25.091374 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-14422547-f061-4ea7-a8a5-bf63ac357ea4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:25.166540 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e862fc3-b153-4b08-999a-69a5b044410d tempest-VolumeQuotaClassesTest-384819214 tempest-VolumeQuotaClassesTest-384819214-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e51cd04076b34f88bdb436334dea1012', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1a5146a78d4e118fcaf67078a6c612', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:25.167178 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e862fc3-b153-4b08-999a-69a5b044410d tempest-VolumeQuotaClassesTest-384819214 tempest-VolumeQuotaClassesTest-384819214-project-admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:25.167478 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e862fc3-b153-4b08-999a-69a5b044410d tempest-VolumeQuotaClassesTest-384819214 tempest-VolumeQuotaClassesTest-384819214-project-admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:25.167809 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e862fc3-b153-4b08-999a-69a5b044410d tempest-VolumeQuotaClassesTest-384819214 tempest-VolumeQuotaClassesTest-384819214-project-admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:25.168595 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e862fc3-b153-4b08-999a-69a5b044410d tempest-VolumeQuotaClassesTest-384819214 tempest-VolumeQuotaClassesTest-384819214-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:30:25.170869 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e862fc3-b153-4b08-999a-69a5b044410d tempest-VolumeQuotaClassesTest-384819214 tempest-VolumeQuotaClassesTest-384819214-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:25.172707 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e862fc3-b153-4b08-999a-69a5b044410d tempest-VolumeQuotaClassesTest-384819214 tempest-VolumeQuotaClassesTest-384819214-project-admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:25.191841 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 995/2013] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 30 01:30:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:30:25.192796 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e862fc3-b153-4b08-999a-69a5b044410d tempest-VolumeQuotaClassesTest-384819214 tempest-VolumeQuotaClassesTest-384819214-project-admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:25.195406 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-7e862fc3-b153-4b08-999a-69a5b044410d tempest-VolumeQuotaClassesTest-384819214 tempest-VolumeQuotaClassesTest-384819214-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:25.209188 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e862fc3-b153-4b08-999a-69a5b044410d tempest-VolumeQuotaClassesTest-384819214 tempest-VolumeQuotaClassesTest-384819214-project-admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:25.211960 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:25.215995 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5396589b-2758-4ecd-ad33-c786bee5074a tempest-VolumeQuotaClassesTest-384819214 tempest-VolumeQuotaClassesTest-384819214-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e51cd04076b34f88bdb436334dea1012', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1a5146a78d4e118fcaf67078a6c612', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:25.216983 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396589b-2758-4ecd-ad33-c786bee5074a tempest-VolumeQuotaClassesTest-384819214 tempest-VolumeQuotaClassesTest-384819214-project-admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:25.217581 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396589b-2758-4ecd-ad33-c786bee5074a tempest-VolumeQuotaClassesTest-384819214 tempest-VolumeQuotaClassesTest-384819214-project-admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:25.218017 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396589b-2758-4ecd-ad33-c786bee5074a tempest-VolumeQuotaClassesTest-384819214 tempest-VolumeQuotaClassesTest-384819214-project-admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:25.219131 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5396589b-2758-4ecd-ad33-c786bee5074a tempest-VolumeQuotaClassesTest-384819214 tempest-VolumeQuotaClassesTest-384819214-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:25.222749 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5396589b-2758-4ecd-ad33-c786bee5074a tempest-VolumeQuotaClassesTest-384819214 tempest-VolumeQuotaClassesTest-384819214-project-admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:25.230576 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14422547-f061-4ea7-a8a5-bf63ac357ea4 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:25.241316 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0315fed1-5dde-4750-93a5-539d28ac4ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:25.242205 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315fed1-5dde-4750-93a5-539d28ac4ff1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:25.242922 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315fed1-5dde-4750-93a5-539d28ac4ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:25.243685 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315fed1-5dde-4750-93a5-539d28ac4ff1 admin admin] PATH_INFO: `/v3/users/6287c1c2b59244699e88103c0e10943d` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:25.245802 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0315fed1-5dde-4750-93a5-539d28ac4ff1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6287c1c2b59244699e88103c0e10943d)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:25.250211 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0315fed1-5dde-4750-93a5-539d28ac4ff1 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:25.282276 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 996/2014] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:30:25 2022] POST /identity/v3/projects => generated 353 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:30:25.286591 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5396589b-2758-4ecd-ad33-c786bee5074a tempest-VolumeQuotaClassesTest-384819214 tempest-VolumeQuotaClassesTest-384819214-project-admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:25.330986 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-0315fed1-5dde-4750-93a5-539d28ac4ff1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6287c1c2b59244699e88103c0e10943d'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:25.345874 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-0315fed1-5dde-4750-93a5-539d28ac4ff1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6287c1c2b59244699e88103c0e10943d'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:25.346691 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-0315fed1-5dde-4750-93a5-539d28ac4ff1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6287c1c2b59244699e88103c0e10943d'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:25.374325 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-0315fed1-5dde-4750-93a5-539d28ac4ff1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6287c1c2b59244699e88103c0e10943d'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:25.375239 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-0315fed1-5dde-4750-93a5-539d28ac4ff1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6287c1c2b59244699e88103c0e10943d'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:25.377513 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:25.386321 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5396589b-2758-4ecd-ad33-c786bee5074a tempest-VolumeQuotaClassesTest-384819214 tempest-VolumeQuotaClassesTest-384819214-project-admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:25.393198 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9508f85b-96c9-4f7d-b323-0be60e5a0738 tempest-VolumeQuotaClassesTest-384819214 tempest-VolumeQuotaClassesTest-384819214-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e51cd04076b34f88bdb436334dea1012', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1a5146a78d4e118fcaf67078a6c612', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:25.394574 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9508f85b-96c9-4f7d-b323-0be60e5a0738 tempest-VolumeQuotaClassesTest-384819214 tempest-VolumeQuotaClassesTest-384819214-project-admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:25.394931 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9508f85b-96c9-4f7d-b323-0be60e5a0738 tempest-VolumeQuotaClassesTest-384819214 tempest-VolumeQuotaClassesTest-384819214-project-admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:25.395324 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9508f85b-96c9-4f7d-b323-0be60e5a0738 tempest-VolumeQuotaClassesTest-384819214 tempest-VolumeQuotaClassesTest-384819214-project-admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:25.396555 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9508f85b-96c9-4f7d-b323-0be60e5a0738 tempest-VolumeQuotaClassesTest-384819214 tempest-VolumeQuotaClassesTest-384819214-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:30:25.397488 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1019/2015] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:30:25 2022] DELETE /identity/v3/users/6287c1c2b59244699e88103c0e10943d => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:30:25.400484 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9508f85b-96c9-4f7d-b323-0be60e5a0738 tempest-VolumeQuotaClassesTest-384819214 tempest-VolumeQuotaClassesTest-384819214-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:25.400484 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9508f85b-96c9-4f7d-b323-0be60e5a0738 tempest-VolumeQuotaClassesTest-384819214 tempest-VolumeQuotaClassesTest-384819214-project-admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:25.449993 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 997/2016] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 30 01:30:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:30:25.486428 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0315fed1-5dde-4750-93a5-539d28ac4ff1 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:25.487950 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-0315fed1-5dde-4750-93a5-539d28ac4ff1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:25.513662 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9508f85b-96c9-4f7d-b323-0be60e5a0738 tempest-VolumeQuotaClassesTest-384819214 tempest-VolumeQuotaClassesTest-384819214-project-admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:25.516907 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-9508f85b-96c9-4f7d-b323-0be60e5a0738 tempest-VolumeQuotaClassesTest-384819214 tempest-VolumeQuotaClassesTest-384819214-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:25.592091 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0315fed1-5dde-4750-93a5-539d28ac4ff1 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:25.603247 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f9568-f63a-4c26-bf5f-104125822c68 tempest-VolumeQuotaClassesTest-384819214 tempest-VolumeQuotaClassesTest-384819214-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e51cd04076b34f88bdb436334dea1012', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1a5146a78d4e118fcaf67078a6c612', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:25.605617 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f9568-f63a-4c26-bf5f-104125822c68 tempest-VolumeQuotaClassesTest-384819214 tempest-VolumeQuotaClassesTest-384819214-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:25.606111 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f9568-f63a-4c26-bf5f-104125822c68 tempest-VolumeQuotaClassesTest-384819214 tempest-VolumeQuotaClassesTest-384819214-project-admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:25.609035 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f9568-f63a-4c26-bf5f-104125822c68 tempest-VolumeQuotaClassesTest-384819214 tempest-VolumeQuotaClassesTest-384819214-project-admin] PATH_INFO: `/v3/projects/e51dd56cad314292aae6e9060ba30267` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:25.614018 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9f9568-f63a-4c26-bf5f-104125822c68 tempest-VolumeQuotaClassesTest-384819214 tempest-VolumeQuotaClassesTest-384819214-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e51dd56cad314292aae6e9060ba30267)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:25.618579 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9f9568-f63a-4c26-bf5f-104125822c68 tempest-VolumeQuotaClassesTest-384819214 tempest-VolumeQuotaClassesTest-384819214-project-admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:25.676748 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9508f85b-96c9-4f7d-b323-0be60e5a0738 tempest-VolumeQuotaClassesTest-384819214 tempest-VolumeQuotaClassesTest-384819214-project-admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:25.708274 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-ff9f9568-f63a-4c26-bf5f-104125822c68 tempest-VolumeQuotaClassesTest-384819214 tempest-VolumeQuotaClassesTest-384819214-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e51dd56cad314292aae6e9060ba30267', 'request_id': 'req-ff9f9568-f63a-4c26-bf5f-104125822c68'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:25.741182 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-ff9f9568-f63a-4c26-bf5f-104125822c68 tempest-VolumeQuotaClassesTest-384819214 tempest-VolumeQuotaClassesTest-384819214-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e51dd56cad314292aae6e9060ba30267', 'request_id': 'req-ff9f9568-f63a-4c26-bf5f-104125822c68'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:25.760218 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-ff9f9568-f63a-4c26-bf5f-104125822c68 tempest-VolumeQuotaClassesTest-384819214 tempest-VolumeQuotaClassesTest-384819214-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e51dd56cad314292aae6e9060ba30267', 'request_id': 'req-ff9f9568-f63a-4c26-bf5f-104125822c68'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:25.789202 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-ff9f9568-f63a-4c26-bf5f-104125822c68 tempest-VolumeQuotaClassesTest-384819214 tempest-VolumeQuotaClassesTest-384819214-project-admin] The token cache is being invalidate because project e51dd56cad314292aae6e9060ba30267 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:30:25.790005 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-ff9f9568-f63a-4c26-bf5f-104125822c68 tempest-VolumeQuotaClassesTest-384819214 tempest-VolumeQuotaClassesTest-384819214-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:25.791302 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-ff9f9568-f63a-4c26-bf5f-104125822c68 tempest-VolumeQuotaClassesTest-384819214 tempest-VolumeQuotaClassesTest-384819214-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:25.795857 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1020/2017] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:30:25 2022] DELETE /identity/v3/projects/e51dd56cad314292aae6e9060ba30267 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:25.817351 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e046b-30d9-461f-989b-8f95aeb3e4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:25.818734 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e046b-30d9-461f-989b-8f95aeb3e4a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:25.820035 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e046b-30d9-461f-989b-8f95aeb3e4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:25.821069 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e046b-30d9-461f-989b-8f95aeb3e4a6 admin admin] PATH_INFO: `/v3/users/01fab6012a614edfbf28d44356292901` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:25.823000 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490e046b-30d9-461f-989b-8f95aeb3e4a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01fab6012a614edfbf28d44356292901)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:25.828874 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490e046b-30d9-461f-989b-8f95aeb3e4a6 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:25.982702 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-490e046b-30d9-461f-989b-8f95aeb3e4a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01fab6012a614edfbf28d44356292901'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:26.011699 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-490e046b-30d9-461f-989b-8f95aeb3e4a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01fab6012a614edfbf28d44356292901'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:26.012415 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-490e046b-30d9-461f-989b-8f95aeb3e4a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01fab6012a614edfbf28d44356292901'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:26.013066 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-490e046b-30d9-461f-989b-8f95aeb3e4a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01fab6012a614edfbf28d44356292901'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:26.039195 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-490e046b-30d9-461f-989b-8f95aeb3e4a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01fab6012a614edfbf28d44356292901'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:26.063065 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 998/2018] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:30:25 2022] DELETE /identity/v3/users/01fab6012a614edfbf28d44356292901 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:26.067966 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de6449c-41f2-42e1-9653-8eb2612db978 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:26.069097 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de6449c-41f2-42e1-9653-8eb2612db978 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:26.069097 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de6449c-41f2-42e1-9653-8eb2612db978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:26.079029 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:26.105360 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-6de6449c-41f2-42e1-9653-8eb2612db978 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:26.110450 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-6de6449c-41f2-42e1-9653-8eb2612db978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:26.142303 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e046b-30d9-461f-989b-8f95aeb3e4a6 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:26.143757 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-490e046b-30d9-461f-989b-8f95aeb3e4a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:26.186477 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:26.305356 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1021/2019] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:26.305356 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de6449c-41f2-42e1-9653-8eb2612db978 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:26.306883 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-6de6449c-41f2-42e1-9653-8eb2612db978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:26.319187 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e046b-30d9-461f-989b-8f95aeb3e4a6 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:26.325664 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d5b612-34d5-4c7f-a5ee-8a1a027660bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:26.326544 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5b612-34d5-4c7f-a5ee-8a1a027660bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:26.326903 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5b612-34d5-4c7f-a5ee-8a1a027660bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:26.327283 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5b612-34d5-4c7f-a5ee-8a1a027660bc admin admin] PATH_INFO: `/v3/projects/69921c83ea1749d791f3b9b5ce100559` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:26.327605 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de6449c-41f2-42e1-9653-8eb2612db978 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:26.329116 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d5b612-34d5-4c7f-a5ee-8a1a027660bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=69921c83ea1749d791f3b9b5ce100559)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:26.331947 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d5b612-34d5-4c7f-a5ee-8a1a027660bc admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:26.332844 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fc7c5c-dc7d-4eb8-aa1e-53f28a51a66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:26.333534 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc7c5c-dc7d-4eb8-aa1e-53f28a51a66b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:26.333809 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc7c5c-dc7d-4eb8-aa1e-53f28a51a66b admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:26.334395 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc7c5c-dc7d-4eb8-aa1e-53f28a51a66b admin admin] PATH_INFO: `/v3/users/fcad38c49c2c483da2ba5faf4d4a626a` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:26.335943 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fc7c5c-dc7d-4eb8-aa1e-53f28a51a66b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcad38c49c2c483da2ba5faf4d4a626a)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:26.338346 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fc7c5c-dc7d-4eb8-aa1e-53f28a51a66b admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:26.407367 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-f0fc7c5c-dc7d-4eb8-aa1e-53f28a51a66b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcad38c49c2c483da2ba5faf4d4a626a'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:26.408369 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-16d5b612-34d5-4c7f-a5ee-8a1a027660bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69921c83ea1749d791f3b9b5ce100559', 'request_id': 'req-16d5b612-34d5-4c7f-a5ee-8a1a027660bc'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:26.417618 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-16d5b612-34d5-4c7f-a5ee-8a1a027660bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69921c83ea1749d791f3b9b5ce100559', 'request_id': 'req-16d5b612-34d5-4c7f-a5ee-8a1a027660bc'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:26.422487 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-f0fc7c5c-dc7d-4eb8-aa1e-53f28a51a66b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcad38c49c2c483da2ba5faf4d4a626a'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:26.423330 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-f0fc7c5c-dc7d-4eb8-aa1e-53f28a51a66b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcad38c49c2c483da2ba5faf4d4a626a'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:26.426388 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-16d5b612-34d5-4c7f-a5ee-8a1a027660bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69921c83ea1749d791f3b9b5ce100559', 'request_id': 'req-16d5b612-34d5-4c7f-a5ee-8a1a027660bc'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:26.441457 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-16d5b612-34d5-4c7f-a5ee-8a1a027660bc admin admin] The token cache is being invalidate because project 69921c83ea1749d791f3b9b5ce100559 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81447) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:30:26.442025 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-16d5b612-34d5-4c7f-a5ee-8a1a027660bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:26.442695 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-f0fc7c5c-dc7d-4eb8-aa1e-53f28a51a66b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcad38c49c2c483da2ba5faf4d4a626a'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:26.444154 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-f0fc7c5c-dc7d-4eb8-aa1e-53f28a51a66b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcad38c49c2c483da2ba5faf4d4a626a'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:26.444756 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-16d5b612-34d5-4c7f-a5ee-8a1a027660bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:26.446333 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 999/2020] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:30:26 2022] DELETE /identity/v3/projects/69921c83ea1749d791f3b9b5ce100559 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:26.447186 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d5b612-34d5-4c7f-a5ee-8a1a027660bc admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:26.452129 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-16d5b612-34d5-4c7f-a5ee-8a1a027660bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:26.462999 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1022/2021] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:30:26 2022] DELETE /identity/v3/users/fcad38c49c2c483da2ba5faf4d4a626a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:26.464443 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73588939-0678-44fe-8594-5c25edd14823 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:26.464726 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73588939-0678-44fe-8594-5c25edd14823 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:26.465006 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73588939-0678-44fe-8594-5c25edd14823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:26.489752 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-73588939-0678-44fe-8594-5c25edd14823 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:26.492149 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-73588939-0678-44fe-8594-5c25edd14823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:26.564726 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d5b612-34d5-4c7f-a5ee-8a1a027660bc admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:26.622139 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1023/2022] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:26.623973 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df6311-04b1-4f66-98eb-b5d1f0f0eeaf None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:26.624487 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df6311-04b1-4f66-98eb-b5d1f0f0eeaf None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:26.624981 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df6311-04b1-4f66-98eb-b5d1f0f0eeaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:26.648658 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-02df6311-04b1-4f66-98eb-b5d1f0f0eeaf None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:26.651133 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-02df6311-04b1-4f66-98eb-b5d1f0f0eeaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:26.662871 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1024/2023] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:26.664850 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d43371-4458-442b-a4cd-69ef18bc7cf0 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:26.665547 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d43371-4458-442b-a4cd-69ef18bc7cf0 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:26.666281 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d43371-4458-442b-a4cd-69ef18bc7cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:26.670714 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a3093-b694-4304-8882-d0fc5a552310 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:26.671658 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a3093-b694-4304-8882-d0fc5a552310 service neutron] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:26.672008 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a3093-b694-4304-8882-d0fc5a552310 service neutron] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:26.672465 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a3093-b694-4304-8882-d0fc5a552310 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:26.674327 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-751a3093-b694-4304-8882-d0fc5a552310 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:26.687942 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751a3093-b694-4304-8882-d0fc5a552310 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:26.704066 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751a3093-b694-4304-8882-d0fc5a552310 service neutron] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:26.712905 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-13d43371-4458-442b-a4cd-69ef18bc7cf0 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:26.714189 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-13d43371-4458-442b-a4cd-69ef18bc7cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:26.723362 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1000/2024] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:30:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:30:26.729013 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a3093-b694-4304-8882-d0fc5a552310 service neutron] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:26.730940 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-751a3093-b694-4304-8882-d0fc5a552310 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:26.731621 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1025/2025] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:26.735540 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d43371-4458-442b-a4cd-69ef18bc7cf0 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:26.741034 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:26.743696 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:26.747321 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d43371-4458-442b-a4cd-69ef18bc7cf0 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:26.748270 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a3093-b694-4304-8882-d0fc5a552310 service neutron] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:26.757702 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935bdbb8-9563-4fa6-8c72-ea1b031878d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:26.759189 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935bdbb8-9563-4fa6-8c72-ea1b031878d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:26.760344 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ba1fb8-3644-4e56-b8c9-8b8157e329a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:26.760555 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935bdbb8-9563-4fa6-8c72-ea1b031878d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:26.760833 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935bdbb8-9563-4fa6-8c72-ea1b031878d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:26.761367 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba1fb8-3644-4e56-b8c9-8b8157e329a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:26.762462 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba1fb8-3644-4e56-b8c9-8b8157e329a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:26.763139 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba1fb8-3644-4e56-b8c9-8b8157e329a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:26.764011 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ba1fb8-3644-4e56-b8c9-8b8157e329a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:30:26.764798 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ba1fb8-3644-4e56-b8c9-8b8157e329a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:26.767711 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ba1fb8-3644-4e56-b8c9-8b8157e329a0 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:26.776960 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935bdbb8-9563-4fa6-8c72-ea1b031878d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:26.778515 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935bdbb8-9563-4fa6-8c72-ea1b031878d3 service neutron] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:26.783684 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1026/2026] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 30 01:30:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:30:26.788825 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ba1fb8-3644-4e56-b8c9-8b8157e329a0 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:26.798574 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1001/2027] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:30:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:30:26.804316 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ba1fb8-3644-4e56-b8c9-8b8157e329a0 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:26.810877 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e4f41c-bed3-49da-bb73-0e07dbf98d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:26.811967 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4f41c-bed3-49da-bb73-0e07dbf98d8e admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:26.812458 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4f41c-bed3-49da-bb73-0e07dbf98d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:26.813153 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4f41c-bed3-49da-bb73-0e07dbf98d8e admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:26.814298 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e4f41c-bed3-49da-bb73-0e07dbf98d8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:26.816578 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e4f41c-bed3-49da-bb73-0e07dbf98d8e admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:26.889644 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1027/2028] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:30:26 2022] POST /identity/v3/projects => generated 379 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:30:26.895130 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935bdbb8-9563-4fa6-8c72-ea1b031878d3 service neutron] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:26.908806 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935bdbb8-9563-4fa6-8c72-ea1b031878d3 service neutron] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:27.016573 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a609d54-44fd-470d-8b9b-c9870828a45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:27.017229 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a609d54-44fd-470d-8b9b-c9870828a45b admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:27.017505 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a609d54-44fd-470d-8b9b-c9870828a45b admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:27.017772 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a609d54-44fd-470d-8b9b-c9870828a45b admin admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:27.018556 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a609d54-44fd-470d-8b9b-c9870828a45b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:27.023123 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a609d54-44fd-470d-8b9b-c9870828a45b admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:27.074568 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1002/2029] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:30:26 2022] POST /identity/v3/users => generated 290 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:30:27.079473 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e4f41c-bed3-49da-bb73-0e07dbf98d8e admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:27.094602 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e4f41c-bed3-49da-bb73-0e07dbf98d8e admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:27.111172 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd921b-20c2-474d-977d-0205f21b050f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:27.111848 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd921b-20c2-474d-977d-0205f21b050f admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:27.112130 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd921b-20c2-474d-977d-0205f21b050f admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:27.112402 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd921b-20c2-474d-977d-0205f21b050f admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:27.113306 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdd921b-20c2-474d-977d-0205f21b050f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:27.114965 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdd921b-20c2-474d-977d-0205f21b050f admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:27.143803 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a609d54-44fd-470d-8b9b-c9870828a45b admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:27.144017 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1028/2030] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:30:27.182609 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a609d54-44fd-470d-8b9b-c9870828a45b admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:27.205405 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7842e76-22da-424c-b2f3-e87993818cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:27.208536 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7842e76-22da-424c-b2f3-e87993818cf8 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:27.211943 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7842e76-22da-424c-b2f3-e87993818cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:27.214517 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7842e76-22da-424c-b2f3-e87993818cf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:27.219248 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7842e76-22da-424c-b2f3-e87993818cf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:27.228606 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7842e76-22da-424c-b2f3-e87993818cf8 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:27.253692 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1003/2031] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:30:27.258415 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd921b-20c2-474d-977d-0205f21b050f admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:27.269593 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd921b-20c2-474d-977d-0205f21b050f admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:27.287144 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a61d66-bdad-4001-9aa3-2856dea29334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:27.288017 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a61d66-bdad-4001-9aa3-2856dea29334 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:27.288303 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a61d66-bdad-4001-9aa3-2856dea29334 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:27.288581 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a61d66-bdad-4001-9aa3-2856dea29334 admin admin] PATH_INFO: `/v3/projects/6f3dd146e8ed4b3da377b32aae52a870/users/2d484c03da654b25ac3ca0c67df9f408/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:27.318185 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a61d66-bdad-4001-9aa3-2856dea29334 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f3dd146e8ed4b3da377b32aae52a870, user_id=2d484c03da654b25ac3ca0c67df9f408, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:27.320327 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a61d66-bdad-4001-9aa3-2856dea29334 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:27.340011 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1029/2032] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:30:27 2022] PUT /identity/v3/projects/6f3dd146e8ed4b3da377b32aae52a870/users/2d484c03da654b25ac3ca0c67df9f408/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:27.355422 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffaefaf-2eea-47b6-9572-13261ba7b2fd None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:27.355961 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffaefaf-2eea-47b6-9572-13261ba7b2fd None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:27.356553 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffaefaf-2eea-47b6-9572-13261ba7b2fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:27.361080 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a61d66-bdad-4001-9aa3-2856dea29334 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:27.388377 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-e0a61d66-bdad-4001-9aa3-2856dea29334 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:27.520721 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-0ffaefaf-2eea-47b6-9572-13261ba7b2fd None None] MFA Rules not processed for user `2d484c03da654b25ac3ca0c67df9f408`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:27.524652 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-0ffaefaf-2eea-47b6-9572-13261ba7b2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:27.567349 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a61d66-bdad-4001-9aa3-2856dea29334 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:27.580536 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980cb011-904d-4e8a-8cc3-1b8e11008a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:27.587293 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980cb011-904d-4e8a-8cc3-1b8e11008a48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:27.587679 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980cb011-904d-4e8a-8cc3-1b8e11008a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:27.599446 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980cb011-904d-4e8a-8cc3-1b8e11008a48 admin admin] PATH_INFO: `/v3/projects/ed2a58250713470ea653dfa8ab496c9e` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:27.599446 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980cb011-904d-4e8a-8cc3-1b8e11008a48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed2a58250713470ea653dfa8ab496c9e)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:27.599446 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980cb011-904d-4e8a-8cc3-1b8e11008a48 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:27.703788 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-980cb011-904d-4e8a-8cc3-1b8e11008a48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed2a58250713470ea653dfa8ab496c9e', 'request_id': 'req-980cb011-904d-4e8a-8cc3-1b8e11008a48'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:27.730250 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-980cb011-904d-4e8a-8cc3-1b8e11008a48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed2a58250713470ea653dfa8ab496c9e', 'request_id': 'req-980cb011-904d-4e8a-8cc3-1b8e11008a48'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:27.743134 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1004/2033] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:27 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:27.744345 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffaefaf-2eea-47b6-9572-13261ba7b2fd None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:27.748520 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-0ffaefaf-2eea-47b6-9572-13261ba7b2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:27.753018 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-980cb011-904d-4e8a-8cc3-1b8e11008a48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed2a58250713470ea653dfa8ab496c9e', 'request_id': 'req-980cb011-904d-4e8a-8cc3-1b8e11008a48'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:27.769770 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-980cb011-904d-4e8a-8cc3-1b8e11008a48 admin admin] The token cache is being invalidate because project ed2a58250713470ea653dfa8ab496c9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:30:27.770076 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-980cb011-904d-4e8a-8cc3-1b8e11008a48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:27.770956 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-980cb011-904d-4e8a-8cc3-1b8e11008a48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:27.773001 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1030/2034] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:30:27 2022] DELETE /identity/v3/projects/ed2a58250713470ea653dfa8ab496c9e => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:27.776943 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffaefaf-2eea-47b6-9572-13261ba7b2fd None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:27.792669 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980cb011-904d-4e8a-8cc3-1b8e11008a48 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:27.795111 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-980cb011-904d-4e8a-8cc3-1b8e11008a48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:27.887273 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:27.936226 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054583ef-0a53-48ff-bd5d-a03e364d37ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:27.937107 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054583ef-0a53-48ff-bd5d-a03e364d37ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:27.937391 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054583ef-0a53-48ff-bd5d-a03e364d37ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:27.937665 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054583ef-0a53-48ff-bd5d-a03e364d37ce admin admin] PATH_INFO: `/v3/projects/059960932a7b4d28bea100cbcf331d5c` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:27.940564 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054583ef-0a53-48ff-bd5d-a03e364d37ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=059960932a7b4d28bea100cbcf331d5c)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:27.942507 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054583ef-0a53-48ff-bd5d-a03e364d37ce admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:27.946160 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:27.982796 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980cb011-904d-4e8a-8cc3-1b8e11008a48 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:27.996044 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63fc48c-9e54-4fb4-bfd4-d31ddb508168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:27.996823 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63fc48c-9e54-4fb4-bfd4-d31ddb508168 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:27.997161 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63fc48c-9e54-4fb4-bfd4-d31ddb508168 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:27.997480 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63fc48c-9e54-4fb4-bfd4-d31ddb508168 admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:27.998249 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63fc48c-9e54-4fb4-bfd4-d31ddb508168 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:28.000561 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63fc48c-9e54-4fb4-bfd4-d31ddb508168 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:28.045409 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-054583ef-0a53-48ff-bd5d-a03e364d37ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '059960932a7b4d28bea100cbcf331d5c', 'request_id': 'req-054583ef-0a53-48ff-bd5d-a03e364d37ce'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:28.055921 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-054583ef-0a53-48ff-bd5d-a03e364d37ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '059960932a7b4d28bea100cbcf331d5c', 'request_id': 'req-054583ef-0a53-48ff-bd5d-a03e364d37ce'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:28.057894 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1031/2035] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:30:27 2022] POST /identity/v3/projects => generated 381 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:30:28.059249 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8208d-9d67-4d91-97a5-bfafae852f3f None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:28.059738 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8208d-9d67-4d91-97a5-bfafae852f3f None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:28.059928 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8208d-9d67-4d91-97a5-bfafae852f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:28.074586 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-054583ef-0a53-48ff-bd5d-a03e364d37ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '059960932a7b4d28bea100cbcf331d5c', 'request_id': 'req-054583ef-0a53-48ff-bd5d-a03e364d37ce'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:28.089979 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-14a8208d-9d67-4d91-97a5-bfafae852f3f None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:28.090533 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-054583ef-0a53-48ff-bd5d-a03e364d37ce admin admin] The token cache is being invalidate because project 059960932a7b4d28bea100cbcf331d5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81447) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:30:28.090997 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-054583ef-0a53-48ff-bd5d-a03e364d37ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:28.091206 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-14a8208d-9d67-4d91-97a5-bfafae852f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:28.092344 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-054583ef-0a53-48ff-bd5d-a03e364d37ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:28.094471 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1005/2036] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:30:27 2022] DELETE /identity/v3/projects/059960932a7b4d28bea100cbcf331d5c => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:28.097768 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054583ef-0a53-48ff-bd5d-a03e364d37ce admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:28.097768 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-054583ef-0a53-48ff-bd5d-a03e364d37ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:28.169591 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1032/2037] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:28.170267 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a8208d-9d67-4d91-97a5-bfafae852f3f None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:28.171658 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-14a8208d-9d67-4d91-97a5-bfafae852f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:28.186604 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a8208d-9d67-4d91-97a5-bfafae852f3f None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:28.193923 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d894a2fc-0964-4391-9703-a927eabceced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:28.194692 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894a2fc-0964-4391-9703-a927eabceced admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:28.195133 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894a2fc-0964-4391-9703-a927eabceced admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:28.195412 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894a2fc-0964-4391-9703-a927eabceced admin admin] PATH_INFO: `/v3/users/e51cd04076b34f88bdb436334dea1012` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:28.196652 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d894a2fc-0964-4391-9703-a927eabceced admin admin] RBAC: Authorizing `identity:delete_user(user_id=e51cd04076b34f88bdb436334dea1012)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:28.197127 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054583ef-0a53-48ff-bd5d-a03e364d37ce admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:28.198610 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d894a2fc-0964-4391-9703-a927eabceced admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:28.210738 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b3360b-2f4a-4f19-bc82-5450f38c29b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:28.214539 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3360b-2f4a-4f19-bc82-5450f38c29b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:28.215107 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3360b-2f4a-4f19-bc82-5450f38c29b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:28.215748 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3360b-2f4a-4f19-bc82-5450f38c29b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:28.218023 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b3360b-2f4a-4f19-bc82-5450f38c29b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:28.222673 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b3360b-2f4a-4f19-bc82-5450f38c29b7 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:28.261538 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1006/2038] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:30:28 2022] POST /identity/v3/users => generated 297 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:30:28.263495 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde95e84-3e61-49bf-9415-e8f1e7719718 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:28.264237 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde95e84-3e61-49bf-9415-e8f1e7719718 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:28.264994 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde95e84-3e61-49bf-9415-e8f1e7719718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:28.291181 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-d894a2fc-0964-4391-9703-a927eabceced admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e51cd04076b34f88bdb436334dea1012'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:28.298082 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-dde95e84-3e61-49bf-9415-e8f1e7719718 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:28.300505 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-dde95e84-3e61-49bf-9415-e8f1e7719718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:28.308859 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-d894a2fc-0964-4391-9703-a927eabceced admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e51cd04076b34f88bdb436334dea1012'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:28.310015 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-d894a2fc-0964-4391-9703-a927eabceced admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e51cd04076b34f88bdb436334dea1012'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:28.314593 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1007/2039] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:28.315902 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde95e84-3e61-49bf-9415-e8f1e7719718 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:28.329577 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde95e84-3e61-49bf-9415-e8f1e7719718 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:28.332586 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-d894a2fc-0964-4391-9703-a927eabceced admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e51cd04076b34f88bdb436334dea1012'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:28.334990 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-d894a2fc-0964-4391-9703-a927eabceced admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e51cd04076b34f88bdb436334dea1012'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:28.340725 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcc281c-60bb-4914-aaca-04333dde6ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:28.342101 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc281c-60bb-4914-aaca-04333dde6ea2 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:28.342742 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc281c-60bb-4914-aaca-04333dde6ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:28.343213 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc281c-60bb-4914-aaca-04333dde6ea2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:28.344226 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcc281c-60bb-4914-aaca-04333dde6ea2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:28.346312 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcc281c-60bb-4914-aaca-04333dde6ea2 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:28.359382 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1008/2040] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:30:28 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:30:28.360767 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcc281c-60bb-4914-aaca-04333dde6ea2 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:28.362848 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-bdcc281c-60bb-4914-aaca-04333dde6ea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:28.372236 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1033/2041] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:30:28 2022] DELETE /identity/v3/users/e51cd04076b34f88bdb436334dea1012 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:28.373519 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d894a2fc-0964-4391-9703-a927eabceced admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:28.378952 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-d894a2fc-0964-4391-9703-a927eabceced admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:28.396395 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcc281c-60bb-4914-aaca-04333dde6ea2 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:28.430325 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:28.526834 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d894a2fc-0964-4391-9703-a927eabceced admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:28.537316 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c4838e-b721-4537-b564-b4d98ae5f3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:28.538589 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4838e-b721-4537-b564-b4d98ae5f3ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:28.538934 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4838e-b721-4537-b564-b4d98ae5f3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:28.539222 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4838e-b721-4537-b564-b4d98ae5f3ca admin admin] PATH_INFO: `/v3/projects/7466efa6c13149ddaa3cada7cdb9b64a/users/c47acddf08a94bbcbf925f865bda277e/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:28.558568 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e977a99-8aa7-40bb-a4de-bf7a45091b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:28.561813 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e977a99-8aa7-40bb-a4de-bf7a45091b17 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:28.562210 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e977a99-8aa7-40bb-a4de-bf7a45091b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:28.562783 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e977a99-8aa7-40bb-a4de-bf7a45091b17 admin admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:28.562901 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c4838e-b721-4537-b564-b4d98ae5f3ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=7466efa6c13149ddaa3cada7cdb9b64a, user_id=c47acddf08a94bbcbf925f865bda277e, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:28.563665 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e977a99-8aa7-40bb-a4de-bf7a45091b17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:30:28.564891 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e977a99-8aa7-40bb-a4de-bf7a45091b17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:28.566032 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c4838e-b721-4537-b564-b4d98ae5f3ca admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:28.570135 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e977a99-8aa7-40bb-a4de-bf7a45091b17 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:28.579090 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:28.596333 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1034/2042] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:30:28 2022] PUT /identity/v3/projects/7466efa6c13149ddaa3cada7cdb9b64a/users/c47acddf08a94bbcbf925f865bda277e/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:28.600775 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c4838e-b721-4537-b564-b4d98ae5f3ca admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:28.614645 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1009/2043] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 30 01:30:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:30:28.620394 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e977a99-8aa7-40bb-a4de-bf7a45091b17 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:28.645401 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e977a99-8aa7-40bb-a4de-bf7a45091b17 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:28.781297 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c4838e-b721-4537-b564-b4d98ae5f3ca admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:28.787540 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7499110b-f3c6-40fa-86a8-e28357a87bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:28.788427 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7499110b-f3c6-40fa-86a8-e28357a87bf8 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:28.788814 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7499110b-f3c6-40fa-86a8-e28357a87bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:28.789287 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7499110b-f3c6-40fa-86a8-e28357a87bf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:28.790114 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7499110b-f3c6-40fa-86a8-e28357a87bf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:28.792518 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7499110b-f3c6-40fa-86a8-e28357a87bf8 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:28.798734 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d976b4-823b-4fbf-abd3-045fc6de4a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:28.799690 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d976b4-823b-4fbf-abd3-045fc6de4a8e admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:28.800142 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d976b4-823b-4fbf-abd3-045fc6de4a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:28.800561 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d976b4-823b-4fbf-abd3-045fc6de4a8e admin admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:28.802140 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d976b4-823b-4fbf-abd3-045fc6de4a8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:28.808228 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d976b4-823b-4fbf-abd3-045fc6de4a8e admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:28.808540 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1035/2044] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:30:28 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:30:28.812840 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7499110b-f3c6-40fa-86a8-e28357a87bf8 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:28.856347 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7499110b-f3c6-40fa-86a8-e28357a87bf8 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:28.864921 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1010/2045] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:30:28 2022] POST /identity/v3/projects => generated 373 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:30:28.867205 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d976b4-823b-4fbf-abd3-045fc6de4a8e admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:29.006425 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d976b4-823b-4fbf-abd3-045fc6de4a8e admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:29.012230 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f644a248-803e-45b5-8db3-7b8131d2d4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:29.013806 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f644a248-803e-45b5-8db3-7b8131d2d4ac admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:29.014266 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f644a248-803e-45b5-8db3-7b8131d2d4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:29.014907 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f644a248-803e-45b5-8db3-7b8131d2d4ac admin admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:29.015828 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f644a248-803e-45b5-8db3-7b8131d2d4ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:29.018610 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f644a248-803e-45b5-8db3-7b8131d2d4ac admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:29.057419 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1011/2046] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:30:28 2022] POST /identity/v3/users => generated 287 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:30:29.059823 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f644a248-803e-45b5-8db3-7b8131d2d4ac admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:29.062528 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-f644a248-803e-45b5-8db3-7b8131d2d4ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:29.074604 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708bb355-4ae0-4f2a-9777-30168ab82203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:29.075360 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708bb355-4ae0-4f2a-9777-30168ab82203 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:29.077048 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708bb355-4ae0-4f2a-9777-30168ab82203 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:29.077340 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708bb355-4ae0-4f2a-9777-30168ab82203 admin admin] PATH_INFO: `/v3/projects/7466efa6c13149ddaa3cada7cdb9b64a/users/c47acddf08a94bbcbf925f865bda277e/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:29.088671 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708bb355-4ae0-4f2a-9777-30168ab82203 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7466efa6c13149ddaa3cada7cdb9b64a, user_id=c47acddf08a94bbcbf925f865bda277e, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:29.090693 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f644a248-803e-45b5-8db3-7b8131d2d4ac admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:29.091809 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708bb355-4ae0-4f2a-9777-30168ab82203 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:29.102419 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedbaf83-67c9-42a6-9f89-6c830b01941b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:29.103036 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbaf83-67c9-42a6-9f89-6c830b01941b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:29.104125 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbaf83-67c9-42a6-9f89-6c830b01941b admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:29.104998 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbaf83-67c9-42a6-9f89-6c830b01941b admin admin] PATH_INFO: `/v3/projects/9d1a5146a78d4e118fcaf67078a6c612` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:29.106466 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedbaf83-67c9-42a6-9f89-6c830b01941b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d1a5146a78d4e118fcaf67078a6c612)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:29.108706 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedbaf83-67c9-42a6-9f89-6c830b01941b admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:29.129351 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1036/2047] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:30:28 2022] PUT /identity/v3/projects/7466efa6c13149ddaa3cada7cdb9b64a/users/c47acddf08a94bbcbf925f865bda277e/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:29.130113 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708bb355-4ae0-4f2a-9777-30168ab82203 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:29.195597 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:29.217250 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-dedbaf83-67c9-42a6-9f89-6c830b01941b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d1a5146a78d4e118fcaf67078a6c612', 'request_id': 'req-dedbaf83-67c9-42a6-9f89-6c830b01941b'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:29.228774 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-dedbaf83-67c9-42a6-9f89-6c830b01941b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d1a5146a78d4e118fcaf67078a6c612', 'request_id': 'req-dedbaf83-67c9-42a6-9f89-6c830b01941b'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:29.244306 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708bb355-4ae0-4f2a-9777-30168ab82203 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:29.247449 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-dedbaf83-67c9-42a6-9f89-6c830b01941b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d1a5146a78d4e118fcaf67078a6c612', 'request_id': 'req-dedbaf83-67c9-42a6-9f89-6c830b01941b'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:29.258884 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:29.280565 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-dedbaf83-67c9-42a6-9f89-6c830b01941b admin admin] The token cache is being invalidate because project 9d1a5146a78d4e118fcaf67078a6c612 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81447) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:30:29.283635 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-dedbaf83-67c9-42a6-9f89-6c830b01941b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:29.284634 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-dedbaf83-67c9-42a6-9f89-6c830b01941b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:29.291977 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1012/2048] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:30:29 2022] DELETE /identity/v3/projects/9d1a5146a78d4e118fcaf67078a6c612 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:29.292947 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11518b9a-dbc0-48fb-8e98-8fb1d4d90b81 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:29.293683 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11518b9a-dbc0-48fb-8e98-8fb1d4d90b81 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:29.293969 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11518b9a-dbc0-48fb-8e98-8fb1d4d90b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:29.359211 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433cd0a0-45c1-42e7-9257-8c695a268f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:29.360197 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433cd0a0-45c1-42e7-9257-8c695a268f33 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:29.360622 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433cd0a0-45c1-42e7-9257-8c695a268f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:29.361157 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433cd0a0-45c1-42e7-9257-8c695a268f33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:29.361841 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433cd0a0-45c1-42e7-9257-8c695a268f33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:29.364438 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433cd0a0-45c1-42e7-9257-8c695a268f33 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:29.376355 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-11518b9a-dbc0-48fb-8e98-8fb1d4d90b81 None None] MFA Rules not processed for user `c47acddf08a94bbcbf925f865bda277e`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:29.377625 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-11518b9a-dbc0-48fb-8e98-8fb1d4d90b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:29.382261 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1037/2049] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:30:29 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:30:29.384094 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfbb659-8493-42e6-bd41-bceb9a8cd2c6 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:29.384319 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfbb659-8493-42e6-bd41-bceb9a8cd2c6 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:29.385397 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfbb659-8493-42e6-bd41-bceb9a8cd2c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:29.426379 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-2dfbb659-8493-42e6-bd41-bceb9a8cd2c6 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:29.428856 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-2dfbb659-8493-42e6-bd41-bceb9a8cd2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:29.442170 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1038/2050] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:29.442928 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfbb659-8493-42e6-bd41-bceb9a8cd2c6 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:29.445011 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-2dfbb659-8493-42e6-bd41-bceb9a8cd2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:29.462335 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfbb659-8493-42e6-bd41-bceb9a8cd2c6 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:29.468650 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64754f8-37b0-43d9-8f51-e7b425b49134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:29.469897 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64754f8-37b0-43d9-8f51-e7b425b49134 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:29.470177 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64754f8-37b0-43d9-8f51-e7b425b49134 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:29.470448 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64754f8-37b0-43d9-8f51-e7b425b49134 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:29.471111 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64754f8-37b0-43d9-8f51-e7b425b49134 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:29.473445 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64754f8-37b0-43d9-8f51-e7b425b49134 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:29.486676 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1039/2051] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:30:29 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:30:29.487883 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc418c8d-a40e-4103-8e9b-9ef5eb5557d0 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:29.488166 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc418c8d-a40e-4103-8e9b-9ef5eb5557d0 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:29.488445 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc418c8d-a40e-4103-8e9b-9ef5eb5557d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:29.516335 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1013/2052] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:29 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:29.518916 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11518b9a-dbc0-48fb-8e98-8fb1d4d90b81 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:29.520906 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-fc418c8d-a40e-4103-8e9b-9ef5eb5557d0 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:29.522774 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-fc418c8d-a40e-4103-8e9b-9ef5eb5557d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:29.532461 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11518b9a-dbc0-48fb-8e98-8fb1d4d90b81 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:29.536169 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1040/2053] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:29.537128 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc418c8d-a40e-4103-8e9b-9ef5eb5557d0 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:29.538481 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-fc418c8d-a40e-4103-8e9b-9ef5eb5557d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:29.546677 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8c285-f90f-40c3-88e5-9156de76cd38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:29.547360 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8c285-f90f-40c3-88e5-9156de76cd38 admin admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:29.547672 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8c285-f90f-40c3-88e5-9156de76cd38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:29.547951 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8c285-f90f-40c3-88e5-9156de76cd38 admin admin] PATH_INFO: `/v3/projects/d75b1164a0ad407f98c9984df3366bc1/users/9c090ad3fe494672b5fece2ed600057e/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:29.581603 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e8c285-f90f-40c3-88e5-9156de76cd38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d75b1164a0ad407f98c9984df3366bc1, user_id=9c090ad3fe494672b5fece2ed600057e, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:29.588202 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e8c285-f90f-40c3-88e5-9156de76cd38 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:29.627014 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1014/2054] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:30:29 2022] PUT /identity/v3/projects/d75b1164a0ad407f98c9984df3366bc1/users/9c090ad3fe494672b5fece2ed600057e/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:29.627951 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8c285-f90f-40c3-88e5-9156de76cd38 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:29.664991 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc418c8d-a40e-4103-8e9b-9ef5eb5557d0 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:29.744012 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8c285-f90f-40c3-88e5-9156de76cd38 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:29.748717 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18790e1-b116-412f-a4eb-e3b0adb0ea78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:29.749244 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18790e1-b116-412f-a4eb-e3b0adb0ea78 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:29.749573 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18790e1-b116-412f-a4eb-e3b0adb0ea78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:29.749852 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18790e1-b116-412f-a4eb-e3b0adb0ea78 admin admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:29.750512 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18790e1-b116-412f-a4eb-e3b0adb0ea78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:30:29.750816 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18790e1-b116-412f-a4eb-e3b0adb0ea78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:29.752501 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18790e1-b116-412f-a4eb-e3b0adb0ea78 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:29.767246 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1015/2055] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 30 01:30:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:30:29.770061 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fde27f-99f2-400f-87fa-a4eb5fdc3966 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:29.771018 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fde27f-99f2-400f-87fa-a4eb5fdc3966 service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:29.771223 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fde27f-99f2-400f-87fa-a4eb5fdc3966 service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:29.771535 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fde27f-99f2-400f-87fa-a4eb5fdc3966 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:29.772454 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094fe788-515e-4409-ba14-dd4ec98743b1 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:29.772835 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094fe788-515e-4409-ba14-dd4ec98743b1 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:29.773207 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094fe788-515e-4409-ba14-dd4ec98743b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:29.794838 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-094fe788-515e-4409-ba14-dd4ec98743b1 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:29.796617 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:29.798071 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-094fe788-515e-4409-ba14-dd4ec98743b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:29.810963 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1016/2056] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:29.812067 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094fe788-515e-4409-ba14-dd4ec98743b1 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:29.826879 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094fe788-515e-4409-ba14-dd4ec98743b1 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:29.833239 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a5e21-09e5-4359-9b7d-61ed67f36e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:29.833957 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a5e21-09e5-4359-9b7d-61ed67f36e5f admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:29.834282 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a5e21-09e5-4359-9b7d-61ed67f36e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:29.835715 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a5e21-09e5-4359-9b7d-61ed67f36e5f admin admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:29.839723 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10a5e21-09e5-4359-9b7d-61ed67f36e5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:29.844581 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10a5e21-09e5-4359-9b7d-61ed67f36e5f admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:29.852649 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fde27f-99f2-400f-87fa-a4eb5fdc3966 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:29.854197 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fde27f-99f2-400f-87fa-a4eb5fdc3966 service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:29.864250 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1041/2057] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:30:29 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:30:29.864949 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fde27f-99f2-400f-87fa-a4eb5fdc3966 service cinder] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:29.866851 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-64fde27f-99f2-400f-87fa-a4eb5fdc3966 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:29.882918 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1017/2058] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:30:29 2022] POST /identity/v3/projects => generated 385 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:30:29.887867 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a5e21-09e5-4359-9b7d-61ed67f36e5f admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:29.911749 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:29.942438 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fde27f-99f2-400f-87fa-a4eb5fdc3966 service cinder] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:29.966718 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a5e21-09e5-4359-9b7d-61ed67f36e5f admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:29.972438 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74314278-a642-4335-aba7-ac193a896309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:29.973208 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74314278-a642-4335-aba7-ac193a896309 admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:29.973540 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74314278-a642-4335-aba7-ac193a896309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:29.973848 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74314278-a642-4335-aba7-ac193a896309 admin admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:29.976796 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74314278-a642-4335-aba7-ac193a896309 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:29.977785 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74314278-a642-4335-aba7-ac193a896309 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:30.018922 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1018/2059] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:30:29 2022] POST /identity/v3/users => generated 293 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:30:30.020042 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a5fa51-246f-4f6b-a6ad-c34ce5bce126 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:30.020202 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74314278-a642-4335-aba7-ac193a896309 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:30.020668 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5fa51-246f-4f6b-a6ad-c34ce5bce126 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:30.020952 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5fa51-246f-4f6b-a6ad-c34ce5bce126 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:30.021230 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5fa51-246f-4f6b-a6ad-c34ce5bce126 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:30.030789 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74314278-a642-4335-aba7-ac193a896309 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:30.033910 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a5fa51-246f-4f6b-a6ad-c34ce5bce126 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:30.035406 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a5fa51-246f-4f6b-a6ad-c34ce5bce126 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:30.035713 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f79c5-a557-463b-bdac-2f1fc4c7717d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:30.036317 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f79c5-a557-463b-bdac-2f1fc4c7717d admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:30.036594 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f79c5-a557-463b-bdac-2f1fc4c7717d admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:30.037484 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f79c5-a557-463b-bdac-2f1fc4c7717d admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:30.038041 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448f79c5-a557-463b-bdac-2f1fc4c7717d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:30.039665 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448f79c5-a557-463b-bdac-2f1fc4c7717d admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:30.047840 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1042/2060] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:30:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:30:30.065028 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1019/2061] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:30:30 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:30:30.069022 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a5fa51-246f-4f6b-a6ad-c34ce5bce126 service neutron] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:30.079821 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a5fa51-246f-4f6b-a6ad-c34ce5bce126 service neutron] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:30.087574 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5ecd1a-6b60-4c98-9006-a38b3a388c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:30.095549 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ecd1a-6b60-4c98-9006-a38b3a388c7f admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:30.096124 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ecd1a-6b60-4c98-9006-a38b3a388c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:30.096124 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ecd1a-6b60-4c98-9006-a38b3a388c7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:30.096753 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5ecd1a-6b60-4c98-9006-a38b3a388c7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:30.098390 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5ecd1a-6b60-4c98-9006-a38b3a388c7f admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:30.114241 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f79c5-a557-463b-bdac-2f1fc4c7717d admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:30.121269 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1043/2062] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:30:30 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:30:30.125651 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f79c5-a557-463b-bdac-2f1fc4c7717d admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:30.135351 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c391f-473b-4a22-acc6-8abaaf5a36f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:30.136442 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c391f-473b-4a22-acc6-8abaaf5a36f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:30.136874 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c391f-473b-4a22-acc6-8abaaf5a36f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:30.137296 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c391f-473b-4a22-acc6-8abaaf5a36f8 admin admin] PATH_INFO: `/v3/projects/63dc5fadd63446a3b2db269174d5f305/users/41fd09f4112042898adfe9d09e166633/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:30.163821 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8c391f-473b-4a22-acc6-8abaaf5a36f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63dc5fadd63446a3b2db269174d5f305, user_id=41fd09f4112042898adfe9d09e166633, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:30.167016 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8c391f-473b-4a22-acc6-8abaaf5a36f8 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:30.197744 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1020/2063] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:30:30 2022] PUT /identity/v3/projects/63dc5fadd63446a3b2db269174d5f305/users/41fd09f4112042898adfe9d09e166633/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:30.213243 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deaa2f5-4045-42df-af63-91d21d0ed277 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:30.213562 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deaa2f5-4045-42df-af63-91d21d0ed277 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:30.213843 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deaa2f5-4045-42df-af63-91d21d0ed277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:30.249651 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-5deaa2f5-4045-42df-af63-91d21d0ed277 None None] MFA Rules not processed for user `41fd09f4112042898adfe9d09e166633`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:30.250939 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-5deaa2f5-4045-42df-af63-91d21d0ed277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:30.340421 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:30.353544 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1044/2064] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:30.429758 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c391f-473b-4a22-acc6-8abaaf5a36f8 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:30.431762 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-0f8c391f-473b-4a22-acc6-8abaaf5a36f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:30.506702 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c391f-473b-4a22-acc6-8abaaf5a36f8 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:30.510804 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0360ccff-d52c-4637-bc79-0ee5e342d6d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:30.511470 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360ccff-d52c-4637-bc79-0ee5e342d6d2 service cinder] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:30.511790 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360ccff-d52c-4637-bc79-0ee5e342d6d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:30.512195 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360ccff-d52c-4637-bc79-0ee5e342d6d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:30.522199 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0360ccff-d52c-4637-bc79-0ee5e342d6d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:30.523831 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0360ccff-d52c-4637-bc79-0ee5e342d6d2 service cinder] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:30.534643 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1021/2065] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:30:30 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:30:30.556439 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deaa2f5-4045-42df-af63-91d21d0ed277 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:30.574019 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0360ccff-d52c-4637-bc79-0ee5e342d6d2 service cinder] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:30.575499 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-0360ccff-d52c-4637-bc79-0ee5e342d6d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:30.657281 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deaa2f5-4045-42df-af63-91d21d0ed277 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:30.665644 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e08c8fe-88b8-4d71-b061-b8e5bc24c15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:30.666530 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08c8fe-88b8-4d71-b061-b8e5bc24c15f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:30.666987 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08c8fe-88b8-4d71-b061-b8e5bc24c15f admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:30.667526 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08c8fe-88b8-4d71-b061-b8e5bc24c15f admin admin] PATH_INFO: `/v3/users/41fd09f4112042898adfe9d09e166633` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:30.670119 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e08c8fe-88b8-4d71-b061-b8e5bc24c15f admin admin] RBAC: Authorizing `identity:delete_user(user_id=41fd09f4112042898adfe9d09e166633)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:30.673890 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e08c8fe-88b8-4d71-b061-b8e5bc24c15f admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:30.716560 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0360ccff-d52c-4637-bc79-0ee5e342d6d2 service cinder] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:30.725289 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ca6f3b-7975-40cd-967a-613b848807a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:30.726437 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca6f3b-7975-40cd-967a-613b848807a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:30.726913 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca6f3b-7975-40cd-967a-613b848807a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:30.727360 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca6f3b-7975-40cd-967a-613b848807a7 admin admin] PATH_INFO: `/v3/users/2d484c03da654b25ac3ca0c67df9f408` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:30.728815 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ca6f3b-7975-40cd-967a-613b848807a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d484c03da654b25ac3ca0c67df9f408)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:30.732925 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ca6f3b-7975-40cd-967a-613b848807a7 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:30.745354 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-6e08c8fe-88b8-4d71-b061-b8e5bc24c15f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41fd09f4112042898adfe9d09e166633'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:30.758118 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-6e08c8fe-88b8-4d71-b061-b8e5bc24c15f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41fd09f4112042898adfe9d09e166633'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:30.759008 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-6e08c8fe-88b8-4d71-b061-b8e5bc24c15f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41fd09f4112042898adfe9d09e166633'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:30.765114 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:30.779995 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-6e08c8fe-88b8-4d71-b061-b8e5bc24c15f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41fd09f4112042898adfe9d09e166633'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:30.781941 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-6e08c8fe-88b8-4d71-b061-b8e5bc24c15f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41fd09f4112042898adfe9d09e166633'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:30.812545 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1045/2066] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:30:30 2022] DELETE /identity/v3/users/41fd09f4112042898adfe9d09e166633 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:30.823297 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838498f-5b67-4b68-8840-66b77e352660 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:30.823992 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838498f-5b67-4b68-8840-66b77e352660 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:30.824419 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838498f-5b67-4b68-8840-66b77e352660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:30.834631 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-43ca6f3b-7975-40cd-967a-613b848807a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d484c03da654b25ac3ca0c67df9f408'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:30.853713 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-43ca6f3b-7975-40cd-967a-613b848807a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d484c03da654b25ac3ca0c67df9f408'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:30.854689 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-43ca6f3b-7975-40cd-967a-613b848807a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d484c03da654b25ac3ca0c67df9f408'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:30.855500 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-43ca6f3b-7975-40cd-967a-613b848807a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d484c03da654b25ac3ca0c67df9f408'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:30.874358 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-2838498f-5b67-4b68-8840-66b77e352660 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:30.876856 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-2838498f-5b67-4b68-8840-66b77e352660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:30.888719 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-43ca6f3b-7975-40cd-967a-613b848807a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d484c03da654b25ac3ca0c67df9f408'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:30.929011 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1022/2067] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:30:30 2022] DELETE /identity/v3/users/2d484c03da654b25ac3ca0c67df9f408 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:30.936118 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4cf7f-39ee-4a45-9f1a-51d98064ff93 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:30.937277 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4cf7f-39ee-4a45-9f1a-51d98064ff93 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:30.937651 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4cf7f-39ee-4a45-9f1a-51d98064ff93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:30.975903 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-e5d4cf7f-39ee-4a45-9f1a-51d98064ff93 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:30.975903 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-e5d4cf7f-39ee-4a45-9f1a-51d98064ff93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:30.992917 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1046/2068] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:31.001187 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2838498f-5b67-4b68-8840-66b77e352660 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:31.003890 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-2838498f-5b67-4b68-8840-66b77e352660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:31.028166 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:31.077892 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1023/2069] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:31.088040 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d4cf7f-39ee-4a45-9f1a-51d98064ff93 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:31.088448 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2838498f-5b67-4b68-8840-66b77e352660 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:31.146559 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8891459-4bf8-46a1-831f-2b9c4e3af6dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:31.147210 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8891459-4bf8-46a1-831f-2b9c4e3af6dc service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:31.147999 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8891459-4bf8-46a1-831f-2b9c4e3af6dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:31.147999 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8891459-4bf8-46a1-831f-2b9c4e3af6dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:31.155766 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d4cf7f-39ee-4a45-9f1a-51d98064ff93 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:31.159263 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8891459-4bf8-46a1-831f-2b9c4e3af6dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:31.160559 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8891459-4bf8-46a1-831f-2b9c4e3af6dc service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:31.160701 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90337774-7a8d-40e5-ae44-1e1b3649b794 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:31.161116 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90337774-7a8d-40e5-ae44-1e1b3649b794 service neutron] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:31.161393 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90337774-7a8d-40e5-ae44-1e1b3649b794 service neutron] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:31.161659 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90337774-7a8d-40e5-ae44-1e1b3649b794 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:31.171249 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1047/2070] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:30:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:30:31.172746 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90337774-7a8d-40e5-ae44-1e1b3649b794 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:31.174261 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90337774-7a8d-40e5-ae44-1e1b3649b794 service neutron] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:31.185528 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1024/2071] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:30:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:30:31.320344 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60180290-ab2d-469b-b1b3-494fc26e48c1 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:31.321008 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60180290-ab2d-469b-b1b3-494fc26e48c1 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:31.321452 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60180290-ab2d-469b-b1b3-494fc26e48c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:31.358898 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-60180290-ab2d-469b-b1b3-494fc26e48c1 None None] MFA Rules not processed for user `9c090ad3fe494672b5fece2ed600057e`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:31.360718 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-60180290-ab2d-469b-b1b3-494fc26e48c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:31.506511 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1048/2072] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:30:31.515401 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90337774-7a8d-40e5-ae44-1e1b3649b794 service neutron] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:31.517279 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-90337774-7a8d-40e5-ae44-1e1b3649b794 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:31.584872 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:31.613681 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90337774-7a8d-40e5-ae44-1e1b3649b794 service neutron] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:31.619009 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22793a01-5825-4bc3-b88f-4e81e55b0a6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:31.619684 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22793a01-5825-4bc3-b88f-4e81e55b0a6d service cinder] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:31.619963 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22793a01-5825-4bc3-b88f-4e81e55b0a6d service cinder] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:31.620238 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22793a01-5825-4bc3-b88f-4e81e55b0a6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:31.630101 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22793a01-5825-4bc3-b88f-4e81e55b0a6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:31.632229 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22793a01-5825-4bc3-b88f-4e81e55b0a6d service cinder] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:31.636298 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60180290-ab2d-469b-b1b3-494fc26e48c1 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:31.638281 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-60180290-ab2d-469b-b1b3-494fc26e48c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:31.643197 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1025/2073] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:30:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:30:31.673361 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60180290-ab2d-469b-b1b3-494fc26e48c1 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:31.680673 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22793a01-5825-4bc3-b88f-4e81e55b0a6d service cinder] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:31.680820 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a90110d-9422-4a30-8c15-a320d9295d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:31.681582 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90110d-9422-4a30-8c15-a320d9295d22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:31.681688 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90110d-9422-4a30-8c15-a320d9295d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:31.681773 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-22793a01-5825-4bc3-b88f-4e81e55b0a6d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:31.681909 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90110d-9422-4a30-8c15-a320d9295d22 admin admin] PATH_INFO: `/v3/projects/63dc5fadd63446a3b2db269174d5f305` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:31.683111 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a90110d-9422-4a30-8c15-a320d9295d22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63dc5fadd63446a3b2db269174d5f305)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:31.685928 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a90110d-9422-4a30-8c15-a320d9295d22 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:31.701228 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22793a01-5825-4bc3-b88f-4e81e55b0a6d service cinder] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:31.707538 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b735bd3-907a-405a-8e58-1780ecf722bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:31.708293 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b735bd3-907a-405a-8e58-1780ecf722bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:31.708674 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b735bd3-907a-405a-8e58-1780ecf722bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:31.709608 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b735bd3-907a-405a-8e58-1780ecf722bd admin admin] PATH_INFO: `/v3/projects/6f3dd146e8ed4b3da377b32aae52a870` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:31.724059 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b735bd3-907a-405a-8e58-1780ecf722bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f3dd146e8ed4b3da377b32aae52a870)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:31.729757 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b735bd3-907a-405a-8e58-1780ecf722bd admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:31.808095 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-1a90110d-9422-4a30-8c15-a320d9295d22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63dc5fadd63446a3b2db269174d5f305', 'request_id': 'req-1a90110d-9422-4a30-8c15-a320d9295d22'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:31.816810 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-1a90110d-9422-4a30-8c15-a320d9295d22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63dc5fadd63446a3b2db269174d5f305', 'request_id': 'req-1a90110d-9422-4a30-8c15-a320d9295d22'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:31.823413 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:31.833523 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-1a90110d-9422-4a30-8c15-a320d9295d22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63dc5fadd63446a3b2db269174d5f305', 'request_id': 'req-1a90110d-9422-4a30-8c15-a320d9295d22'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:31.847278 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-7b735bd3-907a-405a-8e58-1780ecf722bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f3dd146e8ed4b3da377b32aae52a870', 'request_id': 'req-7b735bd3-907a-405a-8e58-1780ecf722bd'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:31.862455 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-1a90110d-9422-4a30-8c15-a320d9295d22 admin admin] The token cache is being invalidate because project 63dc5fadd63446a3b2db269174d5f305 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:30:31.862455 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-1a90110d-9422-4a30-8c15-a320d9295d22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:31.862455 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-1a90110d-9422-4a30-8c15-a320d9295d22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:31.870576 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1049/2074] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:30:31 2022] DELETE /identity/v3/projects/63dc5fadd63446a3b2db269174d5f305 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:31.870576 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37334c85-e05d-493f-b806-ebf045c6dd6e None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:31.870576 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37334c85-e05d-493f-b806-ebf045c6dd6e None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:31.871026 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37334c85-e05d-493f-b806-ebf045c6dd6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:31.872242 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-7b735bd3-907a-405a-8e58-1780ecf722bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f3dd146e8ed4b3da377b32aae52a870', 'request_id': 'req-7b735bd3-907a-405a-8e58-1780ecf722bd'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:31.887317 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-7b735bd3-907a-405a-8e58-1780ecf722bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f3dd146e8ed4b3da377b32aae52a870', 'request_id': 'req-7b735bd3-907a-405a-8e58-1780ecf722bd'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:31.899209 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-37334c85-e05d-493f-b806-ebf045c6dd6e None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:31.900845 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-37334c85-e05d-493f-b806-ebf045c6dd6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:31.907328 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-7b735bd3-907a-405a-8e58-1780ecf722bd admin admin] The token cache is being invalidate because project 6f3dd146e8ed4b3da377b32aae52a870 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81447) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:30:31.907328 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-7b735bd3-907a-405a-8e58-1780ecf722bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:31.908259 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-7b735bd3-907a-405a-8e58-1780ecf722bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:31.915207 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1026/2075] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:30:31 2022] DELETE /identity/v3/projects/6f3dd146e8ed4b3da377b32aae52a870 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:31.916355 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b735bd3-907a-405a-8e58-1780ecf722bd admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:31.918642 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-7b735bd3-907a-405a-8e58-1780ecf722bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:32.000706 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1050/2076] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:32.010873 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eee4be-c302-4a6f-900c-f99af3b387c4 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:32.010873 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eee4be-c302-4a6f-900c-f99af3b387c4 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:32.011148 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eee4be-c302-4a6f-900c-f99af3b387c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:32.042468 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-c2eee4be-c302-4a6f-900c-f99af3b387c4 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:32.044070 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-c2eee4be-c302-4a6f-900c-f99af3b387c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:32.054809 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b735bd3-907a-405a-8e58-1780ecf722bd admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:32.058453 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1051/2077] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:32.060021 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eee4be-c302-4a6f-900c-f99af3b387c4 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:32.067199 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc715027-1a2d-4ee9-8303-3dba6dacc502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:32.068192 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc715027-1a2d-4ee9-8303-3dba6dacc502 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:32.069008 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc715027-1a2d-4ee9-8303-3dba6dacc502 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:32.069486 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc715027-1a2d-4ee9-8303-3dba6dacc502 admin admin] PATH_INFO: `/v3/users/c47acddf08a94bbcbf925f865bda277e` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:32.071946 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc715027-1a2d-4ee9-8303-3dba6dacc502 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c47acddf08a94bbcbf925f865bda277e)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:32.073400 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eee4be-c302-4a6f-900c-f99af3b387c4 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:32.074877 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc715027-1a2d-4ee9-8303-3dba6dacc502 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:32.079394 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f7310-7936-461b-97fa-c3c223a1e458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:32.081037 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f7310-7936-461b-97fa-c3c223a1e458 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:32.081037 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f7310-7936-461b-97fa-c3c223a1e458 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:32.081390 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f7310-7936-461b-97fa-c3c223a1e458 admin admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:32.082068 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f7310-7936-461b-97fa-c3c223a1e458 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:30:32.082378 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f7310-7936-461b-97fa-c3c223a1e458 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:32.085308 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f7310-7936-461b-97fa-c3c223a1e458 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:32.118293 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1052/2078] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 30 01:30:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:30:32.120954 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f7310-7936-461b-97fa-c3c223a1e458 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:32.162834 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f7310-7936-461b-97fa-c3c223a1e458 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:32.181759 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f7fbbe-bf64-4ce5-8317-d33499b28d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:32.184091 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7fbbe-bf64-4ce5-8317-d33499b28d4d admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:32.184340 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7fbbe-bf64-4ce5-8317-d33499b28d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:32.184618 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7fbbe-bf64-4ce5-8317-d33499b28d4d admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:32.188638 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f7fbbe-bf64-4ce5-8317-d33499b28d4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:32.197892 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f7fbbe-bf64-4ce5-8317-d33499b28d4d admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:32.232943 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-fc715027-1a2d-4ee9-8303-3dba6dacc502 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c47acddf08a94bbcbf925f865bda277e'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:32.244696 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-fc715027-1a2d-4ee9-8303-3dba6dacc502 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c47acddf08a94bbcbf925f865bda277e'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:32.249570 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-fc715027-1a2d-4ee9-8303-3dba6dacc502 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c47acddf08a94bbcbf925f865bda277e'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:32.251243 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-fc715027-1a2d-4ee9-8303-3dba6dacc502 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c47acddf08a94bbcbf925f865bda277e'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:32.285426 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:32.288871 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-fc715027-1a2d-4ee9-8303-3dba6dacc502 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c47acddf08a94bbcbf925f865bda277e'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:32.293422 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1053/2079] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:30:32 2022] POST /identity/v3/projects => generated 383 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:30:32.309240 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f7fbbe-bf64-4ce5-8317-d33499b28d4d admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:32.319904 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-93f7fbbe-bf64-4ce5-8317-d33499b28d4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:32.337513 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1027/2080] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:30:31 2022] DELETE /identity/v3/users/c47acddf08a94bbcbf925f865bda277e => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:32.427921 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f7fbbe-bf64-4ce5-8317-d33499b28d4d admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:32.483246 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:32.496879 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d4aa20-354c-4e43-a5c3-ab655d6512a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:32.497559 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4aa20-354c-4e43-a5c3-ab655d6512a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:32.497976 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4aa20-354c-4e43-a5c3-ab655d6512a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:32.498644 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4aa20-354c-4e43-a5c3-ab655d6512a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:32.499283 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d4aa20-354c-4e43-a5c3-ab655d6512a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:32.501377 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d4aa20-354c-4e43-a5c3-ab655d6512a3 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:32.529735 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1054/2081] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:30:32 2022] POST /identity/v3/users => generated 292 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:30:32.531072 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc715027-1a2d-4ee9-8303-3dba6dacc502 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:32.543893 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc715027-1a2d-4ee9-8303-3dba6dacc502 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:32.549314 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ea17d-aed3-4b22-8baf-c6cfc38da5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:32.550143 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ea17d-aed3-4b22-8baf-c6cfc38da5f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:32.550256 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ea17d-aed3-4b22-8baf-c6cfc38da5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:32.550471 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ea17d-aed3-4b22-8baf-c6cfc38da5f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:32.551107 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63ea17d-aed3-4b22-8baf-c6cfc38da5f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:32.553356 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63ea17d-aed3-4b22-8baf-c6cfc38da5f9 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:32.567031 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1028/2082] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:30:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:30:32.568953 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d4aa20-354c-4e43-a5c3-ab655d6512a3 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:32.582615 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d4aa20-354c-4e43-a5c3-ab655d6512a3 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:32.588419 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00701073-7255-46d5-942a-09840f981ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:32.589588 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00701073-7255-46d5-942a-09840f981ebe admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:32.590099 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00701073-7255-46d5-942a-09840f981ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:32.590381 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00701073-7255-46d5-942a-09840f981ebe admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:32.591047 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00701073-7255-46d5-942a-09840f981ebe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:32.592759 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00701073-7255-46d5-942a-09840f981ebe admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:32.603417 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1055/2083] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:30:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:30:32.607619 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ea17d-aed3-4b22-8baf-c6cfc38da5f9 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:32.618136 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ea17d-aed3-4b22-8baf-c6cfc38da5f9 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:32.622844 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81dd18-7378-4518-9718-2a4f6b5c525e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:32.623400 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81dd18-7378-4518-9718-2a4f6b5c525e admin admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:32.624664 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81dd18-7378-4518-9718-2a4f6b5c525e admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:32.624664 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81dd18-7378-4518-9718-2a4f6b5c525e admin admin] PATH_INFO: `/v3/projects/f2995a2ca26147fd93d7012c799f3e62/users/7a9336384df24a3fb7565ef151a5adad/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:32.643795 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc81dd18-7378-4518-9718-2a4f6b5c525e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2995a2ca26147fd93d7012c799f3e62, user_id=7a9336384df24a3fb7565ef151a5adad, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:32.646720 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc81dd18-7378-4518-9718-2a4f6b5c525e admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:32.660731 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1029/2084] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:30:32 2022] PUT /identity/v3/projects/f2995a2ca26147fd93d7012c799f3e62/users/7a9336384df24a3fb7565ef151a5adad/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:32.670764 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513caa9-3dc8-439b-9134-e85c205af5b3 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:32.671059 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513caa9-3dc8-439b-9134-e85c205af5b3 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:32.671330 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513caa9-3dc8-439b-9134-e85c205af5b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:32.702109 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-d513caa9-3dc8-439b-9134-e85c205af5b3 None None] MFA Rules not processed for user `7a9336384df24a3fb7565ef151a5adad`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:32.702740 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-d513caa9-3dc8-439b-9134-e85c205af5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:32.779700 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1056/2085] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:32.780985 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81dd18-7378-4518-9718-2a4f6b5c525e admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:32.907368 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81dd18-7378-4518-9718-2a4f6b5c525e admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:32.933286 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b8434e-5d43-4370-85c8-9d2f356cc178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:32.934158 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b8434e-5d43-4370-85c8-9d2f356cc178 admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:32.934656 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b8434e-5d43-4370-85c8-9d2f356cc178 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:32.934983 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b8434e-5d43-4370-85c8-9d2f356cc178 admin admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:32.935734 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b8434e-5d43-4370-85c8-9d2f356cc178 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:32.938260 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b8434e-5d43-4370-85c8-9d2f356cc178 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:33.000690 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1030/2086] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:30:32 2022] POST /identity/v3/projects => generated 385 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:30:33.001898 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d513caa9-3dc8-439b-9134-e85c205af5b3 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:33.016488 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b8434e-5d43-4370-85c8-9d2f356cc178 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:33.017907 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d513caa9-3dc8-439b-9134-e85c205af5b3 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:33.019886 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-a5b8434e-5d43-4370-85c8-9d2f356cc178 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:33.154534 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b8434e-5d43-4370-85c8-9d2f356cc178 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:33.161354 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174fdc2b-3afb-4a6d-a123-46f8bf1bfdc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:33.161354 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174fdc2b-3afb-4a6d-a123-46f8bf1bfdc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:33.161729 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174fdc2b-3afb-4a6d-a123-46f8bf1bfdc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:33.162526 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174fdc2b-3afb-4a6d-a123-46f8bf1bfdc3 admin admin] PATH_INFO: `/v3/projects/7466efa6c13149ddaa3cada7cdb9b64a` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:33.163949 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174fdc2b-3afb-4a6d-a123-46f8bf1bfdc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7466efa6c13149ddaa3cada7cdb9b64a)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:33.164466 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50bdaa2-f7c9-452a-b5ff-ea911f6c49c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:33.165643 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50bdaa2-f7c9-452a-b5ff-ea911f6c49c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:33.166022 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174fdc2b-3afb-4a6d-a123-46f8bf1bfdc3 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:33.166371 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50bdaa2-f7c9-452a-b5ff-ea911f6c49c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:33.166846 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50bdaa2-f7c9-452a-b5ff-ea911f6c49c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:33.167891 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50bdaa2-f7c9-452a-b5ff-ea911f6c49c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:33.170474 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50bdaa2-f7c9-452a-b5ff-ea911f6c49c9 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:33.198567 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1057/2087] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:30:33 2022] POST /identity/v3/users => generated 293 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:30:33.202682 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50bdaa2-f7c9-452a-b5ff-ea911f6c49c9 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:33.214504 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50bdaa2-f7c9-452a-b5ff-ea911f6c49c9 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:33.222536 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:33.235815 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-174fdc2b-3afb-4a6d-a123-46f8bf1bfdc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7466efa6c13149ddaa3cada7cdb9b64a', 'request_id': 'req-174fdc2b-3afb-4a6d-a123-46f8bf1bfdc3'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:33.243106 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-174fdc2b-3afb-4a6d-a123-46f8bf1bfdc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7466efa6c13149ddaa3cada7cdb9b64a', 'request_id': 'req-174fdc2b-3afb-4a6d-a123-46f8bf1bfdc3'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:33.253312 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-174fdc2b-3afb-4a6d-a123-46f8bf1bfdc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7466efa6c13149ddaa3cada7cdb9b64a', 'request_id': 'req-174fdc2b-3afb-4a6d-a123-46f8bf1bfdc3'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:33.266136 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-174fdc2b-3afb-4a6d-a123-46f8bf1bfdc3 admin admin] The token cache is being invalidate because project 7466efa6c13149ddaa3cada7cdb9b64a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81447) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:30:33.266502 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-174fdc2b-3afb-4a6d-a123-46f8bf1bfdc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:33.267476 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-174fdc2b-3afb-4a6d-a123-46f8bf1bfdc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:33.272146 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1031/2088] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:30:33 2022] DELETE /identity/v3/projects/7466efa6c13149ddaa3cada7cdb9b64a => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:33.277633 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aaa2db-b590-4726-81bc-e711a3ba4f15 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:33.277989 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aaa2db-b590-4726-81bc-e711a3ba4f15 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:33.278287 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aaa2db-b590-4726-81bc-e711a3ba4f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:33.279012 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:33.299803 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ebfad-509f-4399-a751-966766a603b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:33.300869 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ebfad-509f-4399-a751-966766a603b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:33.301330 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ebfad-509f-4399-a751-966766a603b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:33.301917 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ebfad-509f-4399-a751-966766a603b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:33.302799 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-d4aaa2db-b590-4726-81bc-e711a3ba4f15 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:33.303346 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7ebfad-509f-4399-a751-966766a603b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:33.304984 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-d4aaa2db-b590-4726-81bc-e711a3ba4f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:33.306833 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7ebfad-509f-4399-a751-966766a603b2 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:33.317041 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1032/2089] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:30:33.318836 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1058/2090] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:30:33 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:30:33.324667 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ebfad-509f-4399-a751-966766a603b2 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:33.326211 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dfd0f9-c090-4d68-a742-998eef67e850 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:33.326767 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dfd0f9-c090-4d68-a742-998eef67e850 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:33.327503 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dfd0f9-c090-4d68-a742-998eef67e850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:33.327721 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-4b7ebfad-509f-4399-a751-966766a603b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:33.344290 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ebfad-509f-4399-a751-966766a603b2 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:33.351113 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988f2749-8918-4a46-8d3d-77a5bde20f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:33.351819 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f2749-8918-4a46-8d3d-77a5bde20f7f admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:33.352102 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f2749-8918-4a46-8d3d-77a5bde20f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:33.352377 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f2749-8918-4a46-8d3d-77a5bde20f7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:33.353031 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988f2749-8918-4a46-8d3d-77a5bde20f7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:33.354713 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988f2749-8918-4a46-8d3d-77a5bde20f7f admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:33.355212 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-d7dfd0f9-c090-4d68-a742-998eef67e850 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:33.356742 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-d7dfd0f9-c090-4d68-a742-998eef67e850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:33.371475 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1059/2091] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:30:33 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:30:33.371633 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1033/2092] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:33.371731 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988f2749-8918-4a46-8d3d-77a5bde20f7f admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:33.372704 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dfd0f9-c090-4d68-a742-998eef67e850 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:33.384809 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988f2749-8918-4a46-8d3d-77a5bde20f7f admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:33.386168 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dfd0f9-c090-4d68-a742-998eef67e850 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:33.393593 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b194f82-0ba0-4fdf-a625-bef34d8a98f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:33.393915 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa319584-bd3d-4b36-a44f-128c262e2ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:33.394447 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b194f82-0ba0-4fdf-a625-bef34d8a98f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:33.394784 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b194f82-0ba0-4fdf-a625-bef34d8a98f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:33.395132 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b194f82-0ba0-4fdf-a625-bef34d8a98f4 admin admin] PATH_INFO: `/v3/projects/38407a0158dd4e7ba66f89db1c76d3ce/users/d82c9132ba7f4cf7b40bd44661bd01d0/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:33.395480 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa319584-bd3d-4b36-a44f-128c262e2ebf admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:33.396057 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa319584-bd3d-4b36-a44f-128c262e2ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:33.397009 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa319584-bd3d-4b36-a44f-128c262e2ebf admin admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:33.398782 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa319584-bd3d-4b36-a44f-128c262e2ebf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:30:33.399264 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa319584-bd3d-4b36-a44f-128c262e2ebf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:33.403131 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa319584-bd3d-4b36-a44f-128c262e2ebf admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:33.419068 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b194f82-0ba0-4fdf-a625-bef34d8a98f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38407a0158dd4e7ba66f89db1c76d3ce, user_id=d82c9132ba7f4cf7b40bd44661bd01d0, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:33.423688 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1060/2093] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 30 01:30:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:30:33.423824 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b194f82-0ba0-4fdf-a625-bef34d8a98f4 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:33.424606 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa319584-bd3d-4b36-a44f-128c262e2ebf admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:33.437604 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa319584-bd3d-4b36-a44f-128c262e2ebf admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:33.443934 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1034/2094] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:30:33 2022] PUT /identity/v3/projects/38407a0158dd4e7ba66f89db1c76d3ce/users/d82c9132ba7f4cf7b40bd44661bd01d0/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:33.457106 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5258a96-7687-4a04-9739-b0171e360e44 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:33.457358 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5258a96-7687-4a04-9739-b0171e360e44 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:33.457659 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5258a96-7687-4a04-9739-b0171e360e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:33.515865 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-e5258a96-7687-4a04-9739-b0171e360e44 None None] MFA Rules not processed for user `d82c9132ba7f4cf7b40bd44661bd01d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:33.528129 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce89d5-a5d8-4543-955d-d8878d1c55af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:33.528685 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-e5258a96-7687-4a04-9739-b0171e360e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:33.528803 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce89d5-a5d8-4543-955d-d8878d1c55af admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:33.529007 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce89d5-a5d8-4543-955d-d8878d1c55af admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:33.529279 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce89d5-a5d8-4543-955d-d8878d1c55af admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:33.529921 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ce89d5-a5d8-4543-955d-d8878d1c55af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:33.532085 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ce89d5-a5d8-4543-955d-d8878d1c55af admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:33.569338 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1061/2095] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:30:33 2022] POST /identity/v3/projects => generated 371 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:30:33.574381 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1d286-36d4-4626-9973-e0b58d8ca207 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:33.574659 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1d286-36d4-4626-9973-e0b58d8ca207 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:33.574934 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1d286-36d4-4626-9973-e0b58d8ca207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:33.619480 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-92d1d286-36d4-4626-9973-e0b58d8ca207 None None] MFA Rules not processed for user `9c090ad3fe494672b5fece2ed600057e`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:33.621268 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-92d1d286-36d4-4626-9973-e0b58d8ca207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:33.650589 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1035/2096] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:33.651353 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5258a96-7687-4a04-9739-b0171e360e44 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:33.663128 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5258a96-7687-4a04-9739-b0171e360e44 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:33.707118 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1062/2097] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:33.707489 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1d286-36d4-4626-9973-e0b58d8ca207 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:33.824040 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd836031-49d0-4461-b58f-51b0b693ce82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:33.824875 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd836031-49d0-4461-b58f-51b0b693ce82 admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:33.826333 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd836031-49d0-4461-b58f-51b0b693ce82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:33.828839 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd836031-49d0-4461-b58f-51b0b693ce82 admin admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:33.828839 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd836031-49d0-4461-b58f-51b0b693ce82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:33.833897 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd836031-49d0-4461-b58f-51b0b693ce82 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:33.854204 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:33.881405 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1036/2098] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:30:33 2022] POST /identity/v3/users => generated 286 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:30:33.884555 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd836031-49d0-4461-b58f-51b0b693ce82 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:33.885331 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1d286-36d4-4626-9973-e0b58d8ca207 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:33.898643 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd836031-49d0-4461-b58f-51b0b693ce82 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:33.902174 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4738dfd3-a221-46b0-b589-08d2ee4daa6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:33.902746 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738dfd3-a221-46b0-b589-08d2ee4daa6d admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:33.903029 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738dfd3-a221-46b0-b589-08d2ee4daa6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:33.903336 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738dfd3-a221-46b0-b589-08d2ee4daa6d admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:33.904046 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4738dfd3-a221-46b0-b589-08d2ee4daa6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:33.906134 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4738dfd3-a221-46b0-b589-08d2ee4daa6d admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:33.907800 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c8504-8526-405a-96fc-ce177b4130ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:33.908421 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c8504-8526-405a-96fc-ce177b4130ee admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:33.908791 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c8504-8526-405a-96fc-ce177b4130ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:33.909087 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c8504-8526-405a-96fc-ce177b4130ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:33.910007 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6c8504-8526-405a-96fc-ce177b4130ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:33.911689 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6c8504-8526-405a-96fc-ce177b4130ee admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:33.914375 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:33.936408 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1037/2099] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:30:33 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:30:33.937468 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c8504-8526-405a-96fc-ce177b4130ee admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:33.954863 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c8504-8526-405a-96fc-ce177b4130ee admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:33.966409 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad15daa-36c4-40f2-b199-d5157ba2cfaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:33.967038 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad15daa-36c4-40f2-b199-d5157ba2cfaf admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:33.967829 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad15daa-36c4-40f2-b199-d5157ba2cfaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:33.967829 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad15daa-36c4-40f2-b199-d5157ba2cfaf admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:33.968242 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad15daa-36c4-40f2-b199-d5157ba2cfaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:33.969838 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad15daa-36c4-40f2-b199-d5157ba2cfaf admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:33.976228 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1063/2100] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:30:33 2022] POST /identity/v3/projects => generated 385 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:30:33.980492 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4738dfd3-a221-46b0-b589-08d2ee4daa6d admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:33.996130 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1038/2101] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:30:33 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:30:33.997169 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad15daa-36c4-40f2-b199-d5157ba2cfaf admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:34.010368 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad15daa-36c4-40f2-b199-d5157ba2cfaf admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:34.083009 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4738dfd3-a221-46b0-b589-08d2ee4daa6d admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:34.086678 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90242cf-f6ba-4be5-a2e8-1e7b06bc8c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:34.087538 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90242cf-f6ba-4be5-a2e8-1e7b06bc8c4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:34.087819 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90242cf-f6ba-4be5-a2e8-1e7b06bc8c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:34.088090 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90242cf-f6ba-4be5-a2e8-1e7b06bc8c4a admin admin] PATH_INFO: `/v3/projects/fcfc8f6698e04a808abab6683c03b98a/users/cef022b4b2ed4427a30f9edaf2818915/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:34.089873 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7422bd-469c-4cbc-be24-182b23638655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:34.090580 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7422bd-469c-4cbc-be24-182b23638655 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:34.090917 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7422bd-469c-4cbc-be24-182b23638655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:34.091255 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7422bd-469c-4cbc-be24-182b23638655 admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:34.092019 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7422bd-469c-4cbc-be24-182b23638655 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:34.094016 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7422bd-469c-4cbc-be24-182b23638655 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:34.113584 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90242cf-f6ba-4be5-a2e8-1e7b06bc8c4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcfc8f6698e04a808abab6683c03b98a, user_id=cef022b4b2ed4427a30f9edaf2818915, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:34.116498 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90242cf-f6ba-4be5-a2e8-1e7b06bc8c4a admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:34.124596 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1064/2102] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:30:33 2022] POST /identity/v3/users => generated 299 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:30:34.128476 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7422bd-469c-4cbc-be24-182b23638655 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:34.135501 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1039/2103] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:30:33 2022] PUT /identity/v3/projects/fcfc8f6698e04a808abab6683c03b98a/users/cef022b4b2ed4427a30f9edaf2818915/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:34.145782 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7422bd-469c-4cbc-be24-182b23638655 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:34.146076 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58939d-9160-4454-8de2-7565ea3fb51c None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:34.146885 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58939d-9160-4454-8de2-7565ea3fb51c None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:34.147151 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58939d-9160-4454-8de2-7565ea3fb51c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:34.178568 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-2e58939d-9160-4454-8de2-7565ea3fb51c None None] MFA Rules not processed for user `cef022b4b2ed4427a30f9edaf2818915`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:34.180207 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-2e58939d-9160-4454-8de2-7565ea3fb51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:34.219205 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a101291-e008-4030-bb2e-54c416fdc4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:34.219933 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a101291-e008-4030-bb2e-54c416fdc4a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:34.220865 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a101291-e008-4030-bb2e-54c416fdc4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:34.220865 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a101291-e008-4030-bb2e-54c416fdc4a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:34.221314 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a101291-e008-4030-bb2e-54c416fdc4a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:34.223007 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a101291-e008-4030-bb2e-54c416fdc4a5 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:34.234700 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1065/2104] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:30:34.238898 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a101291-e008-4030-bb2e-54c416fdc4a5 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:34.252007 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a101291-e008-4030-bb2e-54c416fdc4a5 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:34.255276 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1040/2105] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:34.259574 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e8601-ab33-44e5-b0ad-ad5f82995c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:34.260609 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e8601-ab33-44e5-b0ad-ad5f82995c75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:34.260893 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e8601-ab33-44e5-b0ad-ad5f82995c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:34.261244 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e8601-ab33-44e5-b0ad-ad5f82995c75 admin admin] PATH_INFO: `/v3/projects/44b57cedbcb542bfa3b3008464804e6f/users/72f35ad259f24d76acd22950d25dbddb/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:34.268043 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e58939d-9160-4454-8de2-7565ea3fb51c None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:34.272171 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-2e58939d-9160-4454-8de2-7565ea3fb51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:34.277693 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403e8601-ab33-44e5-b0ad-ad5f82995c75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44b57cedbcb542bfa3b3008464804e6f, user_id=72f35ad259f24d76acd22950d25dbddb, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:34.280442 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403e8601-ab33-44e5-b0ad-ad5f82995c75 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:34.295529 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1066/2106] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:30:34 2022] PUT /identity/v3/projects/44b57cedbcb542bfa3b3008464804e6f/users/72f35ad259f24d76acd22950d25dbddb/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:30:34.299223 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e8601-ab33-44e5-b0ad-ad5f82995c75 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:34.371242 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e58939d-9160-4454-8de2-7565ea3fb51c None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:34.383021 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:34.393193 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:34.455762 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e8601-ab33-44e5-b0ad-ad5f82995c75 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:34.464035 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea670ade-ae1f-4c5b-8cfc-06505cfd235d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:34.466518 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea670ade-ae1f-4c5b-8cfc-06505cfd235d admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:34.468634 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea670ade-ae1f-4c5b-8cfc-06505cfd235d admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:34.469233 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea670ade-ae1f-4c5b-8cfc-06505cfd235d admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:34.470105 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea670ade-ae1f-4c5b-8cfc-06505cfd235d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:34.470297 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaabd2d2-9258-448d-9f79-b59a5e87a055 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:34.470971 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaabd2d2-9258-448d-9f79-b59a5e87a055 service cinder] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:34.471248 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaabd2d2-9258-448d-9f79-b59a5e87a055 service cinder] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:34.471552 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaabd2d2-9258-448d-9f79-b59a5e87a055 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:34.472906 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea670ade-ae1f-4c5b-8cfc-06505cfd235d admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:34.490143 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1067/2107] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:30:34.510735 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea670ade-ae1f-4c5b-8cfc-06505cfd235d admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:34.527326 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea670ade-ae1f-4c5b-8cfc-06505cfd235d admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:34.539259 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b186958f-16fa-49ea-a645-56340953ee0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:34.540205 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186958f-16fa-49ea-a645-56340953ee0a admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:34.540645 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186958f-16fa-49ea-a645-56340953ee0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:34.541018 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186958f-16fa-49ea-a645-56340953ee0a admin admin] PATH_INFO: `/v3/projects/44b57cedbcb542bfa3b3008464804e6f/users/72f35ad259f24d76acd22950d25dbddb/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:34.543953 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b186958f-16fa-49ea-a645-56340953ee0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=44b57cedbcb542bfa3b3008464804e6f, user_id=72f35ad259f24d76acd22950d25dbddb, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:34.547814 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b186958f-16fa-49ea-a645-56340953ee0a admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:34.561664 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaabd2d2-9258-448d-9f79-b59a5e87a055 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:34.563106 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaabd2d2-9258-448d-9f79-b59a5e87a055 service cinder] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:34.564197 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1068/2108] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:30:34 2022] PUT /identity/v3/projects/44b57cedbcb542bfa3b3008464804e6f/users/72f35ad259f24d76acd22950d25dbddb/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:34.577339 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a398b3a-2a37-49a9-ba1f-f1ac9f4dd391 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:34.579199 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a398b3a-2a37-49a9-ba1f-f1ac9f4dd391 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:34.581507 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a398b3a-2a37-49a9-ba1f-f1ac9f4dd391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:34.615676 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1041/2109] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:30:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:30:34.622174 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaabd2d2-9258-448d-9f79-b59a5e87a055 service cinder] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:34.643081 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaabd2d2-9258-448d-9f79-b59a5e87a055 service cinder] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:34.673916 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-3a398b3a-2a37-49a9-ba1f-f1ac9f4dd391 None None] MFA Rules not processed for user `72f35ad259f24d76acd22950d25dbddb`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:34.675250 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-3a398b3a-2a37-49a9-ba1f-f1ac9f4dd391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:34.806479 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6065f-9e2d-4ff0-ad1a-4e30e5b61373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:34.806479 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6065f-9e2d-4ff0-ad1a-4e30e5b61373 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:34.806907 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6065f-9e2d-4ff0-ad1a-4e30e5b61373 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:34.807069 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6065f-9e2d-4ff0-ad1a-4e30e5b61373 admin admin] PATH_INFO: `/v3/users/cef022b4b2ed4427a30f9edaf2818915` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:34.810061 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f6065f-9e2d-4ff0-ad1a-4e30e5b61373 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cef022b4b2ed4427a30f9edaf2818915)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:34.814257 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f6065f-9e2d-4ff0-ad1a-4e30e5b61373 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:34.932598 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1069/2110] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:34 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:34.969207 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a398b3a-2a37-49a9-ba1f-f1ac9f4dd391 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:34.970804 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-3a398b3a-2a37-49a9-ba1f-f1ac9f4dd391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:34.979065 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-d2f6065f-9e2d-4ff0-ad1a-4e30e5b61373 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cef022b4b2ed4427a30f9edaf2818915'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:35.000060 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-d2f6065f-9e2d-4ff0-ad1a-4e30e5b61373 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cef022b4b2ed4427a30f9edaf2818915'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:35.001194 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-d2f6065f-9e2d-4ff0-ad1a-4e30e5b61373 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cef022b4b2ed4427a30f9edaf2818915'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:35.004591 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-d2f6065f-9e2d-4ff0-ad1a-4e30e5b61373 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cef022b4b2ed4427a30f9edaf2818915'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:35.034100 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-d2f6065f-9e2d-4ff0-ad1a-4e30e5b61373 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cef022b4b2ed4427a30f9edaf2818915'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:35.037516 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:35.061224 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1042/2111] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:30:34 2022] DELETE /identity/v3/users/cef022b4b2ed4427a30f9edaf2818915 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:35.073009 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a16cc-0920-4771-9fce-30066933dd85 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:35.074068 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a16cc-0920-4771-9fce-30066933dd85 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:35.075590 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a16cc-0920-4771-9fce-30066933dd85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:35.105743 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a398b3a-2a37-49a9-ba1f-f1ac9f4dd391 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:35.133030 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-d49a16cc-0920-4771-9fce-30066933dd85 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:35.134497 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-d49a16cc-0920-4771-9fce-30066933dd85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:35.217611 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a12ce-d052-4852-8191-7fc18759b226 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:35.218409 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a12ce-d052-4852-8191-7fc18759b226 service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:35.218802 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a12ce-d052-4852-8191-7fc18759b226 service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:35.220370 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a12ce-d052-4852-8191-7fc18759b226 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:35.225842 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-ea2a12ce-d052-4852-8191-7fc18759b226 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:35.251500 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1043/2112] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:35.265488 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49a16cc-0920-4771-9fce-30066933dd85 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:35.268583 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-d49a16cc-0920-4771-9fce-30066933dd85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:35.277335 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:35.364268 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49a16cc-0920-4771-9fce-30066933dd85 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:35.367272 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2a12ce-d052-4852-8191-7fc18759b226 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:35.369892 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999bb23e-5462-486a-a297-aa3027ea913d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:35.370520 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999bb23e-5462-486a-a297-aa3027ea913d service neutron] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:35.370896 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999bb23e-5462-486a-a297-aa3027ea913d service neutron] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:35.371172 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999bb23e-5462-486a-a297-aa3027ea913d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:35.371581 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2a12ce-d052-4852-8191-7fc18759b226 service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:35.385760 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999bb23e-5462-486a-a297-aa3027ea913d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:35.387291 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1070/2113] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:30:34 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:30:35.388122 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999bb23e-5462-486a-a297-aa3027ea913d service neutron] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:35.414388 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1044/2114] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:30:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:30:35.942824 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a12ce-d052-4852-8191-7fc18759b226 service cinder] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:35.944550 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-ea2a12ce-d052-4852-8191-7fc18759b226 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:35.981555 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a12ce-d052-4852-8191-7fc18759b226 service cinder] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:36.007296 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b7a0b5-cb95-4dfe-9a79-559205224e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:36.008352 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7a0b5-cb95-4dfe-9a79-559205224e55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:36.009677 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7a0b5-cb95-4dfe-9a79-559205224e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:36.010977 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7a0b5-cb95-4dfe-9a79-559205224e55 admin admin] PATH_INFO: `/v3/projects/fcfc8f6698e04a808abab6683c03b98a` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:36.013991 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b7a0b5-cb95-4dfe-9a79-559205224e55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcfc8f6698e04a808abab6683c03b98a)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:36.016384 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b7a0b5-cb95-4dfe-9a79-559205224e55 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:36.106843 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-27b7a0b5-cb95-4dfe-9a79-559205224e55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcfc8f6698e04a808abab6683c03b98a', 'request_id': 'req-27b7a0b5-cb95-4dfe-9a79-559205224e55'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:36.116158 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-27b7a0b5-cb95-4dfe-9a79-559205224e55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcfc8f6698e04a808abab6683c03b98a', 'request_id': 'req-27b7a0b5-cb95-4dfe-9a79-559205224e55'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:36.143599 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-27b7a0b5-cb95-4dfe-9a79-559205224e55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcfc8f6698e04a808abab6683c03b98a', 'request_id': 'req-27b7a0b5-cb95-4dfe-9a79-559205224e55'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:36.161023 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-27b7a0b5-cb95-4dfe-9a79-559205224e55 admin admin] The token cache is being invalidate because project fcfc8f6698e04a808abab6683c03b98a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:30:36.162478 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-27b7a0b5-cb95-4dfe-9a79-559205224e55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:36.163543 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-27b7a0b5-cb95-4dfe-9a79-559205224e55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:36.175276 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1071/2115] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:30:35 2022] DELETE /identity/v3/projects/fcfc8f6698e04a808abab6683c03b98a => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:36.177087 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e6b9a-39cb-42c1-973c-b0c84717ed01 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:36.178204 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e6b9a-39cb-42c1-973c-b0c84717ed01 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:36.178769 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e6b9a-39cb-42c1-973c-b0c84717ed01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:36.211859 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-560e6b9a-39cb-42c1-973c-b0c84717ed01 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:36.214159 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-560e6b9a-39cb-42c1-973c-b0c84717ed01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:36.340125 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1045/2116] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:36.348000 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ae7a4-9f5b-4c82-99d5-09196cc1f7f6 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:36.348484 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ae7a4-9f5b-4c82-99d5-09196cc1f7f6 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:36.348579 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ae7a4-9f5b-4c82-99d5-09196cc1f7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:36.377508 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-432ae7a4-9f5b-4c82-99d5-09196cc1f7f6 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:36.378745 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-432ae7a4-9f5b-4c82-99d5-09196cc1f7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:36.401587 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1072/2117] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:36.409615 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e6b9a-39cb-42c1-973c-b0c84717ed01 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:36.422633 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e6b9a-39cb-42c1-973c-b0c84717ed01 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:36.436800 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d270a516-8fd8-4123-9488-80d4a82dc819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:36.437674 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270a516-8fd8-4123-9488-80d4a82dc819 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:36.438395 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270a516-8fd8-4123-9488-80d4a82dc819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:36.438823 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270a516-8fd8-4123-9488-80d4a82dc819 admin admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:36.439759 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d270a516-8fd8-4123-9488-80d4a82dc819 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:30:36.442140 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d270a516-8fd8-4123-9488-80d4a82dc819 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:36.444071 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d270a516-8fd8-4123-9488-80d4a82dc819 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:36.459786 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1046/2118] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 30 01:30:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:30:36.465077 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ae7a4-9f5b-4c82-99d5-09196cc1f7f6 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:36.482586 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ae7a4-9f5b-4c82-99d5-09196cc1f7f6 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:36.490730 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe3150-1cf0-4ac0-912e-ce9ac1ed8dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:36.491791 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe3150-1cf0-4ac0-912e-ce9ac1ed8dc3 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:36.492117 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe3150-1cf0-4ac0-912e-ce9ac1ed8dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:36.492333 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe3150-1cf0-4ac0-912e-ce9ac1ed8dc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:36.493357 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbe3150-1cf0-4ac0-912e-ce9ac1ed8dc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:36.505325 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbe3150-1cf0-4ac0-912e-ce9ac1ed8dc3 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:36.550792 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1073/2119] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:30:36 2022] POST /identity/v3/projects => generated 385 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:30:36.555554 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d270a516-8fd8-4123-9488-80d4a82dc819 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:36.567403 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d270a516-8fd8-4123-9488-80d4a82dc819 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:36.582715 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:36.637304 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b514470f-2304-47ff-aec5-41fcb51c725e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:36.638023 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514470f-2304-47ff-aec5-41fcb51c725e admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:36.638299 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514470f-2304-47ff-aec5-41fcb51c725e admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:36.638571 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514470f-2304-47ff-aec5-41fcb51c725e admin admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:36.639242 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b514470f-2304-47ff-aec5-41fcb51c725e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:36.641471 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b514470f-2304-47ff-aec5-41fcb51c725e admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:36.666572 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1047/2120] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:30:36 2022] POST /identity/v3/users => generated 293 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:30:36.670568 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe3150-1cf0-4ac0-912e-ce9ac1ed8dc3 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:36.684579 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe3150-1cf0-4ac0-912e-ce9ac1ed8dc3 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:36.690619 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce9dd6-c78d-42f4-b1e8-be6ad9dfd677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:36.691221 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce9dd6-c78d-42f4-b1e8-be6ad9dfd677 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:36.691535 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce9dd6-c78d-42f4-b1e8-be6ad9dfd677 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:36.691808 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce9dd6-c78d-42f4-b1e8-be6ad9dfd677 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:36.692584 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ce9dd6-c78d-42f4-b1e8-be6ad9dfd677 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:36.696994 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ce9dd6-c78d-42f4-b1e8-be6ad9dfd677 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:36.713003 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1074/2121] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:30:36.717064 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b514470f-2304-47ff-aec5-41fcb51c725e admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:36.729215 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b514470f-2304-47ff-aec5-41fcb51c725e admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:36.734727 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f281aeb3-e97f-4092-9a83-0fcccdced5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:36.735577 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f281aeb3-e97f-4092-9a83-0fcccdced5aa admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:36.736093 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f281aeb3-e97f-4092-9a83-0fcccdced5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:36.736368 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f281aeb3-e97f-4092-9a83-0fcccdced5aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:36.737058 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f281aeb3-e97f-4092-9a83-0fcccdced5aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:36.739746 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f281aeb3-e97f-4092-9a83-0fcccdced5aa admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:36.756195 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1048/2122] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:30:36.758405 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce9dd6-c78d-42f4-b1e8-be6ad9dfd677 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:36.769476 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce9dd6-c78d-42f4-b1e8-be6ad9dfd677 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:36.776477 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb01ec-0d69-450c-a0b4-facd224cc283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:36.777203 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb01ec-0d69-450c-a0b4-facd224cc283 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:36.777477 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb01ec-0d69-450c-a0b4-facd224cc283 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:36.778422 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb01ec-0d69-450c-a0b4-facd224cc283 admin admin] PATH_INFO: `/v3/projects/bb5d2bf5b90e4f8da32f58173af3c9e3/users/69e04b9d9d764afca1fd13a4880fcd99/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:36.806047 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bb01ec-0d69-450c-a0b4-facd224cc283 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb5d2bf5b90e4f8da32f58173af3c9e3, user_id=69e04b9d9d764afca1fd13a4880fcd99, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:36.809348 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bb01ec-0d69-450c-a0b4-facd224cc283 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:36.841523 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1075/2123] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:30:36 2022] PUT /identity/v3/projects/bb5d2bf5b90e4f8da32f58173af3c9e3/users/69e04b9d9d764afca1fd13a4880fcd99/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:36.852171 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f8f9f-53b4-4a1f-a267-f9f96943992f None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:36.852795 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f8f9f-53b4-4a1f-a267-f9f96943992f None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:36.853252 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f8f9f-53b4-4a1f-a267-f9f96943992f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:36.906094 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-820f8f9f-53b4-4a1f-a267-f9f96943992f None None] MFA Rules not processed for user `69e04b9d9d764afca1fd13a4880fcd99`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:36.909286 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-820f8f9f-53b4-4a1f-a267-f9f96943992f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:37.014933 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1049/2124] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:37.026350 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb01ec-0d69-450c-a0b4-facd224cc283 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:37.028503 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-f3bb01ec-0d69-450c-a0b4-facd224cc283 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:37.101636 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:37.136444 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb01ec-0d69-450c-a0b4-facd224cc283 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:37.141492 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93379a38-7388-48b1-b919-08485de46330 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:37.142188 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93379a38-7388-48b1-b919-08485de46330 service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:37.142467 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93379a38-7388-48b1-b919-08485de46330 service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:37.142733 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93379a38-7388-48b1-b919-08485de46330 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:37.175023 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93379a38-7388-48b1-b919-08485de46330 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:37.176728 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93379a38-7388-48b1-b919-08485de46330 service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:37.188772 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1076/2125] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:30:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:30:37.389864 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820f8f9f-53b4-4a1f-a267-f9f96943992f None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:37.389864 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-820f8f9f-53b4-4a1f-a267-f9f96943992f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:37.401630 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820f8f9f-53b4-4a1f-a267-f9f96943992f None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:37.407127 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c679b842-de2f-4996-95c2-d2041250547b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:37.408839 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679b842-de2f-4996-95c2-d2041250547b service cinder] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:37.409123 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679b842-de2f-4996-95c2-d2041250547b service cinder] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:37.409716 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679b842-de2f-4996-95c2-d2041250547b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:37.411294 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-c679b842-de2f-4996-95c2-d2041250547b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:37.501606 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c679b842-de2f-4996-95c2-d2041250547b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:37.503175 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c679b842-de2f-4996-95c2-d2041250547b service cinder] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:37.517487 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1050/2126] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:30:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:30:37.867134 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93379a38-7388-48b1-b919-08485de46330 service cinder] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:37.869282 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-93379a38-7388-48b1-b919-08485de46330 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:38.059574 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93379a38-7388-48b1-b919-08485de46330 service cinder] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:38.077860 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619e2aad-3665-4b3c-9919-c35c5fef6bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:38.078531 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e2aad-3665-4b3c-9919-c35c5fef6bfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:38.078806 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e2aad-3665-4b3c-9919-c35c5fef6bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:38.079098 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e2aad-3665-4b3c-9919-c35c5fef6bfe admin admin] PATH_INFO: `/v3/users/56642d70686d49568b06ed9e7e533161` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:38.080372 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619e2aad-3665-4b3c-9919-c35c5fef6bfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=56642d70686d49568b06ed9e7e533161)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:38.082333 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619e2aad-3665-4b3c-9919-c35c5fef6bfe admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:38.176459 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-619e2aad-3665-4b3c-9919-c35c5fef6bfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56642d70686d49568b06ed9e7e533161'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:38.192151 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-619e2aad-3665-4b3c-9919-c35c5fef6bfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56642d70686d49568b06ed9e7e533161'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:38.192828 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-619e2aad-3665-4b3c-9919-c35c5fef6bfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56642d70686d49568b06ed9e7e533161'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:38.228061 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-619e2aad-3665-4b3c-9919-c35c5fef6bfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56642d70686d49568b06ed9e7e533161'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:38.229292 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-619e2aad-3665-4b3c-9919-c35c5fef6bfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56642d70686d49568b06ed9e7e533161'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:38.252514 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1077/2127] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:30:37 2022] DELETE /identity/v3/users/56642d70686d49568b06ed9e7e533161 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:38.259698 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8471c-53ea-48b0-9938-e5220bbda18e None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:38.260494 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8471c-53ea-48b0-9938-e5220bbda18e None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:38.261621 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8471c-53ea-48b0-9938-e5220bbda18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:38.296222 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-7aa8471c-53ea-48b0-9938-e5220bbda18e None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:38.298082 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-7aa8471c-53ea-48b0-9938-e5220bbda18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:38.340758 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:38.426640 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1051/2128] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:38.469288 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619e2aad-3665-4b3c-9919-c35c5fef6bfe admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:38.471383 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-619e2aad-3665-4b3c-9919-c35c5fef6bfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:38.618365 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619e2aad-3665-4b3c-9919-c35c5fef6bfe admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:38.622793 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beaa38c-c8d2-48e1-9009-1b2c9e9dad22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:38.623685 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beaa38c-c8d2-48e1-9009-1b2c9e9dad22 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:38.624118 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beaa38c-c8d2-48e1-9009-1b2c9e9dad22 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:38.625376 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beaa38c-c8d2-48e1-9009-1b2c9e9dad22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:38.646856 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beaa38c-c8d2-48e1-9009-1b2c9e9dad22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:38.647080 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa8471c-53ea-48b0-9938-e5220bbda18e None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:38.648085 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beaa38c-c8d2-48e1-9009-1b2c9e9dad22 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:38.648206 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-7aa8471c-53ea-48b0-9938-e5220bbda18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:38.660325 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1078/2129] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:30:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:30:38.750968 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa8471c-53ea-48b0-9938-e5220bbda18e None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:38.755800 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c203995e-ebe4-4b15-9f00-ceb43900811c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:38.756616 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203995e-ebe4-4b15-9f00-ceb43900811c service cinder] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:38.756732 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203995e-ebe4-4b15-9f00-ceb43900811c service cinder] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:38.756964 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203995e-ebe4-4b15-9f00-ceb43900811c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:38.760321 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-c203995e-ebe4-4b15-9f00-ceb43900811c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:38.866919 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c203995e-ebe4-4b15-9f00-ceb43900811c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:38.869730 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c203995e-ebe4-4b15-9f00-ceb43900811c service cinder] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:38.890721 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1052/2130] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:30:38 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:30:39.519713 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beaa38c-c8d2-48e1-9009-1b2c9e9dad22 service neutron] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:39.521424 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-8beaa38c-c8d2-48e1-9009-1b2c9e9dad22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:39.534393 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:39.545183 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beaa38c-c8d2-48e1-9009-1b2c9e9dad22 service neutron] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:39.570268 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d4d86-abca-46b1-92f7-b8ca6f90501a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:39.571001 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d4d86-abca-46b1-92f7-b8ca6f90501a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:39.571285 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d4d86-abca-46b1-92f7-b8ca6f90501a admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:39.571589 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d4d86-abca-46b1-92f7-b8ca6f90501a admin admin] PATH_INFO: `/v3/projects/1183f0aa17f246749868bece11129236` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:39.574148 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9d4d86-abca-46b1-92f7-b8ca6f90501a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1183f0aa17f246749868bece11129236)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:39.576132 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9d4d86-abca-46b1-92f7-b8ca6f90501a admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:39.667550 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-1c9d4d86-abca-46b1-92f7-b8ca6f90501a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1183f0aa17f246749868bece11129236', 'request_id': 'req-1c9d4d86-abca-46b1-92f7-b8ca6f90501a'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:39.676598 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-1c9d4d86-abca-46b1-92f7-b8ca6f90501a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1183f0aa17f246749868bece11129236', 'request_id': 'req-1c9d4d86-abca-46b1-92f7-b8ca6f90501a'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:39.687833 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-1c9d4d86-abca-46b1-92f7-b8ca6f90501a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1183f0aa17f246749868bece11129236', 'request_id': 'req-1c9d4d86-abca-46b1-92f7-b8ca6f90501a'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:39.705058 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-1c9d4d86-abca-46b1-92f7-b8ca6f90501a admin admin] The token cache is being invalidate because project 1183f0aa17f246749868bece11129236 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:30:39.705677 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-1c9d4d86-abca-46b1-92f7-b8ca6f90501a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:39.706538 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-1c9d4d86-abca-46b1-92f7-b8ca6f90501a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:39.708587 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1079/2131] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:30:39 2022] DELETE /identity/v3/projects/1183f0aa17f246749868bece11129236 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:39.714305 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f4c7c-62b5-4d31-bf4c-abaa9c4ff648 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:39.715822 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f4c7c-62b5-4d31-bf4c-abaa9c4ff648 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:39.716415 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f4c7c-62b5-4d31-bf4c-abaa9c4ff648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:39.741002 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-7e6f4c7c-62b5-4d31-bf4c-abaa9c4ff648 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:39.742522 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-7e6f4c7c-62b5-4d31-bf4c-abaa9c4ff648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:39.874410 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1053/2132] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:39.875859 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ff9d7-0178-4af9-83b7-821807612eb0 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:39.880801 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ff9d7-0178-4af9-83b7-821807612eb0 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:39.881358 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ff9d7-0178-4af9-83b7-821807612eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:39.927833 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-de3ff9d7-0178-4af9-83b7-821807612eb0 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:39.929868 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-de3ff9d7-0178-4af9-83b7-821807612eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:39.951258 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1080/2133] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:39.955827 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f4c7c-62b5-4d31-bf4c-abaa9c4ff648 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:39.982236 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f4c7c-62b5-4d31-bf4c-abaa9c4ff648 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:39.989967 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a3e454-4f73-4477-a484-974020a70539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:39.990600 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3e454-4f73-4477-a484-974020a70539 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:39.990882 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3e454-4f73-4477-a484-974020a70539 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:39.991156 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3e454-4f73-4477-a484-974020a70539 admin admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:39.991899 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a3e454-4f73-4477-a484-974020a70539 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:30:39.992209 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a3e454-4f73-4477-a484-974020a70539 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:39.993858 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a3e454-4f73-4477-a484-974020a70539 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:40.024607 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1054/2134] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 30 01:30:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:30:40.026442 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ff9d7-0178-4af9-83b7-821807612eb0 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:40.037677 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ff9d7-0178-4af9-83b7-821807612eb0 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:40.046478 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82164b21-087c-4062-b86e-98e13e6af519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:40.047453 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82164b21-087c-4062-b86e-98e13e6af519 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:40.049126 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82164b21-087c-4062-b86e-98e13e6af519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:40.049504 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82164b21-087c-4062-b86e-98e13e6af519 admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:40.050084 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82164b21-087c-4062-b86e-98e13e6af519 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:40.054185 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82164b21-087c-4062-b86e-98e13e6af519 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:40.102748 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1081/2135] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:30:40 2022] POST /identity/v3/projects => generated 377 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:30:40.106744 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a3e454-4f73-4477-a484-974020a70539 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:40.113043 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:40.119522 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a3e454-4f73-4477-a484-974020a70539 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:40.163485 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82164b21-087c-4062-b86e-98e13e6af519 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:40.172041 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-82164b21-087c-4062-b86e-98e13e6af519 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:40.236928 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8e062-e6f8-495e-b3bf-90a68ecf16eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:40.237559 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8e062-e6f8-495e-b3bf-90a68ecf16eb admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:40.237839 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8e062-e6f8-495e-b3bf-90a68ecf16eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:40.238114 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8e062-e6f8-495e-b3bf-90a68ecf16eb admin admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:40.239268 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8e062-e6f8-495e-b3bf-90a68ecf16eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:40.241288 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8e062-e6f8-495e-b3bf-90a68ecf16eb admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:40.286119 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1055/2136] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:30:40 2022] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:30:40.288811 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8e062-e6f8-495e-b3bf-90a68ecf16eb admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:40.308300 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8e062-e6f8-495e-b3bf-90a68ecf16eb admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:40.322692 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82164b21-087c-4062-b86e-98e13e6af519 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:40.323733 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f357cd-2bb2-4aa7-b75a-02d9080dd818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:40.325418 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f357cd-2bb2-4aa7-b75a-02d9080dd818 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:40.325418 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f357cd-2bb2-4aa7-b75a-02d9080dd818 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:40.325418 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f357cd-2bb2-4aa7-b75a-02d9080dd818 admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:40.325686 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f357cd-2bb2-4aa7-b75a-02d9080dd818 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:40.327155 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f357cd-2bb2-4aa7-b75a-02d9080dd818 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:40.331181 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1837e3c-e8a1-4904-8a6e-16ff0d432f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:40.332508 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1837e3c-e8a1-4904-8a6e-16ff0d432f60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:40.333122 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1837e3c-e8a1-4904-8a6e-16ff0d432f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:40.334247 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1837e3c-e8a1-4904-8a6e-16ff0d432f60 admin admin] PATH_INFO: `/v3/users/69e04b9d9d764afca1fd13a4880fcd99` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:40.336903 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1837e3c-e8a1-4904-8a6e-16ff0d432f60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69e04b9d9d764afca1fd13a4880fcd99)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:40.339463 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1837e3c-e8a1-4904-8a6e-16ff0d432f60 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:40.369147 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1056/2137] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:30:40 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:30:40.374640 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f357cd-2bb2-4aa7-b75a-02d9080dd818 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:40.405646 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f357cd-2bb2-4aa7-b75a-02d9080dd818 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:40.418772 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd31fc8-7d7b-447a-80fb-5d2b641086bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:40.419318 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd31fc8-7d7b-447a-80fb-5d2b641086bc admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:40.419630 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd31fc8-7d7b-447a-80fb-5d2b641086bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:40.420660 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd31fc8-7d7b-447a-80fb-5d2b641086bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:40.421539 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd31fc8-7d7b-447a-80fb-5d2b641086bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:40.430399 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd31fc8-7d7b-447a-80fb-5d2b641086bc admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:40.458379 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-a1837e3c-e8a1-4904-8a6e-16ff0d432f60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69e04b9d9d764afca1fd13a4880fcd99'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:40.466460 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1057/2138] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:30:40 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:30:40.471268 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd31fc8-7d7b-447a-80fb-5d2b641086bc admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:40.482353 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-a1837e3c-e8a1-4904-8a6e-16ff0d432f60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69e04b9d9d764afca1fd13a4880fcd99'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:40.483514 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-a1837e3c-e8a1-4904-8a6e-16ff0d432f60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69e04b9d9d764afca1fd13a4880fcd99'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:40.489678 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:40.499946 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd31fc8-7d7b-447a-80fb-5d2b641086bc admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:40.512198 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f649e4-a901-4830-a071-579638d927b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:40.513203 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f649e4-a901-4830-a071-579638d927b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:40.513480 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f649e4-a901-4830-a071-579638d927b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:40.516782 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f649e4-a901-4830-a071-579638d927b6 admin admin] PATH_INFO: `/v3/projects/94a165de25ad47ea9cff3468751f285a/users/09b7e3c7518143d7a23b8bfb76155fe6/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:40.532504 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-a1837e3c-e8a1-4904-8a6e-16ff0d432f60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69e04b9d9d764afca1fd13a4880fcd99'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:40.533288 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-a1837e3c-e8a1-4904-8a6e-16ff0d432f60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69e04b9d9d764afca1fd13a4880fcd99'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:40.551346 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1082/2139] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:30:40 2022] DELETE /identity/v3/users/69e04b9d9d764afca1fd13a4880fcd99 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:40.554292 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f649e4-a901-4830-a071-579638d927b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94a165de25ad47ea9cff3468751f285a, user_id=09b7e3c7518143d7a23b8bfb76155fe6, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:40.557046 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e6032-d9ff-4bd2-9312-d74cd3373efa None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:40.557337 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e6032-d9ff-4bd2-9312-d74cd3373efa None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:40.557468 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f649e4-a901-4830-a071-579638d927b6 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:40.557633 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e6032-d9ff-4bd2-9312-d74cd3373efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:40.585403 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1058/2140] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:30:40 2022] PUT /identity/v3/projects/94a165de25ad47ea9cff3468751f285a/users/09b7e3c7518143d7a23b8bfb76155fe6/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:30:40.587704 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-768e6032-d9ff-4bd2-9312-d74cd3373efa None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:40.588957 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-768e6032-d9ff-4bd2-9312-d74cd3373efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:40.597736 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a8625-ab05-47dc-8b62-6863527e3111 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:40.598089 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a8625-ab05-47dc-8b62-6863527e3111 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:40.598357 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a8625-ab05-47dc-8b62-6863527e3111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:40.678542 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-826a8625-ab05-47dc-8b62-6863527e3111 None None] MFA Rules not processed for user `09b7e3c7518143d7a23b8bfb76155fe6`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:40.680406 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-826a8625-ab05-47dc-8b62-6863527e3111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:40.832832 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1083/2141] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:40.846591 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1059/2142] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:40.850866 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768e6032-d9ff-4bd2-9312-d74cd3373efa None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:40.851356 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a8625-ab05-47dc-8b62-6863527e3111 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:40.853601 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-768e6032-d9ff-4bd2-9312-d74cd3373efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:40.853915 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-826a8625-ab05-47dc-8b62-6863527e3111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:40.886006 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a8625-ab05-47dc-8b62-6863527e3111 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:40.893679 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9ba2c3-9fce-44fe-a5af-28fe81fde3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:40.894349 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ba2c3-9fce-44fe-a5af-28fe81fde3f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:40.895419 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ba2c3-9fce-44fe-a5af-28fe81fde3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:40.898274 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ba2c3-9fce-44fe-a5af-28fe81fde3f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:40.898964 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9ba2c3-9fce-44fe-a5af-28fe81fde3f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:40.934128 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9ba2c3-9fce-44fe-a5af-28fe81fde3f3 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:40.973433 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768e6032-d9ff-4bd2-9312-d74cd3373efa None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:40.977510 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620cafb2-af68-4f58-b459-d5147e55b196 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:40.978135 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620cafb2-af68-4f58-b459-d5147e55b196 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:40.978505 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620cafb2-af68-4f58-b459-d5147e55b196 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:40.978784 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620cafb2-af68-4f58-b459-d5147e55b196 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:40.983660 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1060/2143] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:30:40 2022] POST /identity/v3/projects => generated 377 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:30:40.987557 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9ba2c3-9fce-44fe-a5af-28fe81fde3f3 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:41.004386 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620cafb2-af68-4f58-b459-d5147e55b196 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:41.007756 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620cafb2-af68-4f58-b459-d5147e55b196 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:41.023327 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:41.033366 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1084/2144] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:30:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:30:41.125811 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9ba2c3-9fce-44fe-a5af-28fe81fde3f3 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:41.136713 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b746c673-35dd-41e4-94bb-10ba0f7c7e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:41.138527 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746c673-35dd-41e4-94bb-10ba0f7c7e7a admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:41.139057 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746c673-35dd-41e4-94bb-10ba0f7c7e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:41.139999 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746c673-35dd-41e4-94bb-10ba0f7c7e7a admin admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:41.140980 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b746c673-35dd-41e4-94bb-10ba0f7c7e7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:41.143844 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b746c673-35dd-41e4-94bb-10ba0f7c7e7a admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:41.183829 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1061/2145] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:30:40 2022] POST /identity/v3/users => generated 289 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:30:41.188196 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620cafb2-af68-4f58-b459-d5147e55b196 service neutron] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:41.202199 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620cafb2-af68-4f58-b459-d5147e55b196 service neutron] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:41.220775 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0abd9-1dcb-4f83-831c-f37f7fe83315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:41.223346 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0abd9-1dcb-4f83-831c-f37f7fe83315 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:41.224656 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0abd9-1dcb-4f83-831c-f37f7fe83315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:41.225279 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0abd9-1dcb-4f83-831c-f37f7fe83315 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:41.227455 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe0abd9-1dcb-4f83-831c-f37f7fe83315 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:41.233630 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe0abd9-1dcb-4f83-831c-f37f7fe83315 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:41.255608 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1085/2146] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:30:41 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:30:41.260601 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b746c673-35dd-41e4-94bb-10ba0f7c7e7a admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:41.275203 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b746c673-35dd-41e4-94bb-10ba0f7c7e7a admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:41.289166 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423036ef-dff2-4527-b8d3-ac0d618abc07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:41.289914 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423036ef-dff2-4527-b8d3-ac0d618abc07 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:41.290193 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423036ef-dff2-4527-b8d3-ac0d618abc07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:41.290461 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423036ef-dff2-4527-b8d3-ac0d618abc07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:41.291117 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423036ef-dff2-4527-b8d3-ac0d618abc07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:41.292926 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423036ef-dff2-4527-b8d3-ac0d618abc07 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:41.314879 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1062/2147] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:30:41 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:30:41.319221 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0abd9-1dcb-4f83-831c-f37f7fe83315 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:41.333348 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0abd9-1dcb-4f83-831c-f37f7fe83315 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:41.340523 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42245f70-cd40-48ec-85b3-92f4028254a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:41.341301 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42245f70-cd40-48ec-85b3-92f4028254a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:41.341654 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42245f70-cd40-48ec-85b3-92f4028254a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:41.341999 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42245f70-cd40-48ec-85b3-92f4028254a4 admin admin] PATH_INFO: `/v3/projects/29f5cb224433441196c46e036c163b5f/users/843f98cf26da41c2aabd4a1ebb859765/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:41.366579 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42245f70-cd40-48ec-85b3-92f4028254a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29f5cb224433441196c46e036c163b5f, user_id=843f98cf26da41c2aabd4a1ebb859765, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:41.370679 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42245f70-cd40-48ec-85b3-92f4028254a4 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:41.398918 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1086/2148] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:30:41 2022] PUT /identity/v3/projects/29f5cb224433441196c46e036c163b5f/users/843f98cf26da41c2aabd4a1ebb859765/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:41.401363 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136bc99-5ff8-4b86-99cf-828214a42bca None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:41.402159 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136bc99-5ff8-4b86-99cf-828214a42bca None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:41.402449 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136bc99-5ff8-4b86-99cf-828214a42bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:41.456866 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-7136bc99-5ff8-4b86-99cf-828214a42bca None None] MFA Rules not processed for user `843f98cf26da41c2aabd4a1ebb859765`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:41.458908 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-7136bc99-5ff8-4b86-99cf-828214a42bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:41.605092 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1063/2149] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:41.607993 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42245f70-cd40-48ec-85b3-92f4028254a4 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:41.635927 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7136bc99-5ff8-4b86-99cf-828214a42bca None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:41.638398 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-7136bc99-5ff8-4b86-99cf-828214a42bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:41.764598 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:41.809891 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42245f70-cd40-48ec-85b3-92f4028254a4 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:41.822602 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7136bc99-5ff8-4b86-99cf-828214a42bca None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:41.831467 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be9ba7-2513-4a5c-9400-9eb66788cf0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:41.832773 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be9ba7-2513-4a5c-9400-9eb66788cf0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:41.834301 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be9ba7-2513-4a5c-9400-9eb66788cf0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:41.835122 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be9ba7-2513-4a5c-9400-9eb66788cf0e admin admin] PATH_INFO: `/v3/projects/bb5d2bf5b90e4f8da32f58173af3c9e3` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:41.838253 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf12267-ebc8-40f4-80c1-256b846c3fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:41.839557 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2be9ba7-2513-4a5c-9400-9eb66788cf0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb5d2bf5b90e4f8da32f58173af3c9e3)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:41.840496 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf12267-ebc8-40f4-80c1-256b846c3fb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:41.840726 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf12267-ebc8-40f4-80c1-256b846c3fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:41.844227 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf12267-ebc8-40f4-80c1-256b846c3fb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:41.845858 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2be9ba7-2513-4a5c-9400-9eb66788cf0e admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:41.846751 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf12267-ebc8-40f4-80c1-256b846c3fb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:41.853007 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf12267-ebc8-40f4-80c1-256b846c3fb0 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:41.897480 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:41.954841 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1087/2150] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:30:41 2022] POST /identity/v3/projects => generated 375 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:30:41.961738 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf12267-ebc8-40f4-80c1-256b846c3fb0 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:41.966715 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-a2be9ba7-2513-4a5c-9400-9eb66788cf0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb5d2bf5b90e4f8da32f58173af3c9e3', 'request_id': 'req-a2be9ba7-2513-4a5c-9400-9eb66788cf0e'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:41.978633 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-a2be9ba7-2513-4a5c-9400-9eb66788cf0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb5d2bf5b90e4f8da32f58173af3c9e3', 'request_id': 'req-a2be9ba7-2513-4a5c-9400-9eb66788cf0e'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:41.997958 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-a2be9ba7-2513-4a5c-9400-9eb66788cf0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb5d2bf5b90e4f8da32f58173af3c9e3', 'request_id': 'req-a2be9ba7-2513-4a5c-9400-9eb66788cf0e'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:42.042936 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-a2be9ba7-2513-4a5c-9400-9eb66788cf0e admin admin] The token cache is being invalidate because project bb5d2bf5b90e4f8da32f58173af3c9e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81447) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:30:42.043239 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-a2be9ba7-2513-4a5c-9400-9eb66788cf0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:42.045793 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-a2be9ba7-2513-4a5c-9400-9eb66788cf0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:42.047852 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1064/2151] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:30:41 2022] DELETE /identity/v3/projects/bb5d2bf5b90e4f8da32f58173af3c9e3 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:30:42.053409 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114dd108-aef8-4915-8e34-9a438fce1027 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:42.053758 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114dd108-aef8-4915-8e34-9a438fce1027 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:42.053979 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114dd108-aef8-4915-8e34-9a438fce1027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:42.114042 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-114dd108-aef8-4915-8e34-9a438fce1027 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:42.121946 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-114dd108-aef8-4915-8e34-9a438fce1027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:42.152940 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf12267-ebc8-40f4-80c1-256b846c3fb0 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:42.159863 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1065/2152] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:42.169115 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a5466f-fc12-4a40-9246-d3e9014aea22 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:42.169384 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a5466f-fc12-4a40-9246-d3e9014aea22 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:42.169645 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a5466f-fc12-4a40-9246-d3e9014aea22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:42.183128 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d476a8d-c3ab-442f-9500-37602dc5d814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:42.185237 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d476a8d-c3ab-442f-9500-37602dc5d814 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:42.185515 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d476a8d-c3ab-442f-9500-37602dc5d814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:42.185792 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d476a8d-c3ab-442f-9500-37602dc5d814 admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:42.186444 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d476a8d-c3ab-442f-9500-37602dc5d814 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:42.189893 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d476a8d-c3ab-442f-9500-37602dc5d814 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:42.234860 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1088/2153] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:30:41 2022] POST /identity/v3/users => generated 294 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:30:42.238639 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d476a8d-c3ab-442f-9500-37602dc5d814 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:42.244294 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-2d476a8d-c3ab-442f-9500-37602dc5d814 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:42.270046 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-26a5466f-fc12-4a40-9246-d3e9014aea22 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:42.271314 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-26a5466f-fc12-4a40-9246-d3e9014aea22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:42.277972 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d476a8d-c3ab-442f-9500-37602dc5d814 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:42.288578 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4577e3-b8e9-43fa-816d-23c041cdaa4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:42.289692 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4577e3-b8e9-43fa-816d-23c041cdaa4b admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:42.291766 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4577e3-b8e9-43fa-816d-23c041cdaa4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:42.291766 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4577e3-b8e9-43fa-816d-23c041cdaa4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:42.292213 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4577e3-b8e9-43fa-816d-23c041cdaa4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:42.294998 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4577e3-b8e9-43fa-816d-23c041cdaa4b admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:42.312818 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1066/2154] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:42.314360 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a5466f-fc12-4a40-9246-d3e9014aea22 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:42.330534 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a5466f-fc12-4a40-9246-d3e9014aea22 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:42.332787 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1089/2155] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:30:42.337737 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4577e3-b8e9-43fa-816d-23c041cdaa4b admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:42.356687 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a227a4f4-744b-4fc6-b259-06a29dbc34de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:42.357320 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a227a4f4-744b-4fc6-b259-06a29dbc34de admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:42.357601 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a227a4f4-744b-4fc6-b259-06a29dbc34de admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:42.358758 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a227a4f4-744b-4fc6-b259-06a29dbc34de admin admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:42.358758 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a227a4f4-744b-4fc6-b259-06a29dbc34de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:30:42.358955 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a227a4f4-744b-4fc6-b259-06a29dbc34de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:42.363483 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a227a4f4-744b-4fc6-b259-06a29dbc34de admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:42.363739 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4577e3-b8e9-43fa-816d-23c041cdaa4b admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:42.402204 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7e6cf-4aec-45f0-8401-32e7c45db09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:42.402204 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7e6cf-4aec-45f0-8401-32e7c45db09a admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:42.402204 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7e6cf-4aec-45f0-8401-32e7c45db09a admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:42.402204 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7e6cf-4aec-45f0-8401-32e7c45db09a admin admin] PATH_INFO: `/v3/projects/4dd337cdff144c52bbae544ea9101c3a/users/74caa02068c94e00b3fec9766531d55a/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:42.402517 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1067/2156] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 30 01:30:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:30:42.402517 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a227a4f4-744b-4fc6-b259-06a29dbc34de admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:42.423523 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a7e6cf-4aec-45f0-8401-32e7c45db09a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dd337cdff144c52bbae544ea9101c3a, user_id=74caa02068c94e00b3fec9766531d55a, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:42.426870 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a7e6cf-4aec-45f0-8401-32e7c45db09a admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:42.429594 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a227a4f4-744b-4fc6-b259-06a29dbc34de admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:42.441536 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d9c5b-8a71-4853-be5f-19cd911a385c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:42.442295 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d9c5b-8a71-4853-be5f-19cd911a385c admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:42.442565 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d9c5b-8a71-4853-be5f-19cd911a385c admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:42.443493 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d9c5b-8a71-4853-be5f-19cd911a385c admin admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:42.448175 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322d9c5b-8a71-4853-be5f-19cd911a385c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:42.449408 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1090/2157] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:30:42 2022] PUT /identity/v3/projects/4dd337cdff144c52bbae544ea9101c3a/users/74caa02068c94e00b3fec9766531d55a/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:30:42.452538 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322d9c5b-8a71-4853-be5f-19cd911a385c admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:42.453742 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7e6cf-4aec-45f0-8401-32e7c45db09a admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:42.535257 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1068/2158] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:30:42 2022] POST /identity/v3/projects => generated 363 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:30:42.547051 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d9c5b-8a71-4853-be5f-19cd911a385c admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:42.575303 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7e6cf-4aec-45f0-8401-32e7c45db09a admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:42.649140 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:42.701802 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d9c5b-8a71-4853-be5f-19cd911a385c admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:42.714086 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ce92ac-f39a-4494-b252-cadb73828526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:42.714086 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce92ac-f39a-4494-b252-cadb73828526 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:42.714493 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce92ac-f39a-4494-b252-cadb73828526 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:42.714909 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce92ac-f39a-4494-b252-cadb73828526 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:42.715641 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ce92ac-f39a-4494-b252-cadb73828526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:42.718100 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ce92ac-f39a-4494-b252-cadb73828526 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:42.724810 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf5312-fd85-41a5-b272-9ecec6381211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:42.727592 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf5312-fd85-41a5-b272-9ecec6381211 admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:42.727903 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf5312-fd85-41a5-b272-9ecec6381211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:42.728186 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf5312-fd85-41a5-b272-9ecec6381211 admin admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:42.730176 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cf5312-fd85-41a5-b272-9ecec6381211 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:42.737271 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cf5312-fd85-41a5-b272-9ecec6381211 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:42.756496 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1091/2159] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:30:42.759084 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ce92ac-f39a-4494-b252-cadb73828526 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:42.782200 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ce92ac-f39a-4494-b252-cadb73828526 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:42.787175 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1069/2160] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:30:42 2022] POST /identity/v3/users => generated 282 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:30:42.789371 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf5312-fd85-41a5-b272-9ecec6381211 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:42.800705 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf5312-fd85-41a5-b272-9ecec6381211 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:42.802800 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8908f0-f60a-4baa-9268-bff6dadd1df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:42.804826 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8908f0-f60a-4baa-9268-bff6dadd1df2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:42.805182 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8908f0-f60a-4baa-9268-bff6dadd1df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:42.806079 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8908f0-f60a-4baa-9268-bff6dadd1df2 admin admin] PATH_INFO: `/v3/projects/4dd337cdff144c52bbae544ea9101c3a/users/74caa02068c94e00b3fec9766531d55a/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:42.810708 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5d0899-ba96-484b-ab47-5410f9ad3896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:42.811773 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8908f0-f60a-4baa-9268-bff6dadd1df2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dd337cdff144c52bbae544ea9101c3a, user_id=74caa02068c94e00b3fec9766531d55a, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:42.814175 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d0899-ba96-484b-ab47-5410f9ad3896 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:42.814479 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d0899-ba96-484b-ab47-5410f9ad3896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:42.814758 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d0899-ba96-484b-ab47-5410f9ad3896 admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:42.816636 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5d0899-ba96-484b-ab47-5410f9ad3896 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:42.818792 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8908f0-f60a-4baa-9268-bff6dadd1df2 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:42.821442 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5d0899-ba96-484b-ab47-5410f9ad3896 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:42.855477 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1092/2161] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:30:42 2022] PUT /identity/v3/projects/4dd337cdff144c52bbae544ea9101c3a/users/74caa02068c94e00b3fec9766531d55a/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:42.855841 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1070/2162] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:30:42.858130 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3825f-ebb3-42b8-a556-0622ad1cbaa7 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:42.858130 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3825f-ebb3-42b8-a556-0622ad1cbaa7 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:42.858130 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3825f-ebb3-42b8-a556-0622ad1cbaa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:42.860514 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5d0899-ba96-484b-ab47-5410f9ad3896 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:42.881348 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5d0899-ba96-484b-ab47-5410f9ad3896 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:42.934214 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-6ff3825f-ebb3-42b8-a556-0622ad1cbaa7 None None] MFA Rules not processed for user `74caa02068c94e00b3fec9766531d55a`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:42.938206 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-6ff3825f-ebb3-42b8-a556-0622ad1cbaa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:42.987372 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:43.019781 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df78207-9471-42fd-ae64-fd95b5185799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:43.021345 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df78207-9471-42fd-ae64-fd95b5185799 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:43.021632 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df78207-9471-42fd-ae64-fd95b5185799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:43.037667 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df78207-9471-42fd-ae64-fd95b5185799 admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:43.041041 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df78207-9471-42fd-ae64-fd95b5185799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:43.042790 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df78207-9471-42fd-ae64-fd95b5185799 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:43.061990 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1071/2163] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:30:43.063099 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df78207-9471-42fd-ae64-fd95b5185799 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:43.089504 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df78207-9471-42fd-ae64-fd95b5185799 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:43.108151 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54911c09-07f8-4c40-876d-ae523c50997d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:43.108151 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54911c09-07f8-4c40-876d-ae523c50997d admin admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:43.108151 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54911c09-07f8-4c40-876d-ae523c50997d admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:43.108151 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54911c09-07f8-4c40-876d-ae523c50997d admin admin] PATH_INFO: `/v3/projects/d983a79e54e54c82bdb8670a7bc980ff/users/f452ddb0bc1b47f89dc4d659c385b536/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:43.108635 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1093/2164] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:42 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:43.140052 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54911c09-07f8-4c40-876d-ae523c50997d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d983a79e54e54c82bdb8670a7bc980ff, user_id=f452ddb0bc1b47f89dc4d659c385b536, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:43.143916 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54911c09-07f8-4c40-876d-ae523c50997d admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:43.146733 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff3825f-ebb3-42b8-a556-0622ad1cbaa7 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:43.148354 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-6ff3825f-ebb3-42b8-a556-0622ad1cbaa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:43.169623 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1072/2165] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:30:43 2022] PUT /identity/v3/projects/d983a79e54e54c82bdb8670a7bc980ff/users/f452ddb0bc1b47f89dc4d659c385b536/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:43.179675 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13167c97-0514-4cc6-9f42-c3d2f416c25e None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:43.180166 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13167c97-0514-4cc6-9f42-c3d2f416c25e None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:43.180297 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13167c97-0514-4cc6-9f42-c3d2f416c25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:43.250572 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-13167c97-0514-4cc6-9f42-c3d2f416c25e None None] MFA Rules not processed for user `f452ddb0bc1b47f89dc4d659c385b536`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:43.252379 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-13167c97-0514-4cc6-9f42-c3d2f416c25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:43.302479 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff3825f-ebb3-42b8-a556-0622ad1cbaa7 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:43.378281 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1073/2166] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:43.395304 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13167c97-0514-4cc6-9f42-c3d2f416c25e None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:43.400425 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-13167c97-0514-4cc6-9f42-c3d2f416c25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:43.418829 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8b8673-8f45-488c-aa38-097b52689580 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:43.419764 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b8673-8f45-488c-aa38-097b52689580 service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:43.420301 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b8673-8f45-488c-aa38-097b52689580 service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:43.420663 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b8673-8f45-488c-aa38-097b52689580 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:43.424153 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-4d8b8673-8f45-488c-aa38-097b52689580 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:43.442351 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:43.542822 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13167c97-0514-4cc6-9f42-c3d2f416c25e None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:43.552923 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f120c53-c8f3-4695-bc0c-adea5c618daa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:43.554102 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f120c53-c8f3-4695-bc0c-adea5c618daa service cinder] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:43.554289 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f120c53-c8f3-4695-bc0c-adea5c618daa service cinder] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:43.554555 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f120c53-c8f3-4695-bc0c-adea5c618daa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:43.567137 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f120c53-c8f3-4695-bc0c-adea5c618daa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:43.570763 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f120c53-c8f3-4695-bc0c-adea5c618daa service cinder] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:43.576866 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8b8673-8f45-488c-aa38-097b52689580 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:43.577477 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8b8673-8f45-488c-aa38-097b52689580 service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:43.586361 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1074/2167] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:30:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:30:43.607938 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1094/2168] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:30:43 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:30:44.263613 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f120c53-c8f3-4695-bc0c-adea5c618daa service cinder] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:44.266009 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-7f120c53-c8f3-4695-bc0c-adea5c618daa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:44.270586 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a83caa-a7ae-47e9-aa39-637b9337bee3 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:44.271406 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a83caa-a7ae-47e9-aa39-637b9337bee3 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:44.271885 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a83caa-a7ae-47e9-aa39-637b9337bee3 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:44.273958 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1095/2169] 10.222.0.60 () {54 vars in 921 bytes} [Tue Aug 30 01:30:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:30:44.284485 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd384ea1-4245-4bde-9cf8-08731486ad40 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:44.285974 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd384ea1-4245-4bde-9cf8-08731486ad40 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:44.286979 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd384ea1-4245-4bde-9cf8-08731486ad40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:44.323270 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-dd384ea1-4245-4bde-9cf8-08731486ad40 None None] MFA Rules not processed for user `e8dbb4742c3944b9ad389e9628b5a047`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:44.324559 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-dd384ea1-4245-4bde-9cf8-08731486ad40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:44.380090 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:44.404681 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f120c53-c8f3-4695-bc0c-adea5c618daa service cinder] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:44.413696 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3d583-ec6a-4137-ba53-d51220e19158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:44.414776 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3d583-ec6a-4137-ba53-d51220e19158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:44.415143 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3d583-ec6a-4137-ba53-d51220e19158 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:44.415324 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3d583-ec6a-4137-ba53-d51220e19158 admin admin] PATH_INFO: `/v3/users/7a9336384df24a3fb7565ef151a5adad` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:44.417274 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f3d583-ec6a-4137-ba53-d51220e19158 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a9336384df24a3fb7565ef151a5adad)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:44.420043 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f3d583-ec6a-4137-ba53-d51220e19158 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:44.430311 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1096/2170] 10.222.0.60 () {58 vars in 1018 bytes} [Tue Aug 30 01:30:44 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:44.431189 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd384ea1-4245-4bde-9cf8-08731486ad40 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:44.432586 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-dd384ea1-4245-4bde-9cf8-08731486ad40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:44.449639 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd384ea1-4245-4bde-9cf8-08731486ad40 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:44.454996 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117dfad2-18d1-4c66-86d0-6a17f51a40ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:44.456661 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117dfad2-18d1-4c66-86d0-6a17f51a40ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:44.456954 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117dfad2-18d1-4c66-86d0-6a17f51a40ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:44.457224 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117dfad2-18d1-4c66-86d0-6a17f51a40ba admin admin] PATH_INFO: `/v3/users/55904c5143cd4836bf6e3a97e9262eb7` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:44.458917 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117dfad2-18d1-4c66-86d0-6a17f51a40ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=55904c5143cd4836bf6e3a97e9262eb7)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:44.464138 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117dfad2-18d1-4c66-86d0-6a17f51a40ba admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:44.500040 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-b0f3d583-ec6a-4137-ba53-d51220e19158 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a9336384df24a3fb7565ef151a5adad'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:44.509323 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-b0f3d583-ec6a-4137-ba53-d51220e19158 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a9336384df24a3fb7565ef151a5adad'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:44.511416 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-b0f3d583-ec6a-4137-ba53-d51220e19158 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a9336384df24a3fb7565ef151a5adad'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:44.512746 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-b0f3d583-ec6a-4137-ba53-d51220e19158 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a9336384df24a3fb7565ef151a5adad'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:44.530570 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-117dfad2-18d1-4c66-86d0-6a17f51a40ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55904c5143cd4836bf6e3a97e9262eb7'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:44.543308 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-117dfad2-18d1-4c66-86d0-6a17f51a40ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55904c5143cd4836bf6e3a97e9262eb7'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:44.544225 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-117dfad2-18d1-4c66-86d0-6a17f51a40ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55904c5143cd4836bf6e3a97e9262eb7'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:44.546626 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-b0f3d583-ec6a-4137-ba53-d51220e19158 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a9336384df24a3fb7565ef151a5adad'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:44.569179 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1075/2171] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:30:44 2022] DELETE /identity/v3/users/7a9336384df24a3fb7565ef151a5adad => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:44.570585 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb8cc7-4bf5-4880-903c-416b44c53c52 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:44.570871 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb8cc7-4bf5-4880-903c-416b44c53c52 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:44.571139 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb8cc7-4bf5-4880-903c-416b44c53c52 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:44.573622 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1076/2172] 10.222.0.60 () {54 vars in 961 bytes} [Tue Aug 30 01:30:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:30:44.574787 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-117dfad2-18d1-4c66-86d0-6a17f51a40ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55904c5143cd4836bf6e3a97e9262eb7'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:44.575413 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db2cc3-2219-4529-ad17-40d4d1815582 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:44.575722 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db2cc3-2219-4529-ad17-40d4d1815582 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:44.576039 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db2cc3-2219-4529-ad17-40d4d1815582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:44.578677 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-117dfad2-18d1-4c66-86d0-6a17f51a40ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55904c5143cd4836bf6e3a97e9262eb7'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:44.617994 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-18db2cc3-2219-4529-ad17-40d4d1815582 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:44.618403 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-18db2cc3-2219-4529-ad17-40d4d1815582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:44.619909 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1097/2173] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:30:44 2022] DELETE /identity/v3/users/55904c5143cd4836bf6e3a97e9262eb7 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:44.621266 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe4e82-a05e-4648-8b20-83bb9581a7d7 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:44.627184 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe4e82-a05e-4648-8b20-83bb9581a7d7 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:44.627754 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe4e82-a05e-4648-8b20-83bb9581a7d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:44.654812 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-e9fe4e82-a05e-4648-8b20-83bb9581a7d7 None None] MFA Rules not processed for user `e8dbb4742c3944b9ad389e9628b5a047`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:44.656626 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-e9fe4e82-a05e-4648-8b20-83bb9581a7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:44.695340 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:44.734579 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1077/2174] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:44.758969 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db2cc3-2219-4529-ad17-40d4d1815582 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:44.760593 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-18db2cc3-2219-4529-ad17-40d4d1815582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:44.887074 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1098/2175] 10.222.0.60 () {58 vars in 1058 bytes} [Tue Aug 30 01:30:44 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:44.887271 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db2cc3-2219-4529-ad17-40d4d1815582 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:44.892266 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fe4e82-a05e-4648-8b20-83bb9581a7d7 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:44.902698 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f02e754-4232-4fe3-8364-1206654003f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:44.903352 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02e754-4232-4fe3-8364-1206654003f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:44.903609 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02e754-4232-4fe3-8364-1206654003f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:44.904530 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02e754-4232-4fe3-8364-1206654003f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:44.913304 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fe4e82-a05e-4648-8b20-83bb9581a7d7 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:44.927107 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f02e754-4232-4fe3-8364-1206654003f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:44.928661 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f02e754-4232-4fe3-8364-1206654003f4 service neutron] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:44.928945 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc025fb-6523-49f5-881b-bc98b51a5aad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8dbb4742c3944b9ad389e9628b5a047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:44.930039 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc025fb-6523-49f5-881b-bc98b51a5aad service placement] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:44.931159 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc025fb-6523-49f5-881b-bc98b51a5aad service placement] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:44.931879 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc025fb-6523-49f5-881b-bc98b51a5aad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:44.934567 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-8cc025fb-6523-49f5-881b-bc98b51a5aad service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:44.954530 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1078/2176] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:30:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:30:44.956130 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f02e754-4232-4fe3-8364-1206654003f4 service neutron] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:44.959122 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-9f02e754-4232-4fe3-8364-1206654003f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:44.968813 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc025fb-6523-49f5-881b-bc98b51a5aad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:44.970660 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc025fb-6523-49f5-881b-bc98b51a5aad service placement] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:44.980632 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f02e754-4232-4fe3-8364-1206654003f4 service neutron] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:44.988801 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b93fbf-cc98-41e5-9589-c196723006a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:44.989642 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b93fbf-cc98-41e5-9589-c196723006a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:44.990165 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b93fbf-cc98-41e5-9589-c196723006a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:44.990506 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b93fbf-cc98-41e5-9589-c196723006a1 admin admin] PATH_INFO: `/v3/projects/fc70ed6d5f5344f28554bcda77c1a552` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:44.991224 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1099/2177] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:30:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:30:44.991926 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b93fbf-cc98-41e5-9589-c196723006a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc70ed6d5f5344f28554bcda77c1a552)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:44.994615 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b93fbf-cc98-41e5-9589-c196723006a1 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:45.004033 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:45.116335 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-d2b93fbf-cc98-41e5-9589-c196723006a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc70ed6d5f5344f28554bcda77c1a552', 'request_id': 'req-d2b93fbf-cc98-41e5-9589-c196723006a1'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:45.129728 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-d2b93fbf-cc98-41e5-9589-c196723006a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc70ed6d5f5344f28554bcda77c1a552', 'request_id': 'req-d2b93fbf-cc98-41e5-9589-c196723006a1'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:45.140264 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-d2b93fbf-cc98-41e5-9589-c196723006a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc70ed6d5f5344f28554bcda77c1a552', 'request_id': 'req-d2b93fbf-cc98-41e5-9589-c196723006a1'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:45.157185 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-d2b93fbf-cc98-41e5-9589-c196723006a1 admin admin] The token cache is being invalidate because project fc70ed6d5f5344f28554bcda77c1a552 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81447) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:30:45.157185 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-d2b93fbf-cc98-41e5-9589-c196723006a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:45.158142 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-d2b93fbf-cc98-41e5-9589-c196723006a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:45.170483 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1079/2178] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:30:44 2022] DELETE /identity/v3/projects/fc70ed6d5f5344f28554bcda77c1a552 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:45.172384 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a33411-ca36-4b3b-9be5-dd734f60e526 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:45.172902 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a33411-ca36-4b3b-9be5-dd734f60e526 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:45.173363 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a33411-ca36-4b3b-9be5-dd734f60e526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:45.210867 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-c7a33411-ca36-4b3b-9be5-dd734f60e526 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:45.212967 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-c7a33411-ca36-4b3b-9be5-dd734f60e526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:45.308732 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1100/2179] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:45.310434 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53c32a-f12d-4e18-98ff-e5439a858de5 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:45.310819 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53c32a-f12d-4e18-98ff-e5439a858de5 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:45.311030 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53c32a-f12d-4e18-98ff-e5439a858de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:45.363243 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-8d53c32a-f12d-4e18-98ff-e5439a858de5 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:45.365111 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-8d53c32a-f12d-4e18-98ff-e5439a858de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:45.389039 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1080/2180] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:45.396203 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a33411-ca36-4b3b-9be5-dd734f60e526 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:45.412505 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a33411-ca36-4b3b-9be5-dd734f60e526 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:45.420815 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be81e20b-445b-41c7-b70e-72b1bb9e0430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:45.421650 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81e20b-445b-41c7-b70e-72b1bb9e0430 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:45.421939 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81e20b-445b-41c7-b70e-72b1bb9e0430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:45.423724 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81e20b-445b-41c7-b70e-72b1bb9e0430 admin admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:45.424415 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be81e20b-445b-41c7-b70e-72b1bb9e0430 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:30:45.424725 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be81e20b-445b-41c7-b70e-72b1bb9e0430 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:45.426360 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be81e20b-445b-41c7-b70e-72b1bb9e0430 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:45.475658 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d53c32a-f12d-4e18-98ff-e5439a858de5 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:45.492911 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1101/2181] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 30 01:30:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:30:45.494111 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d53c32a-f12d-4e18-98ff-e5439a858de5 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:45.502279 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d3047-177c-4b09-9667-e00e741c91e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:45.502915 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d3047-177c-4b09-9667-e00e741c91e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:45.503195 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d3047-177c-4b09-9667-e00e741c91e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:45.503506 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d3047-177c-4b09-9667-e00e741c91e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:45.504263 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6d3047-177c-4b09-9667-e00e741c91e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:45.507441 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6d3047-177c-4b09-9667-e00e741c91e4 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:45.545344 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1081/2182] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:30:45 2022] POST /identity/v3/projects => generated 373 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:30:45.549488 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be81e20b-445b-41c7-b70e-72b1bb9e0430 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:45.570076 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be81e20b-445b-41c7-b70e-72b1bb9e0430 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:45.626535 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d3047-177c-4b09-9667-e00e741c91e4 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:45.629302 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-1d6d3047-177c-4b09-9667-e00e741c91e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:45.751991 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6c312a-77f8-4233-b211-4d2fd08fd8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:45.752606 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c312a-77f8-4233-b211-4d2fd08fd8fa admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:45.752892 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c312a-77f8-4233-b211-4d2fd08fd8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:45.753162 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c312a-77f8-4233-b211-4d2fd08fd8fa admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:45.753816 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6c312a-77f8-4233-b211-4d2fd08fd8fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:45.755816 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6c312a-77f8-4233-b211-4d2fd08fd8fa admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:45.782962 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1102/2183] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:30:45 2022] POST /identity/v3/users => generated 287 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:30:45.783768 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6c312a-77f8-4233-b211-4d2fd08fd8fa admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:45.788475 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-cc6c312a-77f8-4233-b211-4d2fd08fd8fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:45.802068 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d3047-177c-4b09-9667-e00e741c91e4 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:45.810228 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6c312a-77f8-4233-b211-4d2fd08fd8fa admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:45.812083 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9307c3-b271-4251-b971-2bce6c7d9060 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:45.812953 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9307c3-b271-4251-b971-2bce6c7d9060 service cinder] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:45.813118 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9307c3-b271-4251-b971-2bce6c7d9060 service cinder] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:45.813512 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9307c3-b271-4251-b971-2bce6c7d9060 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:45.817275 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eba0fe-fce1-4351-a8a9-a2afa88071f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:45.818280 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eba0fe-fce1-4351-a8a9-a2afa88071f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:45.818740 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eba0fe-fce1-4351-a8a9-a2afa88071f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:45.819200 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eba0fe-fce1-4351-a8a9-a2afa88071f5 admin admin] PATH_INFO: `/v3/projects/f2995a2ca26147fd93d7012c799f3e62` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:45.819357 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-0a9307c3-b271-4251-b971-2bce6c7d9060 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:45.820774 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eba0fe-fce1-4351-a8a9-a2afa88071f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2995a2ca26147fd93d7012c799f3e62)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:45.823468 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eba0fe-fce1-4351-a8a9-a2afa88071f5 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:45.841395 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:45.944640 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-11eba0fe-fce1-4351-a8a9-a2afa88071f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2995a2ca26147fd93d7012c799f3e62', 'request_id': 'req-11eba0fe-fce1-4351-a8a9-a2afa88071f5'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:45.952669 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-11eba0fe-fce1-4351-a8a9-a2afa88071f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2995a2ca26147fd93d7012c799f3e62', 'request_id': 'req-11eba0fe-fce1-4351-a8a9-a2afa88071f5'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:45.954123 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9307c3-b271-4251-b971-2bce6c7d9060 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:45.956236 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9307c3-b271-4251-b971-2bce6c7d9060 service cinder] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:45.963569 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-11eba0fe-fce1-4351-a8a9-a2afa88071f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2995a2ca26147fd93d7012c799f3e62', 'request_id': 'req-11eba0fe-fce1-4351-a8a9-a2afa88071f5'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:45.976776 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1082/2184] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:30:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:30:45.977711 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9307c3-b271-4251-b971-2bce6c7d9060 service cinder] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:45.978145 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-11eba0fe-fce1-4351-a8a9-a2afa88071f5 admin admin] The token cache is being invalidate because project f2995a2ca26147fd93d7012c799f3e62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:30:45.978534 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-11eba0fe-fce1-4351-a8a9-a2afa88071f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:45.993650 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-11eba0fe-fce1-4351-a8a9-a2afa88071f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:46.001605 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9307c3-b271-4251-b971-2bce6c7d9060 service cinder] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:46.002435 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1103/2185] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:30:45 2022] DELETE /identity/v3/projects/f2995a2ca26147fd93d7012c799f3e62 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:46.006328 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eba0fe-fce1-4351-a8a9-a2afa88071f5 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:46.008967 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-11eba0fe-fce1-4351-a8a9-a2afa88071f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:46.037806 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:46.138641 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be43773-8ff7-4791-a4a1-e98daa688609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:46.140577 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be43773-8ff7-4791-a4a1-e98daa688609 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:46.141402 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be43773-8ff7-4791-a4a1-e98daa688609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:46.142213 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be43773-8ff7-4791-a4a1-e98daa688609 admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:46.143907 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be43773-8ff7-4791-a4a1-e98daa688609 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:46.174670 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be43773-8ff7-4791-a4a1-e98daa688609 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:46.185558 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eba0fe-fce1-4351-a8a9-a2afa88071f5 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:46.195473 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1083/2186] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:30:46.197774 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f2187-e602-4d14-bde1-3dca5d5f4ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:46.198411 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f2187-e602-4d14-bde1-3dca5d5f4ab3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:46.198694 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f2187-e602-4d14-bde1-3dca5d5f4ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:46.198969 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f2187-e602-4d14-bde1-3dca5d5f4ab3 admin admin] PATH_INFO: `/v3/users/d82c9132ba7f4cf7b40bd44661bd01d0` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:46.202702 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be43773-8ff7-4791-a4a1-e98daa688609 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:46.206586 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-2be43773-8ff7-4791-a4a1-e98daa688609 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:46.207743 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053f2187-e602-4d14-bde1-3dca5d5f4ab3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d82c9132ba7f4cf7b40bd44661bd01d0)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:46.210283 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053f2187-e602-4d14-bde1-3dca5d5f4ab3 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:46.241853 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be43773-8ff7-4791-a4a1-e98daa688609 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:46.253107 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb5b636-4478-4ae5-a479-dd252c163fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:46.253746 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb5b636-4478-4ae5-a479-dd252c163fb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:46.254035 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb5b636-4478-4ae5-a479-dd252c163fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:46.254317 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb5b636-4478-4ae5-a479-dd252c163fb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:46.254972 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb5b636-4478-4ae5-a479-dd252c163fb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:46.256651 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb5b636-4478-4ae5-a479-dd252c163fb8 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:46.293976 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1084/2187] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:30:46 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:30:46.295022 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb5b636-4478-4ae5-a479-dd252c163fb8 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:46.305855 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb5b636-4478-4ae5-a479-dd252c163fb8 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:46.311887 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba993e9e-d8bb-47fe-ab61-026e4883f42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:46.313001 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba993e9e-d8bb-47fe-ab61-026e4883f42d admin admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:46.313563 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba993e9e-d8bb-47fe-ab61-026e4883f42d admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:46.314275 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba993e9e-d8bb-47fe-ab61-026e4883f42d admin admin] PATH_INFO: `/v3/projects/8b2ef867872f4479a02e829013c45933/users/cb57ebcf5d694dceadbe9983c5b7f070/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:46.324688 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-053f2187-e602-4d14-bde1-3dca5d5f4ab3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd82c9132ba7f4cf7b40bd44661bd01d0'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:46.341263 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-053f2187-e602-4d14-bde1-3dca5d5f4ab3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd82c9132ba7f4cf7b40bd44661bd01d0'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:46.342729 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba993e9e-d8bb-47fe-ab61-026e4883f42d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b2ef867872f4479a02e829013c45933, user_id=cb57ebcf5d694dceadbe9983c5b7f070, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:46.343057 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-053f2187-e602-4d14-bde1-3dca5d5f4ab3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd82c9132ba7f4cf7b40bd44661bd01d0'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:46.346118 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba993e9e-d8bb-47fe-ab61-026e4883f42d admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:46.361915 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-053f2187-e602-4d14-bde1-3dca5d5f4ab3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd82c9132ba7f4cf7b40bd44661bd01d0'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:46.363566 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-053f2187-e602-4d14-bde1-3dca5d5f4ab3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd82c9132ba7f4cf7b40bd44661bd01d0'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:46.370163 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1085/2188] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:30:46 2022] PUT /identity/v3/projects/8b2ef867872f4479a02e829013c45933/users/cb57ebcf5d694dceadbe9983c5b7f070/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:46.380010 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725beabf-d025-4f08-9057-2862f8d720df None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:46.381729 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725beabf-d025-4f08-9057-2862f8d720df None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:46.382020 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725beabf-d025-4f08-9057-2862f8d720df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:46.388588 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1104/2189] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:30:46 2022] DELETE /identity/v3/users/d82c9132ba7f4cf7b40bd44661bd01d0 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:30:46.428876 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-725beabf-d025-4f08-9057-2862f8d720df None None] MFA Rules not processed for user `cb57ebcf5d694dceadbe9983c5b7f070`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:46.430166 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-725beabf-d025-4f08-9057-2862f8d720df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:46.536698 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1086/2190] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:30:46.542382 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f2187-e602-4d14-bde1-3dca5d5f4ab3 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:46.547504 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-053f2187-e602-4d14-bde1-3dca5d5f4ab3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:46.614904 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:46.754631 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f2187-e602-4d14-bde1-3dca5d5f4ab3 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:46.762574 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725beabf-d025-4f08-9057-2862f8d720df None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:46.765417 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-725beabf-d025-4f08-9057-2862f8d720df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:46.781460 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d1d49a-1f50-4749-971e-2bc29bd04ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:46.784063 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1d49a-1f50-4749-971e-2bc29bd04ab6 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:46.785364 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1d49a-1f50-4749-971e-2bc29bd04ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:46.794579 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1d49a-1f50-4749-971e-2bc29bd04ab6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:46.795329 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d1d49a-1f50-4749-971e-2bc29bd04ab6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:46.797795 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d1d49a-1f50-4749-971e-2bc29bd04ab6 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:46.805275 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725beabf-d025-4f08-9057-2862f8d720df None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:46.819322 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b21b65-4180-453d-bb14-81eab23b34e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:46.820209 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b21b65-4180-453d-bb14-81eab23b34e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:46.820531 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b21b65-4180-453d-bb14-81eab23b34e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:46.820787 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b21b65-4180-453d-bb14-81eab23b34e8 admin admin] PATH_INFO: `/v3/projects/38407a0158dd4e7ba66f89db1c76d3ce` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:46.823149 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b21b65-4180-453d-bb14-81eab23b34e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38407a0158dd4e7ba66f89db1c76d3ce)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:46.825892 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b21b65-4180-453d-bb14-81eab23b34e8 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:46.869787 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1105/2191] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:30:46 2022] POST /identity/v3/projects => generated 371 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:30:46.875637 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d1d49a-1f50-4749-971e-2bc29bd04ab6 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:46.944876 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-f1b21b65-4180-453d-bb14-81eab23b34e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38407a0158dd4e7ba66f89db1c76d3ce', 'request_id': 'req-f1b21b65-4180-453d-bb14-81eab23b34e8'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:46.954131 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-f1b21b65-4180-453d-bb14-81eab23b34e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38407a0158dd4e7ba66f89db1c76d3ce', 'request_id': 'req-f1b21b65-4180-453d-bb14-81eab23b34e8'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:46.968190 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-f1b21b65-4180-453d-bb14-81eab23b34e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38407a0158dd4e7ba66f89db1c76d3ce', 'request_id': 'req-f1b21b65-4180-453d-bb14-81eab23b34e8'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:46.971028 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:46.983855 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-f1b21b65-4180-453d-bb14-81eab23b34e8 admin admin] The token cache is being invalidate because project 38407a0158dd4e7ba66f89db1c76d3ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81447) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:30:46.985914 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-f1b21b65-4180-453d-bb14-81eab23b34e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:46.987716 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-f1b21b65-4180-453d-bb14-81eab23b34e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:46.990813 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1087/2192] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:30:46 2022] DELETE /identity/v3/projects/38407a0158dd4e7ba66f89db1c76d3ce => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:46.994922 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b21b65-4180-453d-bb14-81eab23b34e8 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:46.998786 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-f1b21b65-4180-453d-bb14-81eab23b34e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:47.009397 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d1d49a-1f50-4749-971e-2bc29bd04ab6 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:47.107890 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93afa29c-3cb7-4501-9587-a7a6051448d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:47.108162 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b21b65-4180-453d-bb14-81eab23b34e8 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:47.108924 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afa29c-3cb7-4501-9587-a7a6051448d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:47.109357 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afa29c-3cb7-4501-9587-a7a6051448d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:47.109770 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afa29c-3cb7-4501-9587-a7a6051448d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:47.110753 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93afa29c-3cb7-4501-9587-a7a6051448d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:47.123667 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a66b5bd-e184-40ca-8add-5be88e979d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:47.123793 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93afa29c-3cb7-4501-9587-a7a6051448d3 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:47.123886 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66b5bd-e184-40ca-8add-5be88e979d41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:47.123886 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66b5bd-e184-40ca-8add-5be88e979d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:47.123886 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66b5bd-e184-40ca-8add-5be88e979d41 admin admin] PATH_INFO: `/v3/users/72f35ad259f24d76acd22950d25dbddb` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:47.123886 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a66b5bd-e184-40ca-8add-5be88e979d41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72f35ad259f24d76acd22950d25dbddb)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:47.123886 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a66b5bd-e184-40ca-8add-5be88e979d41 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:47.140503 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1106/2193] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:30:46 2022] POST /identity/v3/users => generated 292 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:30:47.144180 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93afa29c-3cb7-4501-9587-a7a6051448d3 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:47.146328 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-93afa29c-3cb7-4501-9587-a7a6051448d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:47.162257 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93afa29c-3cb7-4501-9587-a7a6051448d3 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:47.168830 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c890e7a2-85ea-4e9d-bf21-a28f89a9e4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:47.169432 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890e7a2-85ea-4e9d-bf21-a28f89a9e4b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:47.169743 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890e7a2-85ea-4e9d-bf21-a28f89a9e4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:47.170014 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890e7a2-85ea-4e9d-bf21-a28f89a9e4b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:47.170663 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c890e7a2-85ea-4e9d-bf21-a28f89a9e4b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:47.172380 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c890e7a2-85ea-4e9d-bf21-a28f89a9e4b9 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:47.186765 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1107/2194] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:30:47 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:30:47.186765 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c890e7a2-85ea-4e9d-bf21-a28f89a9e4b9 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:47.186765 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-c890e7a2-85ea-4e9d-bf21-a28f89a9e4b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:47.197279 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-0a66b5bd-e184-40ca-8add-5be88e979d41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72f35ad259f24d76acd22950d25dbddb'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:47.210991 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-0a66b5bd-e184-40ca-8add-5be88e979d41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72f35ad259f24d76acd22950d25dbddb'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:47.212039 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-0a66b5bd-e184-40ca-8add-5be88e979d41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72f35ad259f24d76acd22950d25dbddb'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:47.212914 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-0a66b5bd-e184-40ca-8add-5be88e979d41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72f35ad259f24d76acd22950d25dbddb'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:47.229466 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-0a66b5bd-e184-40ca-8add-5be88e979d41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72f35ad259f24d76acd22950d25dbddb'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:47.233348 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:47.248159 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1088/2195] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:30:46 2022] DELETE /identity/v3/users/72f35ad259f24d76acd22950d25dbddb => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:30:47.249363 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a66b5bd-e184-40ca-8add-5be88e979d41 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:47.252369 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-0a66b5bd-e184-40ca-8add-5be88e979d41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:47.268742 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c890e7a2-85ea-4e9d-bf21-a28f89a9e4b9 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:47.331423 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a66b5bd-e184-40ca-8add-5be88e979d41 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:47.339306 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22286f1e-bb2d-460b-a6f4-6064a9c6fe78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:47.340193 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22286f1e-bb2d-460b-a6f4-6064a9c6fe78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:47.340480 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22286f1e-bb2d-460b-a6f4-6064a9c6fe78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:47.340754 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22286f1e-bb2d-460b-a6f4-6064a9c6fe78 admin admin] PATH_INFO: `/v3/projects/1cc240343c924ed6a016f8cb4b5d2c0f/users/517f96100d494fc78bc033d88c2b620c/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:47.341940 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb644696-7ede-426f-a907-47870ce93eea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:47.342590 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb644696-7ede-426f-a907-47870ce93eea service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:47.342926 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb644696-7ede-426f-a907-47870ce93eea service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:47.343207 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb644696-7ede-426f-a907-47870ce93eea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:47.347802 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-cb644696-7ede-426f-a907-47870ce93eea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:47.362989 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22286f1e-bb2d-460b-a6f4-6064a9c6fe78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cc240343c924ed6a016f8cb4b5d2c0f, user_id=517f96100d494fc78bc033d88c2b620c, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:47.366921 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22286f1e-bb2d-460b-a6f4-6064a9c6fe78 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:47.369899 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:47.393058 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1089/2196] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:30:47 2022] PUT /identity/v3/projects/1cc240343c924ed6a016f8cb4b5d2c0f/users/517f96100d494fc78bc033d88c2b620c/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:47.398272 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22286f1e-bb2d-460b-a6f4-6064a9c6fe78 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:47.452625 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb644696-7ede-426f-a907-47870ce93eea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:47.470415 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb644696-7ede-426f-a907-47870ce93eea service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:47.482243 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1108/2197] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:30:47 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:30:47.543929 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22286f1e-bb2d-460b-a6f4-6064a9c6fe78 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:47.551820 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9053e329-bfea-466e-919f-27be03e93694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:47.553068 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053e329-bfea-466e-919f-27be03e93694 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:47.553414 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053e329-bfea-466e-919f-27be03e93694 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:47.553745 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053e329-bfea-466e-919f-27be03e93694 admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:47.554412 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9053e329-bfea-466e-919f-27be03e93694 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:47.556246 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9053e329-bfea-466e-919f-27be03e93694 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:47.568196 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1090/2198] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:30:47 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:30:47.572359 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb644696-7ede-426f-a907-47870ce93eea service cinder] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:47.583822 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb644696-7ede-426f-a907-47870ce93eea service cinder] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:47.603022 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f507f3b3-04f5-4777-9576-5e2dc5358115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:47.606065 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507f3b3-04f5-4777-9576-5e2dc5358115 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:47.606680 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507f3b3-04f5-4777-9576-5e2dc5358115 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:47.607111 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507f3b3-04f5-4777-9576-5e2dc5358115 admin admin] PATH_INFO: `/v3/projects/1cc240343c924ed6a016f8cb4b5d2c0f/users/517f96100d494fc78bc033d88c2b620c/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:47.610648 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f507f3b3-04f5-4777-9576-5e2dc5358115 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cc240343c924ed6a016f8cb4b5d2c0f, user_id=517f96100d494fc78bc033d88c2b620c, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:47.617498 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f507f3b3-04f5-4777-9576-5e2dc5358115 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:47.635989 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1109/2199] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:30:47 2022] PUT /identity/v3/projects/1cc240343c924ed6a016f8cb4b5d2c0f/users/517f96100d494fc78bc033d88c2b620c/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:47.648314 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc05df-9a90-4dad-9de4-1ed6ff016747 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:47.648590 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc05df-9a90-4dad-9de4-1ed6ff016747 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:47.649384 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc05df-9a90-4dad-9de4-1ed6ff016747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:47.682695 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-67dc05df-9a90-4dad-9de4-1ed6ff016747 None None] MFA Rules not processed for user `517f96100d494fc78bc033d88c2b620c`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:47.682926 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f507f3b3-04f5-4777-9576-5e2dc5358115 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:47.684504 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-67dc05df-9a90-4dad-9de4-1ed6ff016747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:47.685102 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-f507f3b3-04f5-4777-9576-5e2dc5358115 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:47.772535 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f507f3b3-04f5-4777-9576-5e2dc5358115 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:47.777248 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f02d0-9f44-4033-9aac-e25537ef0d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:47.777872 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f02d0-9f44-4033-9aac-e25537ef0d72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:47.778148 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f02d0-9f44-4033-9aac-e25537ef0d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:47.778443 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f02d0-9f44-4033-9aac-e25537ef0d72 admin admin] PATH_INFO: `/v3/projects/44b57cedbcb542bfa3b3008464804e6f` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:47.778841 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1091/2200] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:47 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:47.780173 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617f02d0-9f44-4033-9aac-e25537ef0d72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44b57cedbcb542bfa3b3008464804e6f)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:47.782117 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617f02d0-9f44-4033-9aac-e25537ef0d72 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:47.790492 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc05df-9a90-4dad-9de4-1ed6ff016747 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:47.792494 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-67dc05df-9a90-4dad-9de4-1ed6ff016747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:47.815149 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:47.838792 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-617f02d0-9f44-4033-9aac-e25537ef0d72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44b57cedbcb542bfa3b3008464804e6f', 'request_id': 'req-617f02d0-9f44-4033-9aac-e25537ef0d72'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:47.845350 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-617f02d0-9f44-4033-9aac-e25537ef0d72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44b57cedbcb542bfa3b3008464804e6f', 'request_id': 'req-617f02d0-9f44-4033-9aac-e25537ef0d72'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:47.854801 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc05df-9a90-4dad-9de4-1ed6ff016747 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:47.858306 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-617f02d0-9f44-4033-9aac-e25537ef0d72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44b57cedbcb542bfa3b3008464804e6f', 'request_id': 'req-617f02d0-9f44-4033-9aac-e25537ef0d72'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:47.872517 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-617f02d0-9f44-4033-9aac-e25537ef0d72 admin admin] The token cache is being invalidate because project 44b57cedbcb542bfa3b3008464804e6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:30:47.872858 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-617f02d0-9f44-4033-9aac-e25537ef0d72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:47.873595 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-617f02d0-9f44-4033-9aac-e25537ef0d72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:47.875167 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1110/2201] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:30:47 2022] DELETE /identity/v3/projects/44b57cedbcb542bfa3b3008464804e6f => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:30:47.879902 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd8750-f6f9-4e2e-a703-8781bb825759 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:47.880781 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd8750-f6f9-4e2e-a703-8781bb825759 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:47.881059 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd8750-f6f9-4e2e-a703-8781bb825759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:47.891791 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:47.904821 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-fbfd8750-f6f9-4e2e-a703-8781bb825759 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:47.906051 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-fbfd8750-f6f9-4e2e-a703-8781bb825759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:47.917275 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01de6444-bf1f-443c-a989-c0d902972bf6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:47.917924 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de6444-bf1f-443c-a989-c0d902972bf6 service cinder] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:47.918209 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de6444-bf1f-443c-a989-c0d902972bf6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:47.918483 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de6444-bf1f-443c-a989-c0d902972bf6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:47.921144 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-01de6444-bf1f-443c-a989-c0d902972bf6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:48.007547 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1111/2202] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:30:48.009298 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23204339-2a38-482e-b70b-fa71da7e55f3 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:48.010229 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23204339-2a38-482e-b70b-fa71da7e55f3 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:48.010229 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23204339-2a38-482e-b70b-fa71da7e55f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:48.018595 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01de6444-bf1f-443c-a989-c0d902972bf6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:48.020444 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01de6444-bf1f-443c-a989-c0d902972bf6 service cinder] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:48.039339 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1092/2203] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:30:47 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:30:48.040120 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-23204339-2a38-482e-b70b-fa71da7e55f3 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:48.044361 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-23204339-2a38-482e-b70b-fa71da7e55f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:48.061222 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1112/2204] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:48.065657 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01de6444-bf1f-443c-a989-c0d902972bf6 service cinder] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:48.092343 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01de6444-bf1f-443c-a989-c0d902972bf6 service cinder] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:48.098021 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2452475-f750-4eef-a4df-ba639edb2d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:48.098688 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2452475-f750-4eef-a4df-ba639edb2d2b admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:48.099786 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2452475-f750-4eef-a4df-ba639edb2d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:48.100116 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2452475-f750-4eef-a4df-ba639edb2d2b admin admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:48.100752 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2452475-f750-4eef-a4df-ba639edb2d2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:30:48.101054 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2452475-f750-4eef-a4df-ba639edb2d2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:48.103173 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2452475-f750-4eef-a4df-ba639edb2d2b admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:48.122286 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1093/2205] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 30 01:30:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:30:48.126154 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23204339-2a38-482e-b70b-fa71da7e55f3 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:48.143544 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23204339-2a38-482e-b70b-fa71da7e55f3 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:48.160203 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391c7a27-af40-4af9-9864-b6e25dc4be94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:48.162361 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c7a27-af40-4af9-9864-b6e25dc4be94 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:48.162573 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2452475-f750-4eef-a4df-ba639edb2d2b admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:48.163077 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c7a27-af40-4af9-9864-b6e25dc4be94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:48.163676 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c7a27-af40-4af9-9864-b6e25dc4be94 admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:48.164710 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391c7a27-af40-4af9-9864-b6e25dc4be94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:48.164828 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-d2452475-f750-4eef-a4df-ba639edb2d2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:48.166992 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391c7a27-af40-4af9-9864-b6e25dc4be94 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:48.178082 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2452475-f750-4eef-a4df-ba639edb2d2b admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:48.183782 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d691c5-ef40-4b6a-91b4-c35e760a6300 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:48.184481 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d691c5-ef40-4b6a-91b4-c35e760a6300 service cinder] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:48.184824 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d691c5-ef40-4b6a-91b4-c35e760a6300 service cinder] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:48.185152 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d691c5-ef40-4b6a-91b4-c35e760a6300 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:48.187245 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-63d691c5-ef40-4b6a-91b4-c35e760a6300 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:48.201761 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1113/2206] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:30:48 2022] POST /identity/v3/projects => generated 369 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:30:48.205848 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391c7a27-af40-4af9-9864-b6e25dc4be94 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:48.262617 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d691c5-ef40-4b6a-91b4-c35e760a6300 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:48.264148 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d691c5-ef40-4b6a-91b4-c35e760a6300 service cinder] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:48.278451 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1094/2207] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:30:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:30:48.282335 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391c7a27-af40-4af9-9864-b6e25dc4be94 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:48.291782 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227a9a6b-ae3b-4d84-902a-184be6536209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:48.293364 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a9a6b-ae3b-4d84-902a-184be6536209 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:48.293364 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a9a6b-ae3b-4d84-902a-184be6536209 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:48.293364 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a9a6b-ae3b-4d84-902a-184be6536209 admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:48.293967 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227a9a6b-ae3b-4d84-902a-184be6536209 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:48.299272 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227a9a6b-ae3b-4d84-902a-184be6536209 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:48.323834 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1114/2208] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:30:48 2022] POST /identity/v3/users => generated 285 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:30:48.324863 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d691c5-ef40-4b6a-91b4-c35e760a6300 service cinder] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:48.338875 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d691c5-ef40-4b6a-91b4-c35e760a6300 service cinder] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:48.346032 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cdd1b2-0ea5-4dd0-83e5-2b27cc31f336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:48.347471 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cdd1b2-0ea5-4dd0-83e5-2b27cc31f336 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:48.347471 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cdd1b2-0ea5-4dd0-83e5-2b27cc31f336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:48.347471 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cdd1b2-0ea5-4dd0-83e5-2b27cc31f336 admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:48.347982 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cdd1b2-0ea5-4dd0-83e5-2b27cc31f336 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:48.350205 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cdd1b2-0ea5-4dd0-83e5-2b27cc31f336 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:48.362474 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1095/2209] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:30:48.367221 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227a9a6b-ae3b-4d84-902a-184be6536209 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:48.377910 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227a9a6b-ae3b-4d84-902a-184be6536209 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:48.383897 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4366330-98ba-47dd-93e6-21e191e7e650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:48.384613 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4366330-98ba-47dd-93e6-21e191e7e650 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:48.384904 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4366330-98ba-47dd-93e6-21e191e7e650 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:48.385282 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4366330-98ba-47dd-93e6-21e191e7e650 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:48.386022 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4366330-98ba-47dd-93e6-21e191e7e650 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:48.387847 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4366330-98ba-47dd-93e6-21e191e7e650 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:48.404801 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1115/2210] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:30:48.408826 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cdd1b2-0ea5-4dd0-83e5-2b27cc31f336 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:48.429244 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cdd1b2-0ea5-4dd0-83e5-2b27cc31f336 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:48.436881 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0074e1ae-9d48-4270-bfb2-9a61876c56ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:48.437553 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074e1ae-9d48-4270-bfb2-9a61876c56ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:48.438460 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074e1ae-9d48-4270-bfb2-9a61876c56ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:48.438746 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074e1ae-9d48-4270-bfb2-9a61876c56ff admin admin] PATH_INFO: `/v3/projects/43b15cc3cdde4ebaa5fdf4de94428c85/users/8175e3515b944c2ca9529df67793673e/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:48.456044 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0074e1ae-9d48-4270-bfb2-9a61876c56ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=43b15cc3cdde4ebaa5fdf4de94428c85, user_id=8175e3515b944c2ca9529df67793673e, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:48.459290 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0074e1ae-9d48-4270-bfb2-9a61876c56ff admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:48.473653 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1096/2211] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:30:48 2022] PUT /identity/v3/projects/43b15cc3cdde4ebaa5fdf4de94428c85/users/8175e3515b944c2ca9529df67793673e/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:48.484704 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a1c24-1815-4b61-8b4e-a5c5964a4770 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:48.484995 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a1c24-1815-4b61-8b4e-a5c5964a4770 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:48.485262 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a1c24-1815-4b61-8b4e-a5c5964a4770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:48.493914 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:48.524971 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-565a1c24-1815-4b61-8b4e-a5c5964a4770 None None] MFA Rules not processed for user `8175e3515b944c2ca9529df67793673e`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:48.526252 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-565a1c24-1815-4b61-8b4e-a5c5964a4770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:48.600296 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1116/2212] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:48.613078 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0074e1ae-9d48-4270-bfb2-9a61876c56ff admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:48.614936 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-0074e1ae-9d48-4270-bfb2-9a61876c56ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:48.674194 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:48.735605 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0074e1ae-9d48-4270-bfb2-9a61876c56ff admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:48.740372 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b80747-1876-45e8-beba-c717759e0405 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2de6decc90df4df58217d5eed9c5e190', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:48.741199 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b80747-1876-45e8-beba-c717759e0405 service glance] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:48.741547 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b80747-1876-45e8-beba-c717759e0405 service glance] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:48.742360 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b80747-1876-45e8-beba-c717759e0405 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:48.751284 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b80747-1876-45e8-beba-c717759e0405 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:48.752927 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b80747-1876-45e8-beba-c717759e0405 service glance] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:48.767928 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1097/2213] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:30:48 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:30:51.623312 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565a1c24-1815-4b61-8b4e-a5c5964a4770 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:51.625090 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-565a1c24-1815-4b61-8b4e-a5c5964a4770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:51.699844 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565a1c24-1815-4b61-8b4e-a5c5964a4770 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:51.704862 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c42fd54-491e-40aa-b269-f1b67f7c4713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:51.705294 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c42fd54-491e-40aa-b269-f1b67f7c4713 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:51.705657 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c42fd54-491e-40aa-b269-f1b67f7c4713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:51.706051 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c42fd54-491e-40aa-b269-f1b67f7c4713 admin admin] PATH_INFO: `/v3/users/09b7e3c7518143d7a23b8bfb76155fe6` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:51.707418 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c42fd54-491e-40aa-b269-f1b67f7c4713 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09b7e3c7518143d7a23b8bfb76155fe6)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:51.709981 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c42fd54-491e-40aa-b269-f1b67f7c4713 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:51.771579 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-2c42fd54-491e-40aa-b269-f1b67f7c4713 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09b7e3c7518143d7a23b8bfb76155fe6'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:51.781600 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-2c42fd54-491e-40aa-b269-f1b67f7c4713 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09b7e3c7518143d7a23b8bfb76155fe6'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:51.782338 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-2c42fd54-491e-40aa-b269-f1b67f7c4713 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09b7e3c7518143d7a23b8bfb76155fe6'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:51.796196 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-2c42fd54-491e-40aa-b269-f1b67f7c4713 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09b7e3c7518143d7a23b8bfb76155fe6'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:51.796917 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-2c42fd54-491e-40aa-b269-f1b67f7c4713 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09b7e3c7518143d7a23b8bfb76155fe6'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:51.809137 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1117/2214] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:30:51 2022] DELETE /identity/v3/users/09b7e3c7518143d7a23b8bfb76155fe6 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:51.813571 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a587e0-d0ea-4915-94c4-5d97025533f5 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:51.814077 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a587e0-d0ea-4915-94c4-5d97025533f5 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:51.814182 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a587e0-d0ea-4915-94c4-5d97025533f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:51.834212 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-b2a587e0-d0ea-4915-94c4-5d97025533f5 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:51.835317 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-b2a587e0-d0ea-4915-94c4-5d97025533f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:51.896485 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1098/2215] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:51.907312 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c42fd54-491e-40aa-b269-f1b67f7c4713 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:51.908778 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-2c42fd54-491e-40aa-b269-f1b67f7c4713 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:51.923135 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:51.967767 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c42fd54-491e-40aa-b269-f1b67f7c4713 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:51.971316 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610037f9-e63b-46cc-86b9-b47211d0c4be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:51.971944 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610037f9-e63b-46cc-86b9-b47211d0c4be service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:51.972225 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610037f9-e63b-46cc-86b9-b47211d0c4be service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:51.972490 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610037f9-e63b-46cc-86b9-b47211d0c4be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:51.981572 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610037f9-e63b-46cc-86b9-b47211d0c4be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:51.983035 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610037f9-e63b-46cc-86b9-b47211d0c4be service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:51.992972 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1118/2216] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:30:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:30:52.266735 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a587e0-d0ea-4915-94c4-5d97025533f5 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:52.268500 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-b2a587e0-d0ea-4915-94c4-5d97025533f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:52.283854 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a587e0-d0ea-4915-94c4-5d97025533f5 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:52.289127 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd461938-2829-4911-9ebf-ad243113d549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:52.289988 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd461938-2829-4911-9ebf-ad243113d549 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:52.290343 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd461938-2829-4911-9ebf-ad243113d549 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:52.290618 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd461938-2829-4911-9ebf-ad243113d549 admin admin] PATH_INFO: `/v3/projects/94a165de25ad47ea9cff3468751f285a` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:52.291917 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd461938-2829-4911-9ebf-ad243113d549 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94a165de25ad47ea9cff3468751f285a)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:52.294017 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd461938-2829-4911-9ebf-ad243113d549 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:52.348159 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-cd461938-2829-4911-9ebf-ad243113d549 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94a165de25ad47ea9cff3468751f285a', 'request_id': 'req-cd461938-2829-4911-9ebf-ad243113d549'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:52.356060 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-cd461938-2829-4911-9ebf-ad243113d549 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94a165de25ad47ea9cff3468751f285a', 'request_id': 'req-cd461938-2829-4911-9ebf-ad243113d549'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:52.367459 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-cd461938-2829-4911-9ebf-ad243113d549 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94a165de25ad47ea9cff3468751f285a', 'request_id': 'req-cd461938-2829-4911-9ebf-ad243113d549'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:52.383707 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-cd461938-2829-4911-9ebf-ad243113d549 admin admin] The token cache is being invalidate because project 94a165de25ad47ea9cff3468751f285a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81447) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:30:52.384145 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-cd461938-2829-4911-9ebf-ad243113d549 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:52.385896 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-cd461938-2829-4911-9ebf-ad243113d549 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:52.387546 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1099/2217] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:30:52 2022] DELETE /identity/v3/projects/94a165de25ad47ea9cff3468751f285a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:52.392443 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610037f9-e63b-46cc-86b9-b47211d0c4be service neutron] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:52.402881 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610037f9-e63b-46cc-86b9-b47211d0c4be service neutron] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:52.467273 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dda2942-2261-48fa-9375-506038aa3f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:52.468488 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda2942-2261-48fa-9375-506038aa3f63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:52.468864 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda2942-2261-48fa-9375-506038aa3f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:52.469226 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda2942-2261-48fa-9375-506038aa3f63 admin admin] PATH_INFO: `/v3/users/843f98cf26da41c2aabd4a1ebb859765` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:52.470478 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dda2942-2261-48fa-9375-506038aa3f63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=843f98cf26da41c2aabd4a1ebb859765)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:52.473169 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dda2942-2261-48fa-9375-506038aa3f63 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:52.532604 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-3dda2942-2261-48fa-9375-506038aa3f63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '843f98cf26da41c2aabd4a1ebb859765'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:52.548346 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-3dda2942-2261-48fa-9375-506038aa3f63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '843f98cf26da41c2aabd4a1ebb859765'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:52.549775 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-3dda2942-2261-48fa-9375-506038aa3f63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '843f98cf26da41c2aabd4a1ebb859765'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:52.568001 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-3dda2942-2261-48fa-9375-506038aa3f63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '843f98cf26da41c2aabd4a1ebb859765'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:52.568845 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-3dda2942-2261-48fa-9375-506038aa3f63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '843f98cf26da41c2aabd4a1ebb859765'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:52.584556 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1119/2218] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:30:52 2022] DELETE /identity/v3/users/843f98cf26da41c2aabd4a1ebb859765 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:53.071585 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd461938-2829-4911-9ebf-ad243113d549 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:53.073008 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-cd461938-2829-4911-9ebf-ad243113d549 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:53.085754 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd461938-2829-4911-9ebf-ad243113d549 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:53.144465 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:53.174772 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f3018b-0bc2-4912-a284-ee72bd6fa554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:53.175521 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3018b-0bc2-4912-a284-ee72bd6fa554 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:53.175900 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3018b-0bc2-4912-a284-ee72bd6fa554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:53.176314 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3018b-0bc2-4912-a284-ee72bd6fa554 admin admin] PATH_INFO: `/v3/projects/29f5cb224433441196c46e036c163b5f` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:53.178240 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f3018b-0bc2-4912-a284-ee72bd6fa554 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29f5cb224433441196c46e036c163b5f)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:53.180269 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f3018b-0bc2-4912-a284-ee72bd6fa554 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:53.231594 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-32f3018b-0bc2-4912-a284-ee72bd6fa554 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29f5cb224433441196c46e036c163b5f', 'request_id': 'req-32f3018b-0bc2-4912-a284-ee72bd6fa554'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:53.240413 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-32f3018b-0bc2-4912-a284-ee72bd6fa554 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29f5cb224433441196c46e036c163b5f', 'request_id': 'req-32f3018b-0bc2-4912-a284-ee72bd6fa554'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:53.248891 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-32f3018b-0bc2-4912-a284-ee72bd6fa554 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29f5cb224433441196c46e036c163b5f', 'request_id': 'req-32f3018b-0bc2-4912-a284-ee72bd6fa554'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:53.275002 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-32f3018b-0bc2-4912-a284-ee72bd6fa554 admin admin] The token cache is being invalidate because project 29f5cb224433441196c46e036c163b5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81447) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:30:53.275002 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-32f3018b-0bc2-4912-a284-ee72bd6fa554 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:53.275002 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-32f3018b-0bc2-4912-a284-ee72bd6fa554 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:53.275002 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1100/2219] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:30:53 2022] DELETE /identity/v3/projects/29f5cb224433441196c46e036c163b5f => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:53.275323 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dda2942-2261-48fa-9375-506038aa3f63 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:53.275323 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-3dda2942-2261-48fa-9375-506038aa3f63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:53.287212 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dda2942-2261-48fa-9375-506038aa3f63 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:53.327573 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:53.359954 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc291c1-51f5-41d2-89d2-95fb2275acc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:53.360626 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc291c1-51f5-41d2-89d2-95fb2275acc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:53.360911 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc291c1-51f5-41d2-89d2-95fb2275acc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:53.361184 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc291c1-51f5-41d2-89d2-95fb2275acc2 admin admin] PATH_INFO: `/v3/users/74caa02068c94e00b3fec9766531d55a` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:53.362367 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc291c1-51f5-41d2-89d2-95fb2275acc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74caa02068c94e00b3fec9766531d55a)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:53.364992 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc291c1-51f5-41d2-89d2-95fb2275acc2 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:53.411965 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-2fc291c1-51f5-41d2-89d2-95fb2275acc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74caa02068c94e00b3fec9766531d55a'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:53.419976 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-2fc291c1-51f5-41d2-89d2-95fb2275acc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74caa02068c94e00b3fec9766531d55a'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:53.420593 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-2fc291c1-51f5-41d2-89d2-95fb2275acc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74caa02068c94e00b3fec9766531d55a'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:53.433054 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-2fc291c1-51f5-41d2-89d2-95fb2275acc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74caa02068c94e00b3fec9766531d55a'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:53.433686 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-2fc291c1-51f5-41d2-89d2-95fb2275acc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74caa02068c94e00b3fec9766531d55a'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:53.445823 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1120/2220] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:30:53 2022] DELETE /identity/v3/users/74caa02068c94e00b3fec9766531d55a => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:53.736885 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f3018b-0bc2-4912-a284-ee72bd6fa554 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:53.738380 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-32f3018b-0bc2-4912-a284-ee72bd6fa554 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:53.754385 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f3018b-0bc2-4912-a284-ee72bd6fa554 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:53.823653 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e150888-6881-4b22-96c8-02e81131f02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:53.824973 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e150888-6881-4b22-96c8-02e81131f02a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:53.825259 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e150888-6881-4b22-96c8-02e81131f02a admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:53.825534 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e150888-6881-4b22-96c8-02e81131f02a admin admin] PATH_INFO: `/v3/projects/4dd337cdff144c52bbae544ea9101c3a` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:53.827517 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e150888-6881-4b22-96c8-02e81131f02a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dd337cdff144c52bbae544ea9101c3a)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:53.830410 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e150888-6881-4b22-96c8-02e81131f02a admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:53.921291 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-8e150888-6881-4b22-96c8-02e81131f02a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dd337cdff144c52bbae544ea9101c3a', 'request_id': 'req-8e150888-6881-4b22-96c8-02e81131f02a'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:53.929351 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-8e150888-6881-4b22-96c8-02e81131f02a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dd337cdff144c52bbae544ea9101c3a', 'request_id': 'req-8e150888-6881-4b22-96c8-02e81131f02a'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:53.949423 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-8e150888-6881-4b22-96c8-02e81131f02a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dd337cdff144c52bbae544ea9101c3a', 'request_id': 'req-8e150888-6881-4b22-96c8-02e81131f02a'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:53.956863 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:53.972047 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-8e150888-6881-4b22-96c8-02e81131f02a admin admin] The token cache is being invalidate because project 4dd337cdff144c52bbae544ea9101c3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81447) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:30:53.972799 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-8e150888-6881-4b22-96c8-02e81131f02a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:53.975890 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-8e150888-6881-4b22-96c8-02e81131f02a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:30:53.978527 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1101/2221] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:30:53 2022] DELETE /identity/v3/projects/4dd337cdff144c52bbae544ea9101c3a => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:53.983314 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba511d-835f-4ee3-b191-99c203cd5d3e None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:53.983920 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba511d-835f-4ee3-b191-99c203cd5d3e None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:53.984356 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba511d-835f-4ee3-b191-99c203cd5d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:54.011002 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-e9ba511d-835f-4ee3-b191-99c203cd5d3e None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:54.012342 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-e9ba511d-835f-4ee3-b191-99c203cd5d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:54.100699 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1121/2222] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:54.109140 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0830a99-d4f2-4cd5-ab07-b68905cae6e6 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:54.109702 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0830a99-d4f2-4cd5-ab07-b68905cae6e6 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:54.109702 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0830a99-d4f2-4cd5-ab07-b68905cae6e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:54.131638 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-f0830a99-d4f2-4cd5-ab07-b68905cae6e6 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:54.132860 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-f0830a99-d4f2-4cd5-ab07-b68905cae6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:54.141482 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1102/2223] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:54.147210 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba511d-835f-4ee3-b191-99c203cd5d3e None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:54.161088 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba511d-835f-4ee3-b191-99c203cd5d3e None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:54.167065 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d04546-e1ab-42b9-8284-ece17503325e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:54.167367 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d04546-e1ab-42b9-8284-ece17503325e admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:54.169352 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d04546-e1ab-42b9-8284-ece17503325e admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:54.169352 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d04546-e1ab-42b9-8284-ece17503325e admin admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:54.169352 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d04546-e1ab-42b9-8284-ece17503325e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:30:54.169352 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d04546-e1ab-42b9-8284-ece17503325e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:54.171159 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d04546-e1ab-42b9-8284-ece17503325e admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:54.190335 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1122/2224] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 30 01:30:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:30:54.197068 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0830a99-d4f2-4cd5-ab07-b68905cae6e6 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:54.213443 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0830a99-d4f2-4cd5-ab07-b68905cae6e6 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:54.220495 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b642f58-58b3-4aa4-bee0-45b88bb37118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:54.221226 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b642f58-58b3-4aa4-bee0-45b88bb37118 admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:54.221697 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b642f58-58b3-4aa4-bee0-45b88bb37118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:54.222147 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b642f58-58b3-4aa4-bee0-45b88bb37118 admin admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:54.222976 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b642f58-58b3-4aa4-bee0-45b88bb37118 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:54.225475 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b642f58-58b3-4aa4-bee0-45b88bb37118 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:54.300329 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1103/2225] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:30:54 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:30:54.305113 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d04546-e1ab-42b9-8284-ece17503325e admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:54.318280 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d04546-e1ab-42b9-8284-ece17503325e admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:54.366778 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:54.394973 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c6c47-fb07-461c-9214-82cb3525b756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:54.396030 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c6c47-fb07-461c-9214-82cb3525b756 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:54.396503 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c6c47-fb07-461c-9214-82cb3525b756 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:54.396918 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c6c47-fb07-461c-9214-82cb3525b756 admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:54.398171 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c6c47-fb07-461c-9214-82cb3525b756 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:54.400556 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c6c47-fb07-461c-9214-82cb3525b756 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:54.436439 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1123/2226] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:30:54 2022] POST /identity/v3/users => generated 292 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:30:54.440890 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b642f58-58b3-4aa4-bee0-45b88bb37118 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:54.454799 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b642f58-58b3-4aa4-bee0-45b88bb37118 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:54.465801 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3863ec3c-3a5a-4b5c-803f-ab708f3e6055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:54.466420 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3863ec3c-3a5a-4b5c-803f-ab708f3e6055 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:54.466724 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3863ec3c-3a5a-4b5c-803f-ab708f3e6055 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:54.466998 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3863ec3c-3a5a-4b5c-803f-ab708f3e6055 admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:54.467687 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3863ec3c-3a5a-4b5c-803f-ab708f3e6055 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:54.469447 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3863ec3c-3a5a-4b5c-803f-ab708f3e6055 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:54.491580 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1104/2227] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:30:54.495904 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c6c47-fb07-461c-9214-82cb3525b756 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:54.508864 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c6c47-fb07-461c-9214-82cb3525b756 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:54.516272 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e610316-d1d7-4f80-92ad-ecbe1bc5cf77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:54.517155 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e610316-d1d7-4f80-92ad-ecbe1bc5cf77 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:54.517450 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e610316-d1d7-4f80-92ad-ecbe1bc5cf77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:54.517723 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e610316-d1d7-4f80-92ad-ecbe1bc5cf77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:54.518373 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e610316-d1d7-4f80-92ad-ecbe1bc5cf77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:54.520063 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e610316-d1d7-4f80-92ad-ecbe1bc5cf77 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:54.531882 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1124/2228] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:30:54.536101 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3863ec3c-3a5a-4b5c-803f-ab708f3e6055 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:54.551322 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3863ec3c-3a5a-4b5c-803f-ab708f3e6055 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:54.560176 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5537e41a-f4df-4e52-b498-ec9805df7e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:54.560950 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5537e41a-f4df-4e52-b498-ec9805df7e4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:54.561330 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5537e41a-f4df-4e52-b498-ec9805df7e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:54.561672 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5537e41a-f4df-4e52-b498-ec9805df7e4b admin admin] PATH_INFO: `/v3/projects/278c562567dd4c51baecdb711c991814/users/673c89eefa69477a834f8f384cbdd8d8/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:54.586255 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5537e41a-f4df-4e52-b498-ec9805df7e4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=278c562567dd4c51baecdb711c991814, user_id=673c89eefa69477a834f8f384cbdd8d8, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:54.594176 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5537e41a-f4df-4e52-b498-ec9805df7e4b admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:54.630031 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1105/2229] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:30:54 2022] PUT /identity/v3/projects/278c562567dd4c51baecdb711c991814/users/673c89eefa69477a834f8f384cbdd8d8/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:30:54.643373 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a8396-ef68-49c1-8602-fc0215b688f3 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:54.643671 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a8396-ef68-49c1-8602-fc0215b688f3 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:54.644045 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a8396-ef68-49c1-8602-fc0215b688f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:54.681353 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-3b4a8396-ef68-49c1-8602-fc0215b688f3 None None] MFA Rules not processed for user `673c89eefa69477a834f8f384cbdd8d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:54.682601 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-3b4a8396-ef68-49c1-8602-fc0215b688f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:54.751610 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1125/2230] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:54.755275 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5537e41a-f4df-4e52-b498-ec9805df7e4b admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:54.833623 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5537e41a-f4df-4e52-b498-ec9805df7e4b admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:54.839847 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83963ce2-e3d1-4cb7-911c-6300e4e4b8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:54.840455 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83963ce2-e3d1-4cb7-911c-6300e4e4b8ac admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:54.840730 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83963ce2-e3d1-4cb7-911c-6300e4e4b8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:54.840997 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83963ce2-e3d1-4cb7-911c-6300e4e4b8ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:54.841734 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83963ce2-e3d1-4cb7-911c-6300e4e4b8ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:54.843776 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83963ce2-e3d1-4cb7-911c-6300e4e4b8ac admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:54.875489 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1106/2231] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:30:54 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:30:54.878846 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a8396-ef68-49c1-8602-fc0215b688f3 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:54.893972 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a8396-ef68-49c1-8602-fc0215b688f3 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:54.974816 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5650c279-61e3-4634-844c-71afe11d18f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:54.975507 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650c279-61e3-4634-844c-71afe11d18f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:54.975791 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650c279-61e3-4634-844c-71afe11d18f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:54.976055 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650c279-61e3-4634-844c-71afe11d18f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:54.976695 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5650c279-61e3-4634-844c-71afe11d18f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:54.978628 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5650c279-61e3-4634-844c-71afe11d18f7 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:55.004575 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d91d6a-4302-4da3-91c4-e11f845bd810 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:55.005124 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d91d6a-4302-4da3-91c4-e11f845bd810 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:55.005509 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d91d6a-4302-4da3-91c4-e11f845bd810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:55.011530 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1126/2232] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:30:54 2022] POST /identity/v3/users => generated 293 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:30:55.012947 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5650c279-61e3-4634-844c-71afe11d18f7 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:55.024771 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5650c279-61e3-4634-844c-71afe11d18f7 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:55.025623 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-c0d91d6a-4302-4da3-91c4-e11f845bd810 None None] MFA Rules not processed for user `9c090ad3fe494672b5fece2ed600057e`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:55.026855 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-c0d91d6a-4302-4da3-91c4-e11f845bd810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:55.029806 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430386a3-aa5c-47b3-8249-f09346202a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:55.030115 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430386a3-aa5c-47b3-8249-f09346202a12 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:55.030393 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430386a3-aa5c-47b3-8249-f09346202a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:55.030794 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430386a3-aa5c-47b3-8249-f09346202a12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:55.031427 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430386a3-aa5c-47b3-8249-f09346202a12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:55.033473 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430386a3-aa5c-47b3-8249-f09346202a12 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:55.045358 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1127/2233] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:30:55.049324 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430386a3-aa5c-47b3-8249-f09346202a12 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:55.059219 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430386a3-aa5c-47b3-8249-f09346202a12 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:55.063880 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e3727-465b-49f1-99a1-9bfe5ab5db91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:55.064468 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e3727-465b-49f1-99a1-9bfe5ab5db91 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:55.064748 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e3727-465b-49f1-99a1-9bfe5ab5db91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:55.065026 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e3727-465b-49f1-99a1-9bfe5ab5db91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:55.065662 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480e3727-465b-49f1-99a1-9bfe5ab5db91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:55.067275 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480e3727-465b-49f1-99a1-9bfe5ab5db91 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:55.077786 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1128/2234] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:30:55.081977 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e3727-465b-49f1-99a1-9bfe5ab5db91 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:55.089048 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1107/2235] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:30:55.092745 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e3727-465b-49f1-99a1-9bfe5ab5db91 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:55.097477 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70c0245-d873-41c7-b458-334c6caf4e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:55.098127 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c0245-d873-41c7-b458-334c6caf4e8c admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:55.098394 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c0245-d873-41c7-b458-334c6caf4e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:55.099291 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c0245-d873-41c7-b458-334c6caf4e8c admin admin] PATH_INFO: `/v3/projects/409fb56c639d41b2ab347ed39468f2f5/users/71d8e8f09d864614ab268d9a88699a75/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:55.117390 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70c0245-d873-41c7-b458-334c6caf4e8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=409fb56c639d41b2ab347ed39468f2f5, user_id=71d8e8f09d864614ab268d9a88699a75, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:55.120409 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70c0245-d873-41c7-b458-334c6caf4e8c admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:55.122795 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:55.135489 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1129/2236] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:30:55 2022] PUT /identity/v3/projects/409fb56c639d41b2ab347ed39468f2f5/users/71d8e8f09d864614ab268d9a88699a75/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:30:55.148351 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24b3ce-317d-4494-ba4d-48043002b872 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:55.148351 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24b3ce-317d-4494-ba4d-48043002b872 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:55.148351 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24b3ce-317d-4494-ba4d-48043002b872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:55.179455 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-9e24b3ce-317d-4494-ba4d-48043002b872 None None] MFA Rules not processed for user `71d8e8f09d864614ab268d9a88699a75`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:55.180664 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-9e24b3ce-317d-4494-ba4d-48043002b872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:55.192718 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:55.252415 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1108/2237] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:55.258419 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70c0245-d873-41c7-b458-334c6caf4e8c admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:55.340088 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70c0245-d873-41c7-b458-334c6caf4e8c admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:55.344961 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66406d8a-8c8e-4417-b81f-7fb310472e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:55.345575 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66406d8a-8c8e-4417-b81f-7fb310472e28 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:55.345860 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66406d8a-8c8e-4417-b81f-7fb310472e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:55.346133 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66406d8a-8c8e-4417-b81f-7fb310472e28 admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:55.346785 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66406d8a-8c8e-4417-b81f-7fb310472e28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:55.348791 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66406d8a-8c8e-4417-b81f-7fb310472e28 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:55.379567 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1130/2238] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:30:55 2022] POST /identity/v3/projects => generated 383 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:30:55.384219 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24b3ce-317d-4494-ba4d-48043002b872 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:55.395533 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24b3ce-317d-4494-ba4d-48043002b872 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:55.454081 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ad3b5-96a4-4c2d-9afa-e4147d8f6f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:55.454977 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ad3b5-96a4-4c2d-9afa-e4147d8f6f3e admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:55.455330 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ad3b5-96a4-4c2d-9afa-e4147d8f6f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:55.455709 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ad3b5-96a4-4c2d-9afa-e4147d8f6f3e admin admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:55.456409 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2ad3b5-96a4-4c2d-9afa-e4147d8f6f3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:55.458886 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2ad3b5-96a4-4c2d-9afa-e4147d8f6f3e admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:55.483210 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1109/2239] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:30:55 2022] POST /identity/v3/users => generated 298 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:30:55.487135 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66406d8a-8c8e-4417-b81f-7fb310472e28 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:55.497613 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66406d8a-8c8e-4417-b81f-7fb310472e28 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:55.502290 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd0c93-1e96-4c70-89e6-fc8adad1bffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:55.502891 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd0c93-1e96-4c70-89e6-fc8adad1bffb admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:55.503176 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd0c93-1e96-4c70-89e6-fc8adad1bffb admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:55.503485 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd0c93-1e96-4c70-89e6-fc8adad1bffb admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:55.504139 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcd0c93-1e96-4c70-89e6-fc8adad1bffb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:55.506314 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcd0c93-1e96-4c70-89e6-fc8adad1bffb admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:55.522695 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1131/2240] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:30:55.524099 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ad3b5-96a4-4c2d-9afa-e4147d8f6f3e admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:55.534176 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ad3b5-96a4-4c2d-9afa-e4147d8f6f3e admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:55.538913 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4383c92d-525d-4432-8f0c-61f9985c4993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:55.546376 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4383c92d-525d-4432-8f0c-61f9985c4993 admin admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:55.546673 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4383c92d-525d-4432-8f0c-61f9985c4993 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:55.546968 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4383c92d-525d-4432-8f0c-61f9985c4993 admin admin] PATH_INFO: `/v3/projects/9fd1bd550a83432cb298abf017520487/users/b09cdc7d938b4676a784c1a80f3b5cec/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:55.584215 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4383c92d-525d-4432-8f0c-61f9985c4993 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fd1bd550a83432cb298abf017520487, user_id=b09cdc7d938b4676a784c1a80f3b5cec, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:55.586837 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4383c92d-525d-4432-8f0c-61f9985c4993 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:55.609061 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1110/2241] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:30:55 2022] PUT /identity/v3/projects/9fd1bd550a83432cb298abf017520487/users/b09cdc7d938b4676a784c1a80f3b5cec/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:30:55.613021 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd0c93-1e96-4c70-89e6-fc8adad1bffb admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:55.624244 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd0c93-1e96-4c70-89e6-fc8adad1bffb admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:55.713281 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0cde8a-3506-4e90-aa92-2632f2b3fdd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:55.714424 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0cde8a-3506-4e90-aa92-2632f2b3fdd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:55.714924 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0cde8a-3506-4e90-aa92-2632f2b3fdd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:55.715411 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0cde8a-3506-4e90-aa92-2632f2b3fdd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:55.716325 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0cde8a-3506-4e90-aa92-2632f2b3fdd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:55.718572 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0cde8a-3506-4e90-aa92-2632f2b3fdd0 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:55.737086 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1132/2242] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:30:55.738838 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4383c92d-525d-4432-8f0c-61f9985c4993 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:55.757089 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4383c92d-525d-4432-8f0c-61f9985c4993 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:55.765184 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649e7973-f851-4eaf-b349-3453bb69ebaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:55.765995 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e7973-f851-4eaf-b349-3453bb69ebaf admin admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:55.766410 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e7973-f851-4eaf-b349-3453bb69ebaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:55.766839 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e7973-f851-4eaf-b349-3453bb69ebaf admin admin] PATH_INFO: `/v3/projects/9fd1bd550a83432cb298abf017520487/users/b09cdc7d938b4676a784c1a80f3b5cec/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:55.769548 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649e7973-f851-4eaf-b349-3453bb69ebaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fd1bd550a83432cb298abf017520487, user_id=b09cdc7d938b4676a784c1a80f3b5cec, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:55.773652 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649e7973-f851-4eaf-b349-3453bb69ebaf admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:55.790210 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1111/2243] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:30:55 2022] PUT /identity/v3/projects/9fd1bd550a83432cb298abf017520487/users/b09cdc7d938b4676a784c1a80f3b5cec/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:30:55.804131 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c8c01-16b5-4995-be47-e0787ac6920a None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:55.804416 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c8c01-16b5-4995-be47-e0787ac6920a None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:55.804780 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c8c01-16b5-4995-be47-e0787ac6920a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:55.853448 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-121c8c01-16b5-4995-be47-e0787ac6920a None None] MFA Rules not processed for user `b09cdc7d938b4676a784c1a80f3b5cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:30:55.855289 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-121c8c01-16b5-4995-be47-e0787ac6920a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:55.947074 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:55.968215 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1133/2244] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:30:55 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:30:55.980097 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649e7973-f851-4eaf-b349-3453bb69ebaf admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:55.982086 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-649e7973-f851-4eaf-b349-3453bb69ebaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:56.046031 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649e7973-f851-4eaf-b349-3453bb69ebaf admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:56.049691 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2e187c-21eb-4feb-bbb5-815a2cd6b86d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:56.050293 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e187c-21eb-4feb-bbb5-815a2cd6b86d service cinder] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:56.050566 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e187c-21eb-4feb-bbb5-815a2cd6b86d service cinder] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:56.050834 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e187c-21eb-4feb-bbb5-815a2cd6b86d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:56.071411 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:30:56.114729 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2e187c-21eb-4feb-bbb5-815a2cd6b86d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:56.116213 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2e187c-21eb-4feb-bbb5-815a2cd6b86d service cinder] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:56.125664 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1112/2245] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:30:55 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:30:57.676015 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c8c01-16b5-4995-be47-e0787ac6920a None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:57.686203 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c8c01-16b5-4995-be47-e0787ac6920a None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:57.693427 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb963096-304a-40d5-871d-0591cd646149 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:57.694145 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb963096-304a-40d5-871d-0591cd646149 service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:57.694334 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb963096-304a-40d5-871d-0591cd646149 service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:57.694617 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb963096-304a-40d5-871d-0591cd646149 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:57.769389 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb963096-304a-40d5-871d-0591cd646149 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:57.772254 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb963096-304a-40d5-871d-0591cd646149 service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:57.786298 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1134/2246] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:30:57 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:30:58.507391 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2e187c-21eb-4feb-bbb5-815a2cd6b86d service cinder] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:30:58.509755 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-7e2e187c-21eb-4feb-bbb5-815a2cd6b86d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:30:58.521164 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2e187c-21eb-4feb-bbb5-815a2cd6b86d service cinder] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:30:58.525418 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ff28a-64cd-4534-8c7f-1fb127d46170 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:30:58.525743 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ff28a-64cd-4534-8c7f-1fb127d46170 service cinder] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:30:58.526019 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ff28a-64cd-4534-8c7f-1fb127d46170 service cinder] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:30:58.526290 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ff28a-64cd-4534-8c7f-1fb127d46170 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:30:58.542512 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ff28a-64cd-4534-8c7f-1fb127d46170 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:30:58.544246 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ff28a-64cd-4534-8c7f-1fb127d46170 service cinder] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:30:58.555814 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1113/2247] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:30:58 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:31:02.587629 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb963096-304a-40d5-871d-0591cd646149 service cinder] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:02.671402 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb963096-304a-40d5-871d-0591cd646149 service cinder] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:02.676577 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee14a844-f23b-4b10-bb4a-34b6f34306c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:02.677719 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee14a844-f23b-4b10-bb4a-34b6f34306c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:02.677997 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee14a844-f23b-4b10-bb4a-34b6f34306c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:02.678268 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee14a844-f23b-4b10-bb4a-34b6f34306c4 admin admin] PATH_INFO: `/v3/users/673c89eefa69477a834f8f384cbdd8d8` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:02.679663 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee14a844-f23b-4b10-bb4a-34b6f34306c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=673c89eefa69477a834f8f384cbdd8d8)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:02.681616 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee14a844-f23b-4b10-bb4a-34b6f34306c4 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:02.765221 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-ee14a844-f23b-4b10-bb4a-34b6f34306c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '673c89eefa69477a834f8f384cbdd8d8'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:02.774459 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-ee14a844-f23b-4b10-bb4a-34b6f34306c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '673c89eefa69477a834f8f384cbdd8d8'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:02.775192 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-ee14a844-f23b-4b10-bb4a-34b6f34306c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '673c89eefa69477a834f8f384cbdd8d8'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:02.805384 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-ee14a844-f23b-4b10-bb4a-34b6f34306c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '673c89eefa69477a834f8f384cbdd8d8'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:02.806187 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-ee14a844-f23b-4b10-bb4a-34b6f34306c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '673c89eefa69477a834f8f384cbdd8d8'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:02.827088 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1135/2248] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:31:02 2022] DELETE /identity/v3/users/673c89eefa69477a834f8f384cbdd8d8 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:31:02.832144 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da72ef-906a-438b-8ae2-eac2ed19b954 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:02.832959 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da72ef-906a-438b-8ae2-eac2ed19b954 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:02.833321 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da72ef-906a-438b-8ae2-eac2ed19b954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:02.857344 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-78da72ef-906a-438b-8ae2-eac2ed19b954 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:31:02.860282 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-78da72ef-906a-438b-8ae2-eac2ed19b954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:02.939722 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1114/2249] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:31:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:31:02.947168 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee14a844-f23b-4b10-bb4a-34b6f34306c4 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:02.949003 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-ee14a844-f23b-4b10-bb4a-34b6f34306c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:02.962228 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:31:03.024836 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee14a844-f23b-4b10-bb4a-34b6f34306c4 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:03.028924 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5408db5a-95b8-4916-a443-43ef7d3e9158 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:03.029412 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5408db5a-95b8-4916-a443-43ef7d3e9158 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:03.029753 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5408db5a-95b8-4916-a443-43ef7d3e9158 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:03.030318 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5408db5a-95b8-4916-a443-43ef7d3e9158 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:03.048939 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5408db5a-95b8-4916-a443-43ef7d3e9158 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:03.052818 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5408db5a-95b8-4916-a443-43ef7d3e9158 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:03.064371 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1136/2250] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:31:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:31:03.400108 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78da72ef-906a-438b-8ae2-eac2ed19b954 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:03.401766 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-78da72ef-906a-438b-8ae2-eac2ed19b954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:03.420227 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78da72ef-906a-438b-8ae2-eac2ed19b954 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:03.430565 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac047d5f-094f-4270-84a6-f7e34c562821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:03.430565 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac047d5f-094f-4270-84a6-f7e34c562821 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:03.430890 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac047d5f-094f-4270-84a6-f7e34c562821 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:03.431139 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac047d5f-094f-4270-84a6-f7e34c562821 admin admin] PATH_INFO: `/v3/projects/278c562567dd4c51baecdb711c991814` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:03.432149 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac047d5f-094f-4270-84a6-f7e34c562821 admin admin] RBAC: Authorizing `identity:delete_project(project_id=278c562567dd4c51baecdb711c991814)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:03.434251 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac047d5f-094f-4270-84a6-f7e34c562821 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:03.504663 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-ac047d5f-094f-4270-84a6-f7e34c562821 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '278c562567dd4c51baecdb711c991814', 'request_id': 'req-ac047d5f-094f-4270-84a6-f7e34c562821'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:03.511074 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-ac047d5f-094f-4270-84a6-f7e34c562821 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '278c562567dd4c51baecdb711c991814', 'request_id': 'req-ac047d5f-094f-4270-84a6-f7e34c562821'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:03.520678 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-ac047d5f-094f-4270-84a6-f7e34c562821 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '278c562567dd4c51baecdb711c991814', 'request_id': 'req-ac047d5f-094f-4270-84a6-f7e34c562821'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:03.537651 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-ac047d5f-094f-4270-84a6-f7e34c562821 admin admin] The token cache is being invalidate because project 278c562567dd4c51baecdb711c991814 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81447) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:31:03.538926 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-ac047d5f-094f-4270-84a6-f7e34c562821 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:03.539875 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-ac047d5f-094f-4270-84a6-f7e34c562821 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:03.541723 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1115/2251] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:31:03 2022] DELETE /identity/v3/projects/278c562567dd4c51baecdb711c991814 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:31:03.546206 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5408db5a-95b8-4916-a443-43ef7d3e9158 service neutron] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:03.556509 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5408db5a-95b8-4916-a443-43ef7d3e9158 service neutron] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:03.631270 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c57aa-0cb4-4790-a84e-15684432f069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:03.632062 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c57aa-0cb4-4790-a84e-15684432f069 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:03.632238 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c57aa-0cb4-4790-a84e-15684432f069 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:03.632487 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c57aa-0cb4-4790-a84e-15684432f069 admin admin] PATH_INFO: `/v3/users/71d8e8f09d864614ab268d9a88699a75` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:03.633633 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60c57aa-0cb4-4790-a84e-15684432f069 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71d8e8f09d864614ab268d9a88699a75)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:03.635647 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60c57aa-0cb4-4790-a84e-15684432f069 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:03.683837 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-f60c57aa-0cb4-4790-a84e-15684432f069 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71d8e8f09d864614ab268d9a88699a75'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:03.690950 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-f60c57aa-0cb4-4790-a84e-15684432f069 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71d8e8f09d864614ab268d9a88699a75'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:03.691599 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-f60c57aa-0cb4-4790-a84e-15684432f069 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71d8e8f09d864614ab268d9a88699a75'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:03.704887 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-f60c57aa-0cb4-4790-a84e-15684432f069 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71d8e8f09d864614ab268d9a88699a75'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:03.705543 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-f60c57aa-0cb4-4790-a84e-15684432f069 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71d8e8f09d864614ab268d9a88699a75'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:03.719925 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1137/2252] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:31:03 2022] DELETE /identity/v3/users/71d8e8f09d864614ab268d9a88699a75 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:31:04.043130 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac047d5f-094f-4270-84a6-f7e34c562821 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:04.048809 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-ac047d5f-094f-4270-84a6-f7e34c562821 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:04.063576 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac047d5f-094f-4270-84a6-f7e34c562821 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:04.105369 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:31:04.137917 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdd84c5-16c2-45d0-b0e5-f576bf09aec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:04.138618 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd84c5-16c2-45d0-b0e5-f576bf09aec3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:04.138901 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd84c5-16c2-45d0-b0e5-f576bf09aec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:04.139177 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd84c5-16c2-45d0-b0e5-f576bf09aec3 admin admin] PATH_INFO: `/v3/projects/409fb56c639d41b2ab347ed39468f2f5` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:04.140518 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdd84c5-16c2-45d0-b0e5-f576bf09aec3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=409fb56c639d41b2ab347ed39468f2f5)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:04.142454 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdd84c5-16c2-45d0-b0e5-f576bf09aec3 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:04.195487 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-abdd84c5-16c2-45d0-b0e5-f576bf09aec3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '409fb56c639d41b2ab347ed39468f2f5', 'request_id': 'req-abdd84c5-16c2-45d0-b0e5-f576bf09aec3'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:04.202098 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-abdd84c5-16c2-45d0-b0e5-f576bf09aec3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '409fb56c639d41b2ab347ed39468f2f5', 'request_id': 'req-abdd84c5-16c2-45d0-b0e5-f576bf09aec3'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:04.212186 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-abdd84c5-16c2-45d0-b0e5-f576bf09aec3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '409fb56c639d41b2ab347ed39468f2f5', 'request_id': 'req-abdd84c5-16c2-45d0-b0e5-f576bf09aec3'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:04.225057 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-abdd84c5-16c2-45d0-b0e5-f576bf09aec3 admin admin] The token cache is being invalidate because project 409fb56c639d41b2ab347ed39468f2f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81447) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:31:04.225351 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-abdd84c5-16c2-45d0-b0e5-f576bf09aec3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:04.226011 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-abdd84c5-16c2-45d0-b0e5-f576bf09aec3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:04.227621 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1116/2253] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:31:04 2022] DELETE /identity/v3/projects/409fb56c639d41b2ab347ed39468f2f5 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:31:04.232842 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c57aa-0cb4-4790-a84e-15684432f069 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:04.234300 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-f60c57aa-0cb4-4790-a84e-15684432f069 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:04.251093 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c57aa-0cb4-4790-a84e-15684432f069 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:04.286362 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:31:04.324884 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5a815c-25a3-4943-940f-2eac6f8b9b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:04.325672 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a815c-25a3-4943-940f-2eac6f8b9b26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:04.326034 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a815c-25a3-4943-940f-2eac6f8b9b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:04.326322 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a815c-25a3-4943-940f-2eac6f8b9b26 admin admin] PATH_INFO: `/v3/users/b09cdc7d938b4676a784c1a80f3b5cec` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:04.327632 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5a815c-25a3-4943-940f-2eac6f8b9b26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b09cdc7d938b4676a784c1a80f3b5cec)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:04.329715 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5a815c-25a3-4943-940f-2eac6f8b9b26 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:04.385682 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-af5a815c-25a3-4943-940f-2eac6f8b9b26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b09cdc7d938b4676a784c1a80f3b5cec'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:04.394025 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-af5a815c-25a3-4943-940f-2eac6f8b9b26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b09cdc7d938b4676a784c1a80f3b5cec'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:04.394940 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-af5a815c-25a3-4943-940f-2eac6f8b9b26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b09cdc7d938b4676a784c1a80f3b5cec'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:04.409508 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-af5a815c-25a3-4943-940f-2eac6f8b9b26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b09cdc7d938b4676a784c1a80f3b5cec'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:04.410273 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-af5a815c-25a3-4943-940f-2eac6f8b9b26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b09cdc7d938b4676a784c1a80f3b5cec'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:04.425476 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1138/2254] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:31:04 2022] DELETE /identity/v3/users/b09cdc7d938b4676a784c1a80f3b5cec => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:31:04.707310 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdd84c5-16c2-45d0-b0e5-f576bf09aec3 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:04.709471 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-abdd84c5-16c2-45d0-b0e5-f576bf09aec3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:04.722424 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdd84c5-16c2-45d0-b0e5-f576bf09aec3 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:04.788823 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d389cf-e13f-437e-ae2a-fa17e47cbf2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:04.789616 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d389cf-e13f-437e-ae2a-fa17e47cbf2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:04.789898 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d389cf-e13f-437e-ae2a-fa17e47cbf2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:04.790609 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d389cf-e13f-437e-ae2a-fa17e47cbf2c admin admin] PATH_INFO: `/v3/projects/9fd1bd550a83432cb298abf017520487` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:04.791772 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d389cf-e13f-437e-ae2a-fa17e47cbf2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fd1bd550a83432cb298abf017520487)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:04.793858 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d389cf-e13f-437e-ae2a-fa17e47cbf2c admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:04.859492 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-78d389cf-e13f-437e-ae2a-fa17e47cbf2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fd1bd550a83432cb298abf017520487', 'request_id': 'req-78d389cf-e13f-437e-ae2a-fa17e47cbf2c'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:04.871111 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-78d389cf-e13f-437e-ae2a-fa17e47cbf2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fd1bd550a83432cb298abf017520487', 'request_id': 'req-78d389cf-e13f-437e-ae2a-fa17e47cbf2c'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:04.881256 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-78d389cf-e13f-437e-ae2a-fa17e47cbf2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fd1bd550a83432cb298abf017520487', 'request_id': 'req-78d389cf-e13f-437e-ae2a-fa17e47cbf2c'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:04.883461 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:31:04.895375 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-78d389cf-e13f-437e-ae2a-fa17e47cbf2c admin admin] The token cache is being invalidate because project 9fd1bd550a83432cb298abf017520487 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81447) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:31:04.896418 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-78d389cf-e13f-437e-ae2a-fa17e47cbf2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:04.897392 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-78d389cf-e13f-437e-ae2a-fa17e47cbf2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:04.898956 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1117/2255] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:31:04 2022] DELETE /identity/v3/projects/9fd1bd550a83432cb298abf017520487 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:31:04.904208 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2550c06-72df-4eaa-b16a-14e099d50a84 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:04.904741 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2550c06-72df-4eaa-b16a-14e099d50a84 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:04.904987 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2550c06-72df-4eaa-b16a-14e099d50a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:04.932935 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-a2550c06-72df-4eaa-b16a-14e099d50a84 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:31:04.934176 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-a2550c06-72df-4eaa-b16a-14e099d50a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:05.006457 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1139/2256] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:31:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:31:05.015103 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd8fce-56f8-4bff-80d5-f5706b0c5ade None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:05.015388 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd8fce-56f8-4bff-80d5-f5706b0c5ade None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:05.015690 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd8fce-56f8-4bff-80d5-f5706b0c5ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:05.042344 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-6bcd8fce-56f8-4bff-80d5-f5706b0c5ade None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:31:05.043633 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-6bcd8fce-56f8-4bff-80d5-f5706b0c5ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:05.053351 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1118/2257] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:31:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:31:05.057877 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2550c06-72df-4eaa-b16a-14e099d50a84 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:05.070473 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2550c06-72df-4eaa-b16a-14e099d50a84 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:05.075316 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35791ec-e949-4c1e-b95b-d27cb7608b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:05.076123 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35791ec-e949-4c1e-b95b-d27cb7608b9d admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:05.076410 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35791ec-e949-4c1e-b95b-d27cb7608b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:05.076681 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35791ec-e949-4c1e-b95b-d27cb7608b9d admin admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:05.077336 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35791ec-e949-4c1e-b95b-d27cb7608b9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:31:05.077643 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35791ec-e949-4c1e-b95b-d27cb7608b9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:05.080333 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35791ec-e949-4c1e-b95b-d27cb7608b9d admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:05.100227 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1140/2258] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 30 01:31:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:31:05.104372 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd8fce-56f8-4bff-80d5-f5706b0c5ade None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:05.113451 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd8fce-56f8-4bff-80d5-f5706b0c5ade None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:05.118210 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df1f266-5674-4a75-b8d1-8b74f6819833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:05.119534 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1f266-5674-4a75-b8d1-8b74f6819833 admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:05.119534 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1f266-5674-4a75-b8d1-8b74f6819833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:05.119534 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1f266-5674-4a75-b8d1-8b74f6819833 admin admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:05.120012 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df1f266-5674-4a75-b8d1-8b74f6819833 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:05.121927 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df1f266-5674-4a75-b8d1-8b74f6819833 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:05.154851 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1119/2259] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:31:05 2022] POST /identity/v3/projects => generated 389 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:31:05.156143 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35791ec-e949-4c1e-b95b-d27cb7608b9d admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:05.166399 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35791ec-e949-4c1e-b95b-d27cb7608b9d admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:05.200106 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:31:05.226140 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ede02b-240e-4d89-9ef1-efc0b29f2a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:05.226875 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ede02b-240e-4d89-9ef1-efc0b29f2a0e admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:05.227338 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ede02b-240e-4d89-9ef1-efc0b29f2a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:05.227750 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ede02b-240e-4d89-9ef1-efc0b29f2a0e admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:05.228548 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ede02b-240e-4d89-9ef1-efc0b29f2a0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:05.232191 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ede02b-240e-4d89-9ef1-efc0b29f2a0e admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:05.268571 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1141/2260] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:31:05 2022] POST /identity/v3/users => generated 295 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:31:05.274479 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df1f266-5674-4a75-b8d1-8b74f6819833 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:05.285183 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df1f266-5674-4a75-b8d1-8b74f6819833 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:05.289789 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c287cfc-322c-49de-bb90-544df2ee02d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:05.290394 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c287cfc-322c-49de-bb90-544df2ee02d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:05.290674 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c287cfc-322c-49de-bb90-544df2ee02d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:05.290950 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c287cfc-322c-49de-bb90-544df2ee02d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:05.291642 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c287cfc-322c-49de-bb90-544df2ee02d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:05.293253 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c287cfc-322c-49de-bb90-544df2ee02d3 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:05.303340 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1120/2261] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:31:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:31:05.307188 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ede02b-240e-4d89-9ef1-efc0b29f2a0e admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:05.317155 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ede02b-240e-4d89-9ef1-efc0b29f2a0e admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:05.322181 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d2515-00e5-481e-a2dc-de926ded6b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:05.322801 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d2515-00e5-481e-a2dc-de926ded6b13 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:05.323102 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d2515-00e5-481e-a2dc-de926ded6b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:05.323377 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d2515-00e5-481e-a2dc-de926ded6b13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:05.324102 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43d2515-00e5-481e-a2dc-de926ded6b13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:05.325757 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43d2515-00e5-481e-a2dc-de926ded6b13 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:05.341420 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1142/2262] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:31:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:31:05.345487 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c287cfc-322c-49de-bb90-544df2ee02d3 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:05.356124 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c287cfc-322c-49de-bb90-544df2ee02d3 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:05.362840 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e58af-fe8f-4be7-a730-97ba6c9dbbdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:05.363790 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e58af-fe8f-4be7-a730-97ba6c9dbbdb admin admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:05.364138 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e58af-fe8f-4be7-a730-97ba6c9dbbdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:05.364486 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e58af-fe8f-4be7-a730-97ba6c9dbbdb admin admin] PATH_INFO: `/v3/projects/ca39238dcbfe4345a87130f88bbb8ef3/users/fb345f242a324d6a8b97b8abbf9b1dcb/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:05.389303 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022e58af-fe8f-4be7-a730-97ba6c9dbbdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca39238dcbfe4345a87130f88bbb8ef3, user_id=fb345f242a324d6a8b97b8abbf9b1dcb, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:05.392133 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022e58af-fe8f-4be7-a730-97ba6c9dbbdb admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:05.411654 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1121/2263] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:31:05 2022] PUT /identity/v3/projects/ca39238dcbfe4345a87130f88bbb8ef3/users/fb345f242a324d6a8b97b8abbf9b1dcb/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:31:05.421879 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f576633f-f72c-407c-8de0-85f0081e377f None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:05.422171 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f576633f-f72c-407c-8de0-85f0081e377f None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:05.422450 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f576633f-f72c-407c-8de0-85f0081e377f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:05.453439 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-f576633f-f72c-407c-8de0-85f0081e377f None None] MFA Rules not processed for user `fb345f242a324d6a8b97b8abbf9b1dcb`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:31:05.454800 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-f576633f-f72c-407c-8de0-85f0081e377f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:05.522453 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1143/2264] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:31:05 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:31:05.534093 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e58af-fe8f-4be7-a730-97ba6c9dbbdb admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:05.535900 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-022e58af-fe8f-4be7-a730-97ba6c9dbbdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:05.616868 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e58af-fe8f-4be7-a730-97ba6c9dbbdb admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:05.620715 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e4664d-af18-4b74-8e24-bacdc5999ac1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:05.621388 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4664d-af18-4b74-8e24-bacdc5999ac1 service cinder] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:05.621667 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4664d-af18-4b74-8e24-bacdc5999ac1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:05.621943 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4664d-af18-4b74-8e24-bacdc5999ac1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:05.633690 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e4664d-af18-4b74-8e24-bacdc5999ac1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:05.635123 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e4664d-af18-4b74-8e24-bacdc5999ac1 service cinder] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:05.643864 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1122/2265] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:31:05 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:31:15.519788 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=50,keystone:INSERT=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:31:15.640014 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=56,keystone:DELETE=1,keystone:INSERT=2 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:31:15.986401 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f576633f-f72c-407c-8de0-85f0081e377f None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:16.060392 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f576633f-f72c-407c-8de0-85f0081e377f None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:16.065718 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4edee5-5b86-4252-9f0e-e27ce8162e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:16.066475 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4edee5-5b86-4252-9f0e-e27ce8162e67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:16.066919 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4edee5-5b86-4252-9f0e-e27ce8162e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:16.067196 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4edee5-5b86-4252-9f0e-e27ce8162e67 admin admin] PATH_INFO: `/v3/users/fb345f242a324d6a8b97b8abbf9b1dcb` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:16.068520 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4edee5-5b86-4252-9f0e-e27ce8162e67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb345f242a324d6a8b97b8abbf9b1dcb)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:16.070580 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4edee5-5b86-4252-9f0e-e27ce8162e67 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:16.123952 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-bf4edee5-5b86-4252-9f0e-e27ce8162e67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb345f242a324d6a8b97b8abbf9b1dcb'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:16.132383 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-bf4edee5-5b86-4252-9f0e-e27ce8162e67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb345f242a324d6a8b97b8abbf9b1dcb'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:16.133055 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-bf4edee5-5b86-4252-9f0e-e27ce8162e67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb345f242a324d6a8b97b8abbf9b1dcb'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:16.145745 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-bf4edee5-5b86-4252-9f0e-e27ce8162e67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb345f242a324d6a8b97b8abbf9b1dcb'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:16.146402 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-bf4edee5-5b86-4252-9f0e-e27ce8162e67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb345f242a324d6a8b97b8abbf9b1dcb'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:16.161379 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1144/2266] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:31:15 2022] DELETE /identity/v3/users/fb345f242a324d6a8b97b8abbf9b1dcb => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:31:16.166749 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0c83c-6633-40d3-ba31-368fedebaf90 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:16.167137 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0c83c-6633-40d3-ba31-368fedebaf90 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:16.167313 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0c83c-6633-40d3-ba31-368fedebaf90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:16.189422 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-d9d0c83c-6633-40d3-ba31-368fedebaf90 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:31:16.190830 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-d9d0c83c-6633-40d3-ba31-368fedebaf90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:16.380073 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1123/2267] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:31:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:31:16.390898 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4edee5-5b86-4252-9f0e-e27ce8162e67 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:16.392521 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-bf4edee5-5b86-4252-9f0e-e27ce8162e67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:16.454149 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4edee5-5b86-4252-9f0e-e27ce8162e67 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:16.458407 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baad378c-a3a1-4c22-a9f3-a03dc25b3d88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:16.458614 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad378c-a3a1-4c22-a9f3-a03dc25b3d88 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:16.458981 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad378c-a3a1-4c22-a9f3-a03dc25b3d88 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:16.459259 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad378c-a3a1-4c22-a9f3-a03dc25b3d88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:16.472557 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baad378c-a3a1-4c22-a9f3-a03dc25b3d88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:16.474043 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baad378c-a3a1-4c22-a9f3-a03dc25b3d88 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:16.488264 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1145/2268] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:31:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:31:16.873475 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d0c83c-6633-40d3-ba31-368fedebaf90 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:16.874881 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-d9d0c83c-6633-40d3-ba31-368fedebaf90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:16.890192 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d0c83c-6633-40d3-ba31-368fedebaf90 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:16.895238 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6540715a-b257-497e-9cf7-d64ce24022c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:16.895962 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540715a-b257-497e-9cf7-d64ce24022c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:16.896179 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540715a-b257-497e-9cf7-d64ce24022c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:16.896446 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540715a-b257-497e-9cf7-d64ce24022c6 admin admin] PATH_INFO: `/v3/projects/ca39238dcbfe4345a87130f88bbb8ef3` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:16.897589 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6540715a-b257-497e-9cf7-d64ce24022c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca39238dcbfe4345a87130f88bbb8ef3)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:16.899962 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6540715a-b257-497e-9cf7-d64ce24022c6 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:16.958199 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-6540715a-b257-497e-9cf7-d64ce24022c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca39238dcbfe4345a87130f88bbb8ef3', 'request_id': 'req-6540715a-b257-497e-9cf7-d64ce24022c6'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:16.966597 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-6540715a-b257-497e-9cf7-d64ce24022c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca39238dcbfe4345a87130f88bbb8ef3', 'request_id': 'req-6540715a-b257-497e-9cf7-d64ce24022c6'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:16.973464 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-6540715a-b257-497e-9cf7-d64ce24022c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca39238dcbfe4345a87130f88bbb8ef3', 'request_id': 'req-6540715a-b257-497e-9cf7-d64ce24022c6'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:16.985072 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-6540715a-b257-497e-9cf7-d64ce24022c6 admin admin] The token cache is being invalidate because project ca39238dcbfe4345a87130f88bbb8ef3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81447) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:31:16.985360 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-6540715a-b257-497e-9cf7-d64ce24022c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:16.985997 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-6540715a-b257-497e-9cf7-d64ce24022c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:16.987561 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1124/2269] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:31:16 2022] DELETE /identity/v3/projects/ca39238dcbfe4345a87130f88bbb8ef3 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:31:16.993359 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db4375-63e4-40e9-9e80-48f59737ff45 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:16.993832 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db4375-63e4-40e9-9e80-48f59737ff45 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:16.993832 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db4375-63e4-40e9-9e80-48f59737ff45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:17.013371 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-64db4375-63e4-40e9-9e80-48f59737ff45 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:31:17.014551 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-64db4375-63e4-40e9-9e80-48f59737ff45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:17.030846 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:31:17.077724 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1146/2270] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:31:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:31:17.085591 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b831231-63b1-4e78-8d7a-2020fe1b8a40 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:17.086135 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b831231-63b1-4e78-8d7a-2020fe1b8a40 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:17.086408 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b831231-63b1-4e78-8d7a-2020fe1b8a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:17.106231 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-9b831231-63b1-4e78-8d7a-2020fe1b8a40 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:31:17.107412 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-9b831231-63b1-4e78-8d7a-2020fe1b8a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:17.115086 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1125/2271] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:31:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:31:17.119875 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db4375-63e4-40e9-9e80-48f59737ff45 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:17.129593 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db4375-63e4-40e9-9e80-48f59737ff45 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:17.134803 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8eeaf-8fd2-4081-a8e6-06a5bd31d88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:17.135459 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8eeaf-8fd2-4081-a8e6-06a5bd31d88e admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:17.135751 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8eeaf-8fd2-4081-a8e6-06a5bd31d88e admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:17.136028 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8eeaf-8fd2-4081-a8e6-06a5bd31d88e admin admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:17.136687 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8eeaf-8fd2-4081-a8e6-06a5bd31d88e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:31:17.136993 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8eeaf-8fd2-4081-a8e6-06a5bd31d88e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:17.138629 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8eeaf-8fd2-4081-a8e6-06a5bd31d88e admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:17.151967 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1147/2272] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 30 01:31:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:31:17.155639 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b831231-63b1-4e78-8d7a-2020fe1b8a40 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:17.165176 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b831231-63b1-4e78-8d7a-2020fe1b8a40 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:17.169753 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a7474c-4a21-470a-a6a2-16791328e5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:17.170352 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7474c-4a21-470a-a6a2-16791328e5a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:17.170629 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7474c-4a21-470a-a6a2-16791328e5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:17.170898 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7474c-4a21-470a-a6a2-16791328e5a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:17.171551 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a7474c-4a21-470a-a6a2-16791328e5a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:17.173451 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a7474c-4a21-470a-a6a2-16791328e5a0 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:17.204630 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1126/2273] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:31:17 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:31:17.208310 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8eeaf-8fd2-4081-a8e6-06a5bd31d88e admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:17.225134 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8eeaf-8fd2-4081-a8e6-06a5bd31d88e admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:17.291134 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8659c8-242a-46fe-a07d-7a8210e43b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:17.291780 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8659c8-242a-46fe-a07d-7a8210e43b25 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:17.292059 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8659c8-242a-46fe-a07d-7a8210e43b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:17.292333 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8659c8-242a-46fe-a07d-7a8210e43b25 admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:17.292978 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8659c8-242a-46fe-a07d-7a8210e43b25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:17.294878 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8659c8-242a-46fe-a07d-7a8210e43b25 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:17.317054 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1148/2274] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:31:17 2022] POST /identity/v3/users => generated 286 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:31:17.321126 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a7474c-4a21-470a-a6a2-16791328e5a0 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:17.331533 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a7474c-4a21-470a-a6a2-16791328e5a0 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:17.337743 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1c64a9-3962-4750-aca1-3ab407bb6106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:17.338460 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c64a9-3962-4750-aca1-3ab407bb6106 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:17.338806 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c64a9-3962-4750-aca1-3ab407bb6106 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:17.339144 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c64a9-3962-4750-aca1-3ab407bb6106 admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:17.339836 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1c64a9-3962-4750-aca1-3ab407bb6106 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:17.341452 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1c64a9-3962-4750-aca1-3ab407bb6106 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:17.352742 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1127/2275] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:31:17.356742 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8659c8-242a-46fe-a07d-7a8210e43b25 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:17.368909 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8659c8-242a-46fe-a07d-7a8210e43b25 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:17.373886 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9284e93e-454e-41b5-9505-66804b8e1024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:17.374524 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284e93e-454e-41b5-9505-66804b8e1024 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:17.374801 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284e93e-454e-41b5-9505-66804b8e1024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:17.375073 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284e93e-454e-41b5-9505-66804b8e1024 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:17.375761 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9284e93e-454e-41b5-9505-66804b8e1024 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:17.377691 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9284e93e-454e-41b5-9505-66804b8e1024 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:17.389868 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1149/2276] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:31:17.393920 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1c64a9-3962-4750-aca1-3ab407bb6106 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:17.405200 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1c64a9-3962-4750-aca1-3ab407bb6106 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:17.409902 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad254d-a484-429f-bb5d-1d8eef3a726f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:17.410558 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad254d-a484-429f-bb5d-1d8eef3a726f admin admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:17.410841 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad254d-a484-429f-bb5d-1d8eef3a726f admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:17.411109 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad254d-a484-429f-bb5d-1d8eef3a726f admin admin] PATH_INFO: `/v3/projects/698a8ca01bfe4d4cabba581342416471/users/91bfcdadb42441538cd25b83c7143808/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:17.426641 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ad254d-a484-429f-bb5d-1d8eef3a726f admin admin] RBAC: Authorizing `identity:create_grant(project_id=698a8ca01bfe4d4cabba581342416471, user_id=91bfcdadb42441538cd25b83c7143808, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:17.429307 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ad254d-a484-429f-bb5d-1d8eef3a726f admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:17.444032 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1128/2277] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:31:17 2022] PUT /identity/v3/projects/698a8ca01bfe4d4cabba581342416471/users/91bfcdadb42441538cd25b83c7143808/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:31:17.450007 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c5cb3-97d1-45d2-b218-2d14e6513a43 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:17.450496 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c5cb3-97d1-45d2-b218-2d14e6513a43 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:17.450943 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c5cb3-97d1-45d2-b218-2d14e6513a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:17.476942 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-892c5cb3-97d1-45d2-b218-2d14e6513a43 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:31:17.478160 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-892c5cb3-97d1-45d2-b218-2d14e6513a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:17.548444 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1150/2278] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:31:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:31:17.559251 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad254d-a484-429f-bb5d-1d8eef3a726f admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:17.561027 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-36ad254d-a484-429f-bb5d-1d8eef3a726f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:17.583048 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:31:17.637603 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad254d-a484-429f-bb5d-1d8eef3a726f admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:17.641384 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946cf9dc-31ce-4cdc-9c8f-9c39aafff1a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:17.641998 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946cf9dc-31ce-4cdc-9c8f-9c39aafff1a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:17.642270 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946cf9dc-31ce-4cdc-9c8f-9c39aafff1a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:17.642539 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946cf9dc-31ce-4cdc-9c8f-9c39aafff1a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:17.654001 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946cf9dc-31ce-4cdc-9c8f-9c39aafff1a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:17.655525 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946cf9dc-31ce-4cdc-9c8f-9c39aafff1a6 service neutron] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:17.666506 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1129/2279] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:31:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:31:17.775980 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ac18f-afb5-4d12-9062-fc349f674371 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:17.776461 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ac18f-afb5-4d12-9062-fc349f674371 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:17.776995 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ac18f-afb5-4d12-9062-fc349f674371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:17.808105 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-9a1ac18f-afb5-4d12-9062-fc349f674371 None None] MFA Rules not processed for user `edc11f8a9c5843939ec230e63ca7fa3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:31:17.808939 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-9a1ac18f-afb5-4d12-9062-fc349f674371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:17.846527 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:31:17.890562 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1151/2280] 10.222.0.60 () {58 vars in 1009 bytes} [Tue Aug 30 01:31:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:31:17.947707 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946cf9dc-31ce-4cdc-9c8f-9c39aafff1a6 service neutron] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:17.949895 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-946cf9dc-31ce-4cdc-9c8f-9c39aafff1a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:18.109483 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946cf9dc-31ce-4cdc-9c8f-9c39aafff1a6 service neutron] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:18.127043 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ff1c5-876d-4452-bcb8-b703411403b5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7de1f31ef84d529bf2c53ce0f7e38b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:18.127754 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ff1c5-876d-4452-bcb8-b703411403b5 service swift] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:18.128163 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ff1c5-876d-4452-bcb8-b703411403b5 service swift] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:18.128447 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ff1c5-876d-4452-bcb8-b703411403b5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:18.149854 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246ff1c5-876d-4452-bcb8-b703411403b5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:18.151730 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246ff1c5-876d-4452-bcb8-b703411403b5 service swift] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:18.166933 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1130/2281] 10.222.0.60 () {60 vars in 1384 bytes} [Tue Aug 30 01:31:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 01:31:19.378212 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ac18f-afb5-4d12-9062-fc349f674371 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:19.379961 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-9a1ac18f-afb5-4d12-9062-fc349f674371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:19.438781 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ac18f-afb5-4d12-9062-fc349f674371 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:19.458160 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3af9fc-ee3b-45b0-a124-d66f376078bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:19.458832 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3af9fc-ee3b-45b0-a124-d66f376078bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:19.459112 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3af9fc-ee3b-45b0-a124-d66f376078bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:19.459382 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3af9fc-ee3b-45b0-a124-d66f376078bf admin admin] PATH_INFO: `/v3/users/cb57ebcf5d694dceadbe9983c5b7f070` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:19.466106 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3af9fc-ee3b-45b0-a124-d66f376078bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb57ebcf5d694dceadbe9983c5b7f070)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:19.466106 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3af9fc-ee3b-45b0-a124-d66f376078bf admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:19.584839 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-0c3af9fc-ee3b-45b0-a124-d66f376078bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb57ebcf5d694dceadbe9983c5b7f070'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:19.603995 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-0c3af9fc-ee3b-45b0-a124-d66f376078bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb57ebcf5d694dceadbe9983c5b7f070'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:19.605823 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-0c3af9fc-ee3b-45b0-a124-d66f376078bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb57ebcf5d694dceadbe9983c5b7f070'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:19.633765 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-0c3af9fc-ee3b-45b0-a124-d66f376078bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb57ebcf5d694dceadbe9983c5b7f070'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:19.640315 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-0c3af9fc-ee3b-45b0-a124-d66f376078bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb57ebcf5d694dceadbe9983c5b7f070'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:19.688734 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1152/2282] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:31:19 2022] DELETE /identity/v3/users/cb57ebcf5d694dceadbe9983c5b7f070 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:31:19.695346 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ce236-9fa0-4117-af1b-ae25de26a059 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:19.695922 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ce236-9fa0-4117-af1b-ae25de26a059 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:19.696125 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ce236-9fa0-4117-af1b-ae25de26a059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:19.756061 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-bc5ce236-9fa0-4117-af1b-ae25de26a059 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:31:19.757351 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-bc5ce236-9fa0-4117-af1b-ae25de26a059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:19.930590 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1131/2283] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:31:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:31:19.941991 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3af9fc-ee3b-45b0-a124-d66f376078bf admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:19.943803 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-0c3af9fc-ee3b-45b0-a124-d66f376078bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:20.108376 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3af9fc-ee3b-45b0-a124-d66f376078bf admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:20.116712 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfd3e09-7b37-4df0-9a6f-62c8daadb85a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:20.117778 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd3e09-7b37-4df0-9a6f-62c8daadb85a service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:20.118137 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd3e09-7b37-4df0-9a6f-62c8daadb85a service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:20.118560 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd3e09-7b37-4df0-9a6f-62c8daadb85a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:20.132463 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfd3e09-7b37-4df0-9a6f-62c8daadb85a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:20.134135 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfd3e09-7b37-4df0-9a6f-62c8daadb85a service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:20.158795 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1153/2284] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:31:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:31:20.844431 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5ce236-9fa0-4117-af1b-ae25de26a059 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:20.846072 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-bc5ce236-9fa0-4117-af1b-ae25de26a059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:20.876925 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5ce236-9fa0-4117-af1b-ae25de26a059 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:20.911731 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953094c-2797-4d38-949e-df3d7336ecf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:20.912871 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953094c-2797-4d38-949e-df3d7336ecf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:20.913748 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953094c-2797-4d38-949e-df3d7336ecf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:20.914090 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953094c-2797-4d38-949e-df3d7336ecf1 admin admin] PATH_INFO: `/v3/projects/8b2ef867872f4479a02e829013c45933` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:20.918817 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d953094c-2797-4d38-949e-df3d7336ecf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b2ef867872f4479a02e829013c45933)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:20.921081 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d953094c-2797-4d38-949e-df3d7336ecf1 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:21.044290 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:31:21.054751 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-d953094c-2797-4d38-949e-df3d7336ecf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b2ef867872f4479a02e829013c45933', 'request_id': 'req-d953094c-2797-4d38-949e-df3d7336ecf1'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:21.072689 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-d953094c-2797-4d38-949e-df3d7336ecf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b2ef867872f4479a02e829013c45933', 'request_id': 'req-d953094c-2797-4d38-949e-df3d7336ecf1'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:21.087287 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-d953094c-2797-4d38-949e-df3d7336ecf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b2ef867872f4479a02e829013c45933', 'request_id': 'req-d953094c-2797-4d38-949e-df3d7336ecf1'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:21.118115 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-d953094c-2797-4d38-949e-df3d7336ecf1 admin admin] The token cache is being invalidate because project 8b2ef867872f4479a02e829013c45933 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81447) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:31:21.118422 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-d953094c-2797-4d38-949e-df3d7336ecf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:21.119122 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-d953094c-2797-4d38-949e-df3d7336ecf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:21.124269 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1132/2285] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:31:20 2022] DELETE /identity/v3/projects/8b2ef867872f4479a02e829013c45933 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:31:21.125586 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfd3e09-7b37-4df0-9a6f-62c8daadb85a service neutron] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:21.156007 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfd3e09-7b37-4df0-9a6f-62c8daadb85a service neutron] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:21.316309 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:31:21.352283 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60829bc1-9e37-4af5-8cc4-79ebfb2d7ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:21.353024 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60829bc1-9e37-4af5-8cc4-79ebfb2d7ed3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:21.353319 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60829bc1-9e37-4af5-8cc4-79ebfb2d7ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:21.353673 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60829bc1-9e37-4af5-8cc4-79ebfb2d7ed3 admin admin] PATH_INFO: `/v3/users/517f96100d494fc78bc033d88c2b620c` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:21.356618 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60829bc1-9e37-4af5-8cc4-79ebfb2d7ed3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=517f96100d494fc78bc033d88c2b620c)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:21.358597 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60829bc1-9e37-4af5-8cc4-79ebfb2d7ed3 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:21.502858 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-60829bc1-9e37-4af5-8cc4-79ebfb2d7ed3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '517f96100d494fc78bc033d88c2b620c'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:21.527770 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-60829bc1-9e37-4af5-8cc4-79ebfb2d7ed3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '517f96100d494fc78bc033d88c2b620c'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:21.538978 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-60829bc1-9e37-4af5-8cc4-79ebfb2d7ed3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '517f96100d494fc78bc033d88c2b620c'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:21.580705 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-60829bc1-9e37-4af5-8cc4-79ebfb2d7ed3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '517f96100d494fc78bc033d88c2b620c'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:21.584401 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-60829bc1-9e37-4af5-8cc4-79ebfb2d7ed3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '517f96100d494fc78bc033d88c2b620c'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:21.634224 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1154/2286] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:31:21 2022] DELETE /identity/v3/users/517f96100d494fc78bc033d88c2b620c => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:31:22.898211 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953094c-2797-4d38-949e-df3d7336ecf1 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:22.900625 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-d953094c-2797-4d38-949e-df3d7336ecf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:22.939465 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953094c-2797-4d38-949e-df3d7336ecf1 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:23.042661 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a97764f-28b7-4db5-a85e-296395ba421b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:23.043334 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a97764f-28b7-4db5-a85e-296395ba421b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:23.043662 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a97764f-28b7-4db5-a85e-296395ba421b admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:23.043932 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a97764f-28b7-4db5-a85e-296395ba421b admin admin] PATH_INFO: `/v3/projects/1cc240343c924ed6a016f8cb4b5d2c0f` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:23.045499 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a97764f-28b7-4db5-a85e-296395ba421b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cc240343c924ed6a016f8cb4b5d2c0f)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:23.047540 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a97764f-28b7-4db5-a85e-296395ba421b admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:23.139468 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-4a97764f-28b7-4db5-a85e-296395ba421b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cc240343c924ed6a016f8cb4b5d2c0f', 'request_id': 'req-4a97764f-28b7-4db5-a85e-296395ba421b'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:23.148131 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-4a97764f-28b7-4db5-a85e-296395ba421b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cc240343c924ed6a016f8cb4b5d2c0f', 'request_id': 'req-4a97764f-28b7-4db5-a85e-296395ba421b'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:23.163469 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-4a97764f-28b7-4db5-a85e-296395ba421b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cc240343c924ed6a016f8cb4b5d2c0f', 'request_id': 'req-4a97764f-28b7-4db5-a85e-296395ba421b'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:23.195646 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-4a97764f-28b7-4db5-a85e-296395ba421b admin admin] The token cache is being invalidate because project 1cc240343c924ed6a016f8cb4b5d2c0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81447) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:31:23.195843 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-4a97764f-28b7-4db5-a85e-296395ba421b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:23.200469 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-4a97764f-28b7-4db5-a85e-296395ba421b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:23.206419 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1133/2287] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:31:22 2022] DELETE /identity/v3/projects/1cc240343c924ed6a016f8cb4b5d2c0f => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:31:23.208528 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679dd89f-a579-4a43-9ca7-90f1f38042da None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:23.209063 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679dd89f-a579-4a43-9ca7-90f1f38042da None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:23.209063 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679dd89f-a579-4a43-9ca7-90f1f38042da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:23.245539 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-679dd89f-a579-4a43-9ca7-90f1f38042da None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:31:23.248376 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-679dd89f-a579-4a43-9ca7-90f1f38042da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:23.386992 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1155/2288] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:31:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:31:23.395240 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759face-80c2-410c-8c4d-09828a61849a None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:23.395657 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759face-80c2-410c-8c4d-09828a61849a None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:23.395942 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759face-80c2-410c-8c4d-09828a61849a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:23.437103 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-0759face-80c2-410c-8c4d-09828a61849a None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:31:23.439648 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-0759face-80c2-410c-8c4d-09828a61849a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:23.468629 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1134/2289] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:31:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:31:23.473085 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679dd89f-a579-4a43-9ca7-90f1f38042da None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:23.486909 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679dd89f-a579-4a43-9ca7-90f1f38042da None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:23.493798 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b049c15-3e30-4b0d-8192-0d97b13782e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:23.494507 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b049c15-3e30-4b0d-8192-0d97b13782e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:23.494850 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b049c15-3e30-4b0d-8192-0d97b13782e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:23.495401 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b049c15-3e30-4b0d-8192-0d97b13782e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:23.496247 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b049c15-3e30-4b0d-8192-0d97b13782e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:31:23.497393 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b049c15-3e30-4b0d-8192-0d97b13782e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:23.501029 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b049c15-3e30-4b0d-8192-0d97b13782e1 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:23.521643 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1156/2290] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 30 01:31:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:31:23.522917 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0759face-80c2-410c-8c4d-09828a61849a None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:23.533708 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0759face-80c2-410c-8c4d-09828a61849a None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:23.539717 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad29f6-44f7-45fa-ba8c-6b0695e4243c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:23.540719 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad29f6-44f7-45fa-ba8c-6b0695e4243c admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:23.540719 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad29f6-44f7-45fa-ba8c-6b0695e4243c admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:23.540909 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad29f6-44f7-45fa-ba8c-6b0695e4243c admin admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:23.541530 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ad29f6-44f7-45fa-ba8c-6b0695e4243c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:23.544960 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ad29f6-44f7-45fa-ba8c-6b0695e4243c admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:23.613802 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1135/2291] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:31:23 2022] POST /identity/v3/projects => generated 387 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:31:23.618400 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b049c15-3e30-4b0d-8192-0d97b13782e1 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:23.632768 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b049c15-3e30-4b0d-8192-0d97b13782e1 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:23.743386 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:31:23.768596 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed872fc-ad0e-47c8-b2a8-8d87d23d52b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:23.769569 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed872fc-ad0e-47c8-b2a8-8d87d23d52b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:23.769691 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed872fc-ad0e-47c8-b2a8-8d87d23d52b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:23.769935 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed872fc-ad0e-47c8-b2a8-8d87d23d52b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:23.770579 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed872fc-ad0e-47c8-b2a8-8d87d23d52b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:23.781058 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed872fc-ad0e-47c8-b2a8-8d87d23d52b4 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:23.862785 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1157/2292] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:31:23 2022] POST /identity/v3/users => generated 294 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:31:23.863680 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad29f6-44f7-45fa-ba8c-6b0695e4243c admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:23.876606 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad29f6-44f7-45fa-ba8c-6b0695e4243c admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:23.893649 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2d20cf-80ec-4393-a9f1-24065c661cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:23.894444 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d20cf-80ec-4393-a9f1-24065c661cda admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:23.894837 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d20cf-80ec-4393-a9f1-24065c661cda admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:23.895226 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d20cf-80ec-4393-a9f1-24065c661cda admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:23.896421 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2d20cf-80ec-4393-a9f1-24065c661cda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:23.898764 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2d20cf-80ec-4393-a9f1-24065c661cda admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:23.923308 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1136/2293] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:31:23 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:31:23.924702 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed872fc-ad0e-47c8-b2a8-8d87d23d52b4 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:23.940550 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed872fc-ad0e-47c8-b2a8-8d87d23d52b4 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:23.961967 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a413cc-0a60-4fd4-9c5f-dbc46d676112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:23.962793 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a413cc-0a60-4fd4-9c5f-dbc46d676112 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:23.963222 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a413cc-0a60-4fd4-9c5f-dbc46d676112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:23.963523 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a413cc-0a60-4fd4-9c5f-dbc46d676112 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:23.964241 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a413cc-0a60-4fd4-9c5f-dbc46d676112 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:23.967927 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a413cc-0a60-4fd4-9c5f-dbc46d676112 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:23.995943 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2d20cf-80ec-4393-a9f1-24065c661cda admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:24.014242 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1158/2294] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:31:23 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:31:24.032868 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2d20cf-80ec-4393-a9f1-24065c661cda admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:24.056497 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058da4cf-49cd-4009-9aea-6766f6bedfdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:24.057174 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058da4cf-49cd-4009-9aea-6766f6bedfdb admin admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:24.057446 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058da4cf-49cd-4009-9aea-6766f6bedfdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:24.057714 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058da4cf-49cd-4009-9aea-6766f6bedfdb admin admin] PATH_INFO: `/v3/projects/a5a59fae91fc44c3936ad0fdf3d9e822/users/04a41d99875b4794a9b2d68e4b842b46/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:24.081523 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058da4cf-49cd-4009-9aea-6766f6bedfdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5a59fae91fc44c3936ad0fdf3d9e822, user_id=04a41d99875b4794a9b2d68e4b842b46, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:24.084958 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058da4cf-49cd-4009-9aea-6766f6bedfdb admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:24.128046 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1137/2295] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:31:23 2022] PUT /identity/v3/projects/a5a59fae91fc44c3936ad0fdf3d9e822/users/04a41d99875b4794a9b2d68e4b842b46/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:31:24.130631 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7dd4b-247e-4048-82d6-6bc656dc7349 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:24.130927 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7dd4b-247e-4048-82d6-6bc656dc7349 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:24.132077 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7dd4b-247e-4048-82d6-6bc656dc7349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:24.204290 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-c2e7dd4b-247e-4048-82d6-6bc656dc7349 None None] MFA Rules not processed for user `04a41d99875b4794a9b2d68e4b842b46`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:31:24.207025 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-c2e7dd4b-247e-4048-82d6-6bc656dc7349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:24.380712 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058da4cf-49cd-4009-9aea-6766f6bedfdb admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:24.389795 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:31:24.393407 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1159/2296] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:31:24 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:31:24.547930 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058da4cf-49cd-4009-9aea-6766f6bedfdb admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:24.555489 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a70377-ce12-4a77-b914-91d9189cff6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:24.556848 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a70377-ce12-4a77-b914-91d9189cff6c admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:24.557148 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a70377-ce12-4a77-b914-91d9189cff6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:24.557609 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a70377-ce12-4a77-b914-91d9189cff6c admin admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:24.558475 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a70377-ce12-4a77-b914-91d9189cff6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:24.562143 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a70377-ce12-4a77-b914-91d9189cff6c admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:24.659526 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1138/2297] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:31:24 2022] POST /identity/v3/projects => generated 385 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:31:24.663622 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e7dd4b-247e-4048-82d6-6bc656dc7349 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:24.683214 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e7dd4b-247e-4048-82d6-6bc656dc7349 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:24.876749 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c452469c-8d84-4df5-8461-594084d6c282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:24.877440 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452469c-8d84-4df5-8461-594084d6c282 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:24.877893 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452469c-8d84-4df5-8461-594084d6c282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:24.878196 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452469c-8d84-4df5-8461-594084d6c282 admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:24.879948 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c452469c-8d84-4df5-8461-594084d6c282 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:24.882760 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c452469c-8d84-4df5-8461-594084d6c282 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:24.943832 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1160/2298] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:31:24 2022] POST /identity/v3/users => generated 299 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:31:24.949421 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a70377-ce12-4a77-b914-91d9189cff6c admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:24.966332 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a70377-ce12-4a77-b914-91d9189cff6c admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:24.986634 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936587aa-604a-4fdc-9d35-7c4eaa2b9b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:24.987264 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936587aa-604a-4fdc-9d35-7c4eaa2b9b6f admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:24.987573 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936587aa-604a-4fdc-9d35-7c4eaa2b9b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:24.987849 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936587aa-604a-4fdc-9d35-7c4eaa2b9b6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:24.988511 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936587aa-604a-4fdc-9d35-7c4eaa2b9b6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:24.990149 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936587aa-604a-4fdc-9d35-7c4eaa2b9b6f admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:25.025225 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c452469c-8d84-4df5-8461-594084d6c282 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:25.028701 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1139/2299] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:31:24 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:31:25.040167 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c452469c-8d84-4df5-8461-594084d6c282 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:25.045933 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e67f0a-c749-4887-a7ff-ad70aa280926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:25.046074 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e67f0a-c749-4887-a7ff-ad70aa280926 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:25.046443 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e67f0a-c749-4887-a7ff-ad70aa280926 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:25.046643 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e67f0a-c749-4887-a7ff-ad70aa280926 admin admin] PATH_INFO: `/v3/projects/99551ddaf0c248d59bdfb3f32ad6e2b1/users/0a6e57bc9cd64433baf30a844beeb1d7/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:25.087396 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e67f0a-c749-4887-a7ff-ad70aa280926 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99551ddaf0c248d59bdfb3f32ad6e2b1, user_id=0a6e57bc9cd64433baf30a844beeb1d7, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:25.095719 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e67f0a-c749-4887-a7ff-ad70aa280926 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:25.129812 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1161/2300] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:31:25 2022] PUT /identity/v3/projects/99551ddaf0c248d59bdfb3f32ad6e2b1/users/0a6e57bc9cd64433baf30a844beeb1d7/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:31:25.134667 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936587aa-604a-4fdc-9d35-7c4eaa2b9b6f admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:25.147704 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936587aa-604a-4fdc-9d35-7c4eaa2b9b6f admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:25.369670 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c9f5c-303f-4f92-b598-7eaa197e689a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:25.373086 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c9f5c-303f-4f92-b598-7eaa197e689a admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:25.373373 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c9f5c-303f-4f92-b598-7eaa197e689a admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:25.373836 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c9f5c-303f-4f92-b598-7eaa197e689a admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:25.374506 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5c9f5c-303f-4f92-b598-7eaa197e689a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:25.387782 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5c9f5c-303f-4f92-b598-7eaa197e689a admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:25.437689 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e67f0a-c749-4887-a7ff-ad70aa280926 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:25.438662 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1140/2301] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:31:25 2022] GET /identity/v3/roles => generated 1420 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:31:25.454124 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e67f0a-c749-4887-a7ff-ad70aa280926 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:25.464848 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021549d0-9399-4002-a017-581079829859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:25.465820 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021549d0-9399-4002-a017-581079829859 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:25.466267 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021549d0-9399-4002-a017-581079829859 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:25.466707 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021549d0-9399-4002-a017-581079829859 admin admin] PATH_INFO: `/v3/projects/99551ddaf0c248d59bdfb3f32ad6e2b1/users/0a6e57bc9cd64433baf30a844beeb1d7/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:25.470516 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021549d0-9399-4002-a017-581079829859 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99551ddaf0c248d59bdfb3f32ad6e2b1, user_id=0a6e57bc9cd64433baf30a844beeb1d7, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:25.473447 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021549d0-9399-4002-a017-581079829859 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:25.511333 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1162/2302] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:31:25 2022] PUT /identity/v3/projects/99551ddaf0c248d59bdfb3f32ad6e2b1/users/0a6e57bc9cd64433baf30a844beeb1d7/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:31:25.513091 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4980b-a472-4984-a49f-387e891e3838 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:25.513566 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4980b-a472-4984-a49f-387e891e3838 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:25.514002 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4980b-a472-4984-a49f-387e891e3838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:25.603029 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-91e4980b-a472-4984-a49f-387e891e3838 None None] MFA Rules not processed for user `0a6e57bc9cd64433baf30a844beeb1d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:31:25.607180 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-91e4980b-a472-4984-a49f-387e891e3838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:25.729087 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:31:25.736316 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1141/2303] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:31:25 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:31:25.757458 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021549d0-9399-4002-a017-581079829859 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:25.760223 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-021549d0-9399-4002-a017-581079829859 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:25.815619 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:31:25.963174 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021549d0-9399-4002-a017-581079829859 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:25.967124 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6034b7-5a0e-45f2-9938-ef7e0f99463f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:25.967921 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6034b7-5a0e-45f2-9938-ef7e0f99463f service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:25.968302 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6034b7-5a0e-45f2-9938-ef7e0f99463f service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:25.968681 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6034b7-5a0e-45f2-9938-ef7e0f99463f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:25.979965 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6034b7-5a0e-45f2-9938-ef7e0f99463f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:25.981564 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6034b7-5a0e-45f2-9938-ef7e0f99463f service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:25.996505 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1163/2304] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:31:25 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:31:26.039739 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e4980b-a472-4984-a49f-387e891e3838 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:26.138461 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e4980b-a472-4984-a49f-387e891e3838 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:26.144182 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09238bd-bd33-4cb4-a97a-b5aca7e9d86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:26.144873 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09238bd-bd33-4cb4-a97a-b5aca7e9d86e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:26.145333 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09238bd-bd33-4cb4-a97a-b5aca7e9d86e admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:26.145955 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09238bd-bd33-4cb4-a97a-b5aca7e9d86e admin admin] PATH_INFO: `/v3/users/04a41d99875b4794a9b2d68e4b842b46` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:26.148034 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09238bd-bd33-4cb4-a97a-b5aca7e9d86e admin admin] RBAC: Authorizing `identity:delete_user(user_id=04a41d99875b4794a9b2d68e4b842b46)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:26.150501 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09238bd-bd33-4cb4-a97a-b5aca7e9d86e admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:26.328993 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-c09238bd-bd33-4cb4-a97a-b5aca7e9d86e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04a41d99875b4794a9b2d68e4b842b46'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:26.359412 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-c09238bd-bd33-4cb4-a97a-b5aca7e9d86e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04a41d99875b4794a9b2d68e4b842b46'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:26.360307 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-c09238bd-bd33-4cb4-a97a-b5aca7e9d86e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04a41d99875b4794a9b2d68e4b842b46'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:26.364459 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-c09238bd-bd33-4cb4-a97a-b5aca7e9d86e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04a41d99875b4794a9b2d68e4b842b46'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:26.418673 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-c09238bd-bd33-4cb4-a97a-b5aca7e9d86e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04a41d99875b4794a9b2d68e4b842b46'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:26.497983 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1142/2305] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:31:26 2022] DELETE /identity/v3/users/04a41d99875b4794a9b2d68e4b842b46 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:31:26.503472 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d28a74-54ff-4aab-85cf-809f0141769c None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:26.504075 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d28a74-54ff-4aab-85cf-809f0141769c None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:26.504075 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d28a74-54ff-4aab-85cf-809f0141769c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:26.565040 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-52d28a74-54ff-4aab-85cf-809f0141769c None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:31:26.571294 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-52d28a74-54ff-4aab-85cf-809f0141769c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:26.654033 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1164/2306] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:31:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:31:26.664967 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09238bd-bd33-4cb4-a97a-b5aca7e9d86e admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:26.666491 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-c09238bd-bd33-4cb4-a97a-b5aca7e9d86e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:26.818460 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09238bd-bd33-4cb4-a97a-b5aca7e9d86e admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:26.850391 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55371a2e-0ec7-4e97-9f80-b0021c9a5b34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:26.851001 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55371a2e-0ec7-4e97-9f80-b0021c9a5b34 service neutron] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:26.851285 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55371a2e-0ec7-4e97-9f80-b0021c9a5b34 service neutron] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:26.851589 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55371a2e-0ec7-4e97-9f80-b0021c9a5b34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:26.882398 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55371a2e-0ec7-4e97-9f80-b0021c9a5b34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:26.884158 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55371a2e-0ec7-4e97-9f80-b0021c9a5b34 service neutron] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:26.901501 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1143/2307] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:31:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:31:27.184194 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77842d-295f-495f-b235-1ab30094e838 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:27.184723 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77842d-295f-495f-b235-1ab30094e838 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:27.184998 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77842d-295f-495f-b235-1ab30094e838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:27.314416 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-ab77842d-295f-495f-b235-1ab30094e838 None None] MFA Rules not processed for user `91bfcdadb42441538cd25b83c7143808`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:31:27.317787 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-ab77842d-295f-495f-b235-1ab30094e838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:27.624363 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1165/2308] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:31:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 438 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:31:27.625722 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55371a2e-0ec7-4e97-9f80-b0021c9a5b34 service neutron] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:27.627648 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-55371a2e-0ec7-4e97-9f80-b0021c9a5b34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:27.653688 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77842d-295f-495f-b235-1ab30094e838 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:27.655016 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-ab77842d-295f-495f-b235-1ab30094e838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:27.657445 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55371a2e-0ec7-4e97-9f80-b0021c9a5b34 service neutron] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:27.687505 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6746c6b4-75f9-4dbb-91bf-04deab10e855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:27.687505 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746c6b4-75f9-4dbb-91bf-04deab10e855 admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:27.689074 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746c6b4-75f9-4dbb-91bf-04deab10e855 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:27.689377 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746c6b4-75f9-4dbb-91bf-04deab10e855 admin admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:27.690037 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6746c6b4-75f9-4dbb-91bf-04deab10e855 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:27.709804 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6746c6b4-75f9-4dbb-91bf-04deab10e855 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:27.712569 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77842d-295f-495f-b235-1ab30094e838 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:27.735327 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9050fb3-6537-4b47-b728-9f5ade609ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:27.735957 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9050fb3-6537-4b47-b728-9f5ade609ab4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:27.736337 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9050fb3-6537-4b47-b728-9f5ade609ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:27.740422 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9050fb3-6537-4b47-b728-9f5ade609ab4 admin admin] PATH_INFO: `/v3/projects/a5a59fae91fc44c3936ad0fdf3d9e822` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:27.747584 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9050fb3-6537-4b47-b728-9f5ade609ab4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5a59fae91fc44c3936ad0fdf3d9e822)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:27.751325 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9050fb3-6537-4b47-b728-9f5ade609ab4 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:27.789909 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:31:27.811591 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1144/2309] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:31:27 2022] POST /identity/v3/projects => generated 369 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:31:27.815750 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6746c6b4-75f9-4dbb-91bf-04deab10e855 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:27.878150 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:31:27.886496 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e9050fb3-6537-4b47-b728-9f5ade609ab4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5a59fae91fc44c3936ad0fdf3d9e822', 'request_id': 'req-e9050fb3-6537-4b47-b728-9f5ade609ab4'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:27.910488 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e9050fb3-6537-4b47-b728-9f5ade609ab4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5a59fae91fc44c3936ad0fdf3d9e822', 'request_id': 'req-e9050fb3-6537-4b47-b728-9f5ade609ab4'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:27.945337 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e9050fb3-6537-4b47-b728-9f5ade609ab4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5a59fae91fc44c3936ad0fdf3d9e822', 'request_id': 'req-e9050fb3-6537-4b47-b728-9f5ade609ab4'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:28.009098 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e9050fb3-6537-4b47-b728-9f5ade609ab4 admin admin] The token cache is being invalidate because project a5a59fae91fc44c3936ad0fdf3d9e822 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:31:28.009612 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e9050fb3-6537-4b47-b728-9f5ade609ab4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:28.011837 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e9050fb3-6537-4b47-b728-9f5ade609ab4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:28.014425 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1166/2310] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:31:27 2022] DELETE /identity/v3/projects/a5a59fae91fc44c3936ad0fdf3d9e822 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:31:28.018800 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9050fb3-6537-4b47-b728-9f5ade609ab4 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:28.025319 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-e9050fb3-6537-4b47-b728-9f5ade609ab4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:28.050440 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6746c6b4-75f9-4dbb-91bf-04deab10e855 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:28.271305 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9050fb3-6537-4b47-b728-9f5ade609ab4 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:28.284610 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9543945-fdd4-4855-8c5d-8e554979ba74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:28.285558 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9543945-fdd4-4855-8c5d-8e554979ba74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:28.285849 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9543945-fdd4-4855-8c5d-8e554979ba74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:28.286230 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9543945-fdd4-4855-8c5d-8e554979ba74 admin admin] PATH_INFO: `/v3/users/0a6e57bc9cd64433baf30a844beeb1d7` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:28.288755 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9543945-fdd4-4855-8c5d-8e554979ba74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a6e57bc9cd64433baf30a844beeb1d7)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:28.293810 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9543945-fdd4-4855-8c5d-8e554979ba74 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:28.359582 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6396b596-6cb5-4c43-8fab-007ed0b6d83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:28.361290 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396b596-6cb5-4c43-8fab-007ed0b6d83c admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:28.362158 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396b596-6cb5-4c43-8fab-007ed0b6d83c admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:28.364074 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396b596-6cb5-4c43-8fab-007ed0b6d83c admin admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:28.365267 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6396b596-6cb5-4c43-8fab-007ed0b6d83c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:28.374490 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6396b596-6cb5-4c43-8fab-007ed0b6d83c admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:28.404967 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-b9543945-fdd4-4855-8c5d-8e554979ba74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a6e57bc9cd64433baf30a844beeb1d7'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:28.433879 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-b9543945-fdd4-4855-8c5d-8e554979ba74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a6e57bc9cd64433baf30a844beeb1d7'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:28.434546 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-b9543945-fdd4-4855-8c5d-8e554979ba74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a6e57bc9cd64433baf30a844beeb1d7'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:28.447086 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1145/2311] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:31:27 2022] POST /identity/v3/users => generated 291 bytes in 629 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:31:28.454419 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6396b596-6cb5-4c43-8fab-007ed0b6d83c admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:28.458431 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-6396b596-6cb5-4c43-8fab-007ed0b6d83c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:28.475640 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-b9543945-fdd4-4855-8c5d-8e554979ba74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a6e57bc9cd64433baf30a844beeb1d7'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:28.476442 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-b9543945-fdd4-4855-8c5d-8e554979ba74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a6e57bc9cd64433baf30a844beeb1d7'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:28.499622 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1167/2312] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:31:28 2022] DELETE /identity/v3/users/0a6e57bc9cd64433baf30a844beeb1d7 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:31:28.522155 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6396b596-6cb5-4c43-8fab-007ed0b6d83c admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:28.816518 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b2af28-68cb-4697-a276-1f2191473ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:28.818584 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2af28-68cb-4697-a276-1f2191473ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:28.819065 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2af28-68cb-4697-a276-1f2191473ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:28.820035 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2af28-68cb-4697-a276-1f2191473ec7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:28.821103 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b2af28-68cb-4697-a276-1f2191473ec7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:28.833950 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b2af28-68cb-4697-a276-1f2191473ec7 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:28.891626 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1146/2313] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 441 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:31:28.894118 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9543945-fdd4-4855-8c5d-8e554979ba74 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:28.901283 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-b9543945-fdd4-4855-8c5d-8e554979ba74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:28.945412 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9543945-fdd4-4855-8c5d-8e554979ba74 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:28.960279 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39bf8f1-5c57-4826-9303-1a493f8c4b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:28.961832 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39bf8f1-5c57-4826-9303-1a493f8c4b5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:28.962201 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39bf8f1-5c57-4826-9303-1a493f8c4b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:28.962673 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39bf8f1-5c57-4826-9303-1a493f8c4b5e admin admin] PATH_INFO: `/v3/projects/d2e6cdaf30c44018aa8c3eb77323da5b/users/6b718ad9162a43778ee997d4fa07c3f0/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:29.021300 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39bf8f1-5c57-4826-9303-1a493f8c4b5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2e6cdaf30c44018aa8c3eb77323da5b, user_id=6b718ad9162a43778ee997d4fa07c3f0, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:29.031900 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39bf8f1-5c57-4826-9303-1a493f8c4b5e admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:29.071712 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1168/2314] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:31:28 2022] PUT /identity/v3/projects/d2e6cdaf30c44018aa8c3eb77323da5b/users/6b718ad9162a43778ee997d4fa07c3f0/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:31:29.073068 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b2af28-68cb-4697-a276-1f2191473ec7 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:29.086570 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b2af28-68cb-4697-a276-1f2191473ec7 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:29.125181 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:31:29.177090 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d39df2-ceab-46f4-9dc0-2692096927b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:29.177836 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d39df2-ceab-46f4-9dc0-2692096927b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:29.178564 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d39df2-ceab-46f4-9dc0-2692096927b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:29.179552 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d39df2-ceab-46f4-9dc0-2692096927b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:29.180325 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d39df2-ceab-46f4-9dc0-2692096927b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:29.182159 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d39df2-ceab-46f4-9dc0-2692096927b8 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:29.195415 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1147/2315] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:31:29.200097 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39bf8f1-5c57-4826-9303-1a493f8c4b5e admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:29.238460 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39bf8f1-5c57-4826-9303-1a493f8c4b5e admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:29.262858 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b526a708-37d2-46ba-b8ce-ddb3073c97fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:29.263495 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526a708-37d2-46ba-b8ce-ddb3073c97fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:29.263783 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526a708-37d2-46ba-b8ce-ddb3073c97fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:29.264063 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526a708-37d2-46ba-b8ce-ddb3073c97fc admin admin] PATH_INFO: `/v3/projects/d2e6cdaf30c44018aa8c3eb77323da5b/users/6b718ad9162a43778ee997d4fa07c3f0/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:29.274855 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b526a708-37d2-46ba-b8ce-ddb3073c97fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2e6cdaf30c44018aa8c3eb77323da5b, user_id=6b718ad9162a43778ee997d4fa07c3f0, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:29.278301 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b526a708-37d2-46ba-b8ce-ddb3073c97fc admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:29.306382 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1169/2316] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:31:29 2022] PUT /identity/v3/projects/d2e6cdaf30c44018aa8c3eb77323da5b/users/6b718ad9162a43778ee997d4fa07c3f0/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:31:29.780991 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d39df2-ceab-46f4-9dc0-2692096927b8 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:29.783764 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-72d39df2-ceab-46f4-9dc0-2692096927b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:29.810192 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d39df2-ceab-46f4-9dc0-2692096927b8 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:30.001229 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f580a85-0bc0-435f-b68f-7d49d23042b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:30.002649 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f580a85-0bc0-435f-b68f-7d49d23042b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:30.003773 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f580a85-0bc0-435f-b68f-7d49d23042b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:30.005629 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f580a85-0bc0-435f-b68f-7d49d23042b8 admin admin] PATH_INFO: `/v3/projects/99551ddaf0c248d59bdfb3f32ad6e2b1` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:30.012279 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f580a85-0bc0-435f-b68f-7d49d23042b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99551ddaf0c248d59bdfb3f32ad6e2b1)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:30.016336 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f580a85-0bc0-435f-b68f-7d49d23042b8 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:30.139583 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-6f580a85-0bc0-435f-b68f-7d49d23042b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99551ddaf0c248d59bdfb3f32ad6e2b1', 'request_id': 'req-6f580a85-0bc0-435f-b68f-7d49d23042b8'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:30.149450 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-6f580a85-0bc0-435f-b68f-7d49d23042b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99551ddaf0c248d59bdfb3f32ad6e2b1', 'request_id': 'req-6f580a85-0bc0-435f-b68f-7d49d23042b8'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:30.180504 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-6f580a85-0bc0-435f-b68f-7d49d23042b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99551ddaf0c248d59bdfb3f32ad6e2b1', 'request_id': 'req-6f580a85-0bc0-435f-b68f-7d49d23042b8'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:30.205366 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-6f580a85-0bc0-435f-b68f-7d49d23042b8 admin admin] The token cache is being invalidate because project 99551ddaf0c248d59bdfb3f32ad6e2b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81447) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:31:30.205841 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-6f580a85-0bc0-435f-b68f-7d49d23042b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:30.207716 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-6f580a85-0bc0-435f-b68f-7d49d23042b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:30.218572 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1148/2317] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:31:29 2022] DELETE /identity/v3/projects/99551ddaf0c248d59bdfb3f32ad6e2b1 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:31:30.221184 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d6329-7c9a-46f7-8cf0-230423936757 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:30.222235 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d6329-7c9a-46f7-8cf0-230423936757 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:30.222718 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d6329-7c9a-46f7-8cf0-230423936757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:30.265129 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-a13d6329-7c9a-46f7-8cf0-230423936757 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:31:30.267633 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-a13d6329-7c9a-46f7-8cf0-230423936757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:30.290470 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=82,keystone:DELETE=14,keystone:INSERT=4 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:31:30.543178 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db232fa3-cf34-4141-87d4-ee8600776a36 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:30.543350 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1170/2318] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:31:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:31:30.544371 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db232fa3-cf34-4141-87d4-ee8600776a36 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:30.544885 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db232fa3-cf34-4141-87d4-ee8600776a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:30.612677 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-db232fa3-cf34-4141-87d4-ee8600776a36 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:31:30.615112 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-db232fa3-cf34-4141-87d4-ee8600776a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:30.636326 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13d6329-7c9a-46f7-8cf0-230423936757 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:30.636550 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1149/2319] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:31:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:31:30.654752 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13d6329-7c9a-46f7-8cf0-230423936757 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:30.666499 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f51be91-408f-404c-ad8d-90c93db6c605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:30.667123 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51be91-408f-404c-ad8d-90c93db6c605 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:30.667636 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51be91-408f-404c-ad8d-90c93db6c605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:30.668085 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51be91-408f-404c-ad8d-90c93db6c605 admin admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:30.668911 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f51be91-408f-404c-ad8d-90c93db6c605 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:31:30.674491 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f51be91-408f-404c-ad8d-90c93db6c605 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:30.676362 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f51be91-408f-404c-ad8d-90c93db6c605 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:30.703451 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1171/2320] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 30 01:31:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:31:30.709450 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db232fa3-cf34-4141-87d4-ee8600776a36 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:30.720604 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db232fa3-cf34-4141-87d4-ee8600776a36 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:30.729196 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4549ce-6a53-4a18-96a3-73b1d5c6f4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:30.729946 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4549ce-6a53-4a18-96a3-73b1d5c6f4e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:30.730323 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4549ce-6a53-4a18-96a3-73b1d5c6f4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:30.730692 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4549ce-6a53-4a18-96a3-73b1d5c6f4e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:30.731476 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4549ce-6a53-4a18-96a3-73b1d5c6f4e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:30.736412 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4549ce-6a53-4a18-96a3-73b1d5c6f4e9 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:30.774851 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1150/2321] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:31:30 2022] POST /identity/v3/projects => generated 409 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:31:30.779889 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f51be91-408f-404c-ad8d-90c93db6c605 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:30.800879 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f51be91-408f-404c-ad8d-90c93db6c605 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:30.884132 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af27f3-f47b-4fc0-82be-fffd28badbd2 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:30.884415 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af27f3-f47b-4fc0-82be-fffd28badbd2 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:30.884750 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af27f3-f47b-4fc0-82be-fffd28badbd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:30.935728 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-76af27f3-f47b-4fc0-82be-fffd28badbd2 None None] MFA Rules not processed for user `a991f1a0f804497c91d21d69e33113ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:31:30.937302 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-76af27f3-f47b-4fc0-82be-fffd28badbd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:31.004539 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a27a0-9d75-4cb4-9c4b-a4bcb393a59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:31.006476 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a27a0-9d75-4cb4-9c4b-a4bcb393a59c admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:31.008771 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a27a0-9d75-4cb4-9c4b-a4bcb393a59c admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:31.009063 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a27a0-9d75-4cb4-9c4b-a4bcb393a59c admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:31.012670 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658a27a0-9d75-4cb4-9c4b-a4bcb393a59c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:31.019533 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658a27a0-9d75-4cb4-9c4b-a4bcb393a59c admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:31.033329 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:31:31.083947 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1172/2322] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:31:30 2022] POST /identity/v3/users => generated 305 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:31:31.086078 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a27a0-9d75-4cb4-9c4b-a4bcb393a59c admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:31.107228 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1151/2323] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:31:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:31:31.116723 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a27a0-9d75-4cb4-9c4b-a4bcb393a59c admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:31.133139 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fc3e9a-c90f-4281-80f0-34b05dfcf746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:31.133959 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc3e9a-c90f-4281-80f0-34b05dfcf746 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:31.134243 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc3e9a-c90f-4281-80f0-34b05dfcf746 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:31.134515 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc3e9a-c90f-4281-80f0-34b05dfcf746 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:31.135180 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fc3e9a-c90f-4281-80f0-34b05dfcf746 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:31.144530 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fc3e9a-c90f-4281-80f0-34b05dfcf746 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:31.176425 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1173/2324] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:31:31.182245 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af27f3-f47b-4fc0-82be-fffd28badbd2 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:31.224557 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af27f3-f47b-4fc0-82be-fffd28badbd2 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:31.251406 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aca2c88-2dc6-4d16-8f54-b650d832631c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:31.258893 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca2c88-2dc6-4d16-8f54-b650d832631c admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:31.261933 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca2c88-2dc6-4d16-8f54-b650d832631c admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:31.262557 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca2c88-2dc6-4d16-8f54-b650d832631c admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:31.263702 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aca2c88-2dc6-4d16-8f54-b650d832631c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:31.269078 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aca2c88-2dc6-4d16-8f54-b650d832631c admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:31.294864 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1152/2325] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:31:31.295250 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fc3e9a-c90f-4281-80f0-34b05dfcf746 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:31.315542 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fc3e9a-c90f-4281-80f0-34b05dfcf746 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:31.322955 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cef016-c412-4992-a00c-e0c589b997b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:31.324192 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cef016-c412-4992-a00c-e0c589b997b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:31.324788 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cef016-c412-4992-a00c-e0c589b997b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:31.326016 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cef016-c412-4992-a00c-e0c589b997b1 admin admin] PATH_INFO: `/v3/projects/cfefacc7251641feb134d79a966b5d61/users/54b7518585df43f0ae4e070aaa22a4ad/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:31.350346 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cef016-c412-4992-a00c-e0c589b997b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfefacc7251641feb134d79a966b5d61, user_id=54b7518585df43f0ae4e070aaa22a4ad, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:31.353941 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cef016-c412-4992-a00c-e0c589b997b1 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:31.390218 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1174/2326] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:31:31 2022] PUT /identity/v3/projects/cfefacc7251641feb134d79a966b5d61/users/54b7518585df43f0ae4e070aaa22a4ad/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:31:31.402440 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa73fa-f824-47b4-89f8-906c079816da None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:31.402730 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa73fa-f824-47b4-89f8-906c079816da None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:31.403181 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa73fa-f824-47b4-89f8-906c079816da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:31.451682 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-47fa73fa-f824-47b4-89f8-906c079816da None None] MFA Rules not processed for user `54b7518585df43f0ae4e070aaa22a4ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:31:31.455567 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-47fa73fa-f824-47b4-89f8-906c079816da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:31.571347 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1153/2327] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:31:31 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:31:31.576835 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cef016-c412-4992-a00c-e0c589b997b1 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:31.778247 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:31:31.793744 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cef016-c412-4992-a00c-e0c589b997b1 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:31.809044 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eef319-dd35-4db3-8a7a-3da7c043dbbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:31.810674 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eef319-dd35-4db3-8a7a-3da7c043dbbd admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:31.811352 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eef319-dd35-4db3-8a7a-3da7c043dbbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:31.812950 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eef319-dd35-4db3-8a7a-3da7c043dbbd admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:31.814537 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eef319-dd35-4db3-8a7a-3da7c043dbbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:31.823225 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eef319-dd35-4db3-8a7a-3da7c043dbbd admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:31.890502 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fa73fa-f824-47b4-89f8-906c079816da None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:31.893361 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1175/2328] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:31:31 2022] POST /identity/v3/projects => generated 407 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:31:31.949740 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fa73fa-f824-47b4-89f8-906c079816da None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:32.149118 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc11247f-d776-4211-b5e7-3a9aeeccee2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:32.149798 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11247f-d776-4211-b5e7-3a9aeeccee2d admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:32.151130 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11247f-d776-4211-b5e7-3a9aeeccee2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:32.151408 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11247f-d776-4211-b5e7-3a9aeeccee2d admin admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:32.153347 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc11247f-d776-4211-b5e7-3a9aeeccee2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:32.160548 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc11247f-d776-4211-b5e7-3a9aeeccee2d admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:32.214000 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1154/2329] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:31:31 2022] POST /identity/v3/users => generated 310 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:31:32.217985 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eef319-dd35-4db3-8a7a-3da7c043dbbd admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:32.241586 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eef319-dd35-4db3-8a7a-3da7c043dbbd admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:32.280313 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7b37af-1405-41f3-b4f8-f3ad0d074f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:32.281301 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b37af-1405-41f3-b4f8-f3ad0d074f62 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:32.281847 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b37af-1405-41f3-b4f8-f3ad0d074f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:32.282270 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b37af-1405-41f3-b4f8-f3ad0d074f62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:32.284275 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7b37af-1405-41f3-b4f8-f3ad0d074f62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:32.293042 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7b37af-1405-41f3-b4f8-f3ad0d074f62 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:32.346131 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1176/2330] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:31:32 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:31:32.349699 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc11247f-d776-4211-b5e7-3a9aeeccee2d admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:32.375708 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc11247f-d776-4211-b5e7-3a9aeeccee2d admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:32.401345 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e101a07-4780-4918-acaf-9e708cf51612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:32.404581 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e101a07-4780-4918-acaf-9e708cf51612 admin admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:32.405783 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e101a07-4780-4918-acaf-9e708cf51612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:32.408251 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e101a07-4780-4918-acaf-9e708cf51612 admin admin] PATH_INFO: `/v3/projects/d8071cbe4e2241e58ee37188c3205c50/users/ba4a35cf501b4341afb6a82144d036cf/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:32.448441 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e101a07-4780-4918-acaf-9e708cf51612 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8071cbe4e2241e58ee37188c3205c50, user_id=ba4a35cf501b4341afb6a82144d036cf, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:32.452095 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e101a07-4780-4918-acaf-9e708cf51612 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:32.478807 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1155/2331] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:31:32 2022] PUT /identity/v3/projects/d8071cbe4e2241e58ee37188c3205c50/users/ba4a35cf501b4341afb6a82144d036cf/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:31:32.483363 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7b37af-1405-41f3-b4f8-f3ad0d074f62 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:32.510114 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7b37af-1405-41f3-b4f8-f3ad0d074f62 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:32.684884 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e91a3e-b030-47d9-91aa-8accb75ea8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:32.685849 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e91a3e-b030-47d9-91aa-8accb75ea8cd admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:32.687651 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e91a3e-b030-47d9-91aa-8accb75ea8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:32.688088 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e91a3e-b030-47d9-91aa-8accb75ea8cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:32.689577 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e91a3e-b030-47d9-91aa-8accb75ea8cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:32.693176 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e91a3e-b030-47d9-91aa-8accb75ea8cd admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:32.721037 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1177/2332] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:31:32 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:31:32.724384 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e101a07-4780-4918-acaf-9e708cf51612 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:32.742156 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e101a07-4780-4918-acaf-9e708cf51612 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:32.757184 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b4097e-2997-4d7d-96d4-32131f9222c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:32.758205 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b4097e-2997-4d7d-96d4-32131f9222c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:32.758525 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b4097e-2997-4d7d-96d4-32131f9222c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:32.758872 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b4097e-2997-4d7d-96d4-32131f9222c6 admin admin] PATH_INFO: `/v3/projects/d8071cbe4e2241e58ee37188c3205c50/users/ba4a35cf501b4341afb6a82144d036cf/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:32.763100 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b4097e-2997-4d7d-96d4-32131f9222c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8071cbe4e2241e58ee37188c3205c50, user_id=ba4a35cf501b4341afb6a82144d036cf, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:32.770708 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b4097e-2997-4d7d-96d4-32131f9222c6 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:32.807630 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1156/2333] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:31:32 2022] PUT /identity/v3/projects/d8071cbe4e2241e58ee37188c3205c50/users/ba4a35cf501b4341afb6a82144d036cf/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:31:32.812561 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d930750-0687-4c98-b78c-25a892b8d96f None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:32.813144 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d930750-0687-4c98-b78c-25a892b8d96f None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:32.813490 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d930750-0687-4c98-b78c-25a892b8d96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:32.889074 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-7d930750-0687-4c98-b78c-25a892b8d96f None None] MFA Rules not processed for user `ba4a35cf501b4341afb6a82144d036cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:31:32.890653 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-7d930750-0687-4c98-b78c-25a892b8d96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:33.079155 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1178/2334] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:31:32 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:31:33.091825 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b4097e-2997-4d7d-96d4-32131f9222c6 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:33.093982 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-d3b4097e-2997-4d7d-96d4-32131f9222c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:33.132651 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:31:33.393616 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b4097e-2997-4d7d-96d4-32131f9222c6 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:33.406745 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7749368-7993-4621-9ee6-efe5ce0bdff8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:33.410121 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7749368-7993-4621-9ee6-efe5ce0bdff8 service cinder] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:33.413271 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7749368-7993-4621-9ee6-efe5ce0bdff8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:33.413831 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7749368-7993-4621-9ee6-efe5ce0bdff8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:33.459280 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7749368-7993-4621-9ee6-efe5ce0bdff8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:33.468023 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7749368-7993-4621-9ee6-efe5ce0bdff8 service cinder] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:33.508729 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d930750-0687-4c98-b78c-25a892b8d96f None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:33.510370 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-7d930750-0687-4c98-b78c-25a892b8d96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:33.531055 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1157/2335] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:31:33 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:31:33.803024 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:31:33.864751 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d930750-0687-4c98-b78c-25a892b8d96f None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:33.895946 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa3b8e9-19cb-4b11-9abf-4e851bc9483c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:33.916133 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa3b8e9-19cb-4b11-9abf-4e851bc9483c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:33.929279 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa3b8e9-19cb-4b11-9abf-4e851bc9483c admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:33.929279 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa3b8e9-19cb-4b11-9abf-4e851bc9483c admin admin] PATH_INFO: `/v3/users/f452ddb0bc1b47f89dc4d659c385b536` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:33.939209 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa3b8e9-19cb-4b11-9abf-4e851bc9483c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f452ddb0bc1b47f89dc4d659c385b536)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:33.943454 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa3b8e9-19cb-4b11-9abf-4e851bc9483c admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:34.053932 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7749368-7993-4621-9ee6-efe5ce0bdff8 service cinder] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:34.063678 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7749368-7993-4621-9ee6-efe5ce0bdff8 service cinder] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:34.093298 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6067e08-5332-4a32-949f-80d70e68351a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:34.094344 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6067e08-5332-4a32-949f-80d70e68351a service cinder] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:34.095253 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6067e08-5332-4a32-949f-80d70e68351a service cinder] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:34.096077 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6067e08-5332-4a32-949f-80d70e68351a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:34.216992 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-3aa3b8e9-19cb-4b11-9abf-4e851bc9483c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f452ddb0bc1b47f89dc4d659c385b536'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:34.260535 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-3aa3b8e9-19cb-4b11-9abf-4e851bc9483c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f452ddb0bc1b47f89dc4d659c385b536'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:34.261864 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-3aa3b8e9-19cb-4b11-9abf-4e851bc9483c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f452ddb0bc1b47f89dc4d659c385b536'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:34.299077 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6067e08-5332-4a32-949f-80d70e68351a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:34.301003 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6067e08-5332-4a32-949f-80d70e68351a service cinder] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:34.321315 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-3aa3b8e9-19cb-4b11-9abf-4e851bc9483c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f452ddb0bc1b47f89dc4d659c385b536'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:34.324327 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-3aa3b8e9-19cb-4b11-9abf-4e851bc9483c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f452ddb0bc1b47f89dc4d659c385b536'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:34.342028 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1158/2336] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:31:34 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:31:34.382055 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1179/2337] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:31:33 2022] DELETE /identity/v3/users/f452ddb0bc1b47f89dc4d659c385b536 => generated 0 bytes in 874 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:31:34.387087 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c7349-d107-418d-b3f1-3fc311ba971d None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:34.387589 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c7349-d107-418d-b3f1-3fc311ba971d None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:34.388159 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c7349-d107-418d-b3f1-3fc311ba971d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:34.440169 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-636c7349-d107-418d-b3f1-3fc311ba971d None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:31:34.448451 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-636c7349-d107-418d-b3f1-3fc311ba971d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:34.713026 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1159/2338] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:31:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:31:34.739983 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa3b8e9-19cb-4b11-9abf-4e851bc9483c admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:34.742284 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-3aa3b8e9-19cb-4b11-9abf-4e851bc9483c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:34.963097 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa3b8e9-19cb-4b11-9abf-4e851bc9483c admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:34.974348 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6551ebbb-c707-42ad-95e2-db4f1b259a89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:34.976095 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6551ebbb-c707-42ad-95e2-db4f1b259a89 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:34.976576 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6551ebbb-c707-42ad-95e2-db4f1b259a89 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:34.977018 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6551ebbb-c707-42ad-95e2-db4f1b259a89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:35.028988 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6551ebbb-c707-42ad-95e2-db4f1b259a89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:35.031813 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6551ebbb-c707-42ad-95e2-db4f1b259a89 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:35.073477 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1180/2339] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:31:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:31:35.878896 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636c7349-d107-418d-b3f1-3fc311ba971d None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:35.881644 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-636c7349-d107-418d-b3f1-3fc311ba971d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:35.901348 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636c7349-d107-418d-b3f1-3fc311ba971d None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:35.911070 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe997b75-8570-497a-a0df-4839fccae5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:35.912291 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe997b75-8570-497a-a0df-4839fccae5e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:35.913316 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe997b75-8570-497a-a0df-4839fccae5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:35.913776 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe997b75-8570-497a-a0df-4839fccae5e6 admin admin] PATH_INFO: `/v3/projects/d983a79e54e54c82bdb8670a7bc980ff` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:35.917297 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe997b75-8570-497a-a0df-4839fccae5e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d983a79e54e54c82bdb8670a7bc980ff)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:35.924614 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe997b75-8570-497a-a0df-4839fccae5e6 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:36.024073 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:31:36.049728 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-fe997b75-8570-497a-a0df-4839fccae5e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd983a79e54e54c82bdb8670a7bc980ff', 'request_id': 'req-fe997b75-8570-497a-a0df-4839fccae5e6'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:36.068530 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-fe997b75-8570-497a-a0df-4839fccae5e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd983a79e54e54c82bdb8670a7bc980ff', 'request_id': 'req-fe997b75-8570-497a-a0df-4839fccae5e6'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:36.085638 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-fe997b75-8570-497a-a0df-4839fccae5e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd983a79e54e54c82bdb8670a7bc980ff', 'request_id': 'req-fe997b75-8570-497a-a0df-4839fccae5e6'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:36.113007 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-fe997b75-8570-497a-a0df-4839fccae5e6 admin admin] The token cache is being invalidate because project d983a79e54e54c82bdb8670a7bc980ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81447) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:31:36.113746 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-fe997b75-8570-497a-a0df-4839fccae5e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:36.115748 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-fe997b75-8570-497a-a0df-4839fccae5e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:36.119032 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1160/2340] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:31:35 2022] DELETE /identity/v3/projects/d983a79e54e54c82bdb8670a7bc980ff => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:31:38.948428 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6551ebbb-c707-42ad-95e2-db4f1b259a89 service neutron] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:38.951660 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-6551ebbb-c707-42ad-95e2-db4f1b259a89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:38.976732 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6551ebbb-c707-42ad-95e2-db4f1b259a89 service neutron] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:39.058754 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a8d47-4d5a-4fc5-8dcc-6b0e900fe33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:39.059460 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a8d47-4d5a-4fc5-8dcc-6b0e900fe33a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:39.059826 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a8d47-4d5a-4fc5-8dcc-6b0e900fe33a admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:39.060171 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a8d47-4d5a-4fc5-8dcc-6b0e900fe33a admin admin] PATH_INFO: `/v3/users/8175e3515b944c2ca9529df67793673e` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:39.063105 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7a8d47-4d5a-4fc5-8dcc-6b0e900fe33a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8175e3515b944c2ca9529df67793673e)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:39.065780 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7a8d47-4d5a-4fc5-8dcc-6b0e900fe33a admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:39.092918 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:31:39.166054 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-9e7a8d47-4d5a-4fc5-8dcc-6b0e900fe33a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8175e3515b944c2ca9529df67793673e'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:39.181768 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-9e7a8d47-4d5a-4fc5-8dcc-6b0e900fe33a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8175e3515b944c2ca9529df67793673e'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:39.183364 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-9e7a8d47-4d5a-4fc5-8dcc-6b0e900fe33a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8175e3515b944c2ca9529df67793673e'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:39.203027 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-9e7a8d47-4d5a-4fc5-8dcc-6b0e900fe33a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8175e3515b944c2ca9529df67793673e'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:39.204098 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-9e7a8d47-4d5a-4fc5-8dcc-6b0e900fe33a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8175e3515b944c2ca9529df67793673e'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:39.234746 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1181/2341] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:31:38 2022] DELETE /identity/v3/users/8175e3515b944c2ca9529df67793673e => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:31:39.236788 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec594ab-655c-4eca-a46e-519859cfc049 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:39.237238 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec594ab-655c-4eca-a46e-519859cfc049 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:39.237326 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec594ab-655c-4eca-a46e-519859cfc049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:39.281449 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-8ec594ab-655c-4eca-a46e-519859cfc049 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:31:39.282933 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-8ec594ab-655c-4eca-a46e-519859cfc049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:39.421969 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1161/2342] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:31:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:31:39.448509 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a8d47-4d5a-4fc5-8dcc-6b0e900fe33a admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:39.449435 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-9e7a8d47-4d5a-4fc5-8dcc-6b0e900fe33a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:39.561934 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a8d47-4d5a-4fc5-8dcc-6b0e900fe33a admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:39.572032 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd163b-e415-4a0d-83d3-df0ce1364723 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:39.573365 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd163b-e415-4a0d-83d3-df0ce1364723 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:39.573667 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd163b-e415-4a0d-83d3-df0ce1364723 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:39.573979 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd163b-e415-4a0d-83d3-df0ce1364723 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:39.590550 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd163b-e415-4a0d-83d3-df0ce1364723 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:39.592625 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd163b-e415-4a0d-83d3-df0ce1364723 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:39.605597 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1182/2343] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:31:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:31:40.867117 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec594ab-655c-4eca-a46e-519859cfc049 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:40.868790 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-8ec594ab-655c-4eca-a46e-519859cfc049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:40.885617 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec594ab-655c-4eca-a46e-519859cfc049 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:40.897960 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d051a4-220b-4a71-b380-c68b2a4dc0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:40.899250 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d051a4-220b-4a71-b380-c68b2a4dc0be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:40.899859 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d051a4-220b-4a71-b380-c68b2a4dc0be admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:40.900368 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d051a4-220b-4a71-b380-c68b2a4dc0be admin admin] PATH_INFO: `/v3/projects/43b15cc3cdde4ebaa5fdf4de94428c85` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:40.901988 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d051a4-220b-4a71-b380-c68b2a4dc0be admin admin] RBAC: Authorizing `identity:delete_project(project_id=43b15cc3cdde4ebaa5fdf4de94428c85)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:40.904234 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d051a4-220b-4a71-b380-c68b2a4dc0be admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:41.074776 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-e5d051a4-220b-4a71-b380-c68b2a4dc0be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43b15cc3cdde4ebaa5fdf4de94428c85', 'request_id': 'req-e5d051a4-220b-4a71-b380-c68b2a4dc0be'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:41.099664 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-e5d051a4-220b-4a71-b380-c68b2a4dc0be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43b15cc3cdde4ebaa5fdf4de94428c85', 'request_id': 'req-e5d051a4-220b-4a71-b380-c68b2a4dc0be'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:41.113381 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-e5d051a4-220b-4a71-b380-c68b2a4dc0be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43b15cc3cdde4ebaa5fdf4de94428c85', 'request_id': 'req-e5d051a4-220b-4a71-b380-c68b2a4dc0be'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:41.150734 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-e5d051a4-220b-4a71-b380-c68b2a4dc0be admin admin] The token cache is being invalidate because project 43b15cc3cdde4ebaa5fdf4de94428c85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81447) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:31:41.151276 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-e5d051a4-220b-4a71-b380-c68b2a4dc0be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:41.155677 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-e5d051a4-220b-4a71-b380-c68b2a4dc0be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:41.158218 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1162/2344] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:31:40 2022] DELETE /identity/v3/projects/43b15cc3cdde4ebaa5fdf4de94428c85 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:31:41.164289 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4f4a7-920c-43b3-a8ae-230c6a21439a None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:41.165487 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4f4a7-920c-43b3-a8ae-230c6a21439a None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:41.165487 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4f4a7-920c-43b3-a8ae-230c6a21439a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:41.245658 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-ebc4f4a7-920c-43b3-a8ae-230c6a21439a None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:31:41.248411 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-ebc4f4a7-920c-43b3-a8ae-230c6a21439a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:41.428437 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1183/2345] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:31:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:31:41.436762 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717bf8a6-02ab-4221-97e0-597ab28786fe None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:41.437308 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717bf8a6-02ab-4221-97e0-597ab28786fe None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:41.437752 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717bf8a6-02ab-4221-97e0-597ab28786fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:41.510766 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-717bf8a6-02ab-4221-97e0-597ab28786fe None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:31:41.512091 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-717bf8a6-02ab-4221-97e0-597ab28786fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:41.538419 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1163/2346] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:31:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:31:41.540286 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc4f4a7-920c-43b3-a8ae-230c6a21439a None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:41.559383 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc4f4a7-920c-43b3-a8ae-230c6a21439a None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:41.587091 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2c5f99-4080-4b83-bab3-7bfe14673830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:41.594567 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c5f99-4080-4b83-bab3-7bfe14673830 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:41.607318 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c5f99-4080-4b83-bab3-7bfe14673830 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:41.607762 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c5f99-4080-4b83-bab3-7bfe14673830 admin admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:41.608481 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2c5f99-4080-4b83-bab3-7bfe14673830 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:31:41.608795 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2c5f99-4080-4b83-bab3-7bfe14673830 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:41.610489 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2c5f99-4080-4b83-bab3-7bfe14673830 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:41.660619 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1184/2347] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 30 01:31:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:31:41.661345 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717bf8a6-02ab-4221-97e0-597ab28786fe None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:41.685869 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717bf8a6-02ab-4221-97e0-597ab28786fe None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:41.704700 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0734ca2f-ee9b-4535-99c1-9fa649b28e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:41.705342 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0734ca2f-ee9b-4535-99c1-9fa649b28e4c admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:41.705683 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0734ca2f-ee9b-4535-99c1-9fa649b28e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:41.705959 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0734ca2f-ee9b-4535-99c1-9fa649b28e4c admin admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:41.706623 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0734ca2f-ee9b-4535-99c1-9fa649b28e4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:41.714224 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0734ca2f-ee9b-4535-99c1-9fa649b28e4c admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:41.793111 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2c5f99-4080-4b83-bab3-7bfe14673830 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:41.795862 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-bb2c5f99-4080-4b83-bab3-7bfe14673830 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:41.796501 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1164/2348] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:31:41 2022] POST /identity/v3/projects => generated 395 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:31:41.800518 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0734ca2f-ee9b-4535-99c1-9fa649b28e4c admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:41.826031 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2c5f99-4080-4b83-bab3-7bfe14673830 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:41.852497 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:31:41.853585 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:31:41.918792 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0734ca2f-ee9b-4535-99c1-9fa649b28e4c admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:41.926255 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d345c22-30b1-47e8-86f1-a69bc15a1d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:41.926961 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d345c22-30b1-47e8-86f1-a69bc15a1d05 admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:41.927349 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d345c22-30b1-47e8-86f1-a69bc15a1d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:41.928028 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d345c22-30b1-47e8-86f1-a69bc15a1d05 admin admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:41.929948 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d345c22-30b1-47e8-86f1-a69bc15a1d05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:41.935551 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d345c22-30b1-47e8-86f1-a69bc15a1d05 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:41.962628 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ca0c0-71cb-4cc8-9ae4-6bcaab69b495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:41.964176 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ca0c0-71cb-4cc8-9ae4-6bcaab69b495 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:41.966318 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ca0c0-71cb-4cc8-9ae4-6bcaab69b495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:41.966786 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ca0c0-71cb-4cc8-9ae4-6bcaab69b495 admin admin] PATH_INFO: `/v3/users/54b7518585df43f0ae4e070aaa22a4ad` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:41.970317 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51ca0c0-71cb-4cc8-9ae4-6bcaab69b495 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54b7518585df43f0ae4e070aaa22a4ad)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:41.976826 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51ca0c0-71cb-4cc8-9ae4-6bcaab69b495 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:41.989930 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1165/2349] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:31:41 2022] POST /identity/v3/users => generated 298 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:31:41.993903 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d345c22-30b1-47e8-86f1-a69bc15a1d05 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:42.044650 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d345c22-30b1-47e8-86f1-a69bc15a1d05 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:42.076825 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b61a57-4ba9-48d2-b99d-aa8837e74a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:42.080550 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b61a57-4ba9-48d2-b99d-aa8837e74a3e admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:42.080865 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b61a57-4ba9-48d2-b99d-aa8837e74a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:42.086428 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b61a57-4ba9-48d2-b99d-aa8837e74a3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:42.090505 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b61a57-4ba9-48d2-b99d-aa8837e74a3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:42.095113 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b61a57-4ba9-48d2-b99d-aa8837e74a3e admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:42.208749 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1166/2350] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:31:41 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:31:42.221810 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b61a57-4ba9-48d2-b99d-aa8837e74a3e admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:42.253648 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b61a57-4ba9-48d2-b99d-aa8837e74a3e admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:42.273143 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db5b3f8-0bd3-42b8-9205-e9d73631fe64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:42.274526 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5b3f8-0bd3-42b8-9205-e9d73631fe64 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:42.274715 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5b3f8-0bd3-42b8-9205-e9d73631fe64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:42.274981 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5b3f8-0bd3-42b8-9205-e9d73631fe64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:42.275739 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db5b3f8-0bd3-42b8-9205-e9d73631fe64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:42.277528 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db5b3f8-0bd3-42b8-9205-e9d73631fe64 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:42.284542 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e51ca0c0-71cb-4cc8-9ae4-6bcaab69b495 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54b7518585df43f0ae4e070aaa22a4ad'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:42.301638 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1167/2351] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:31:42 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:31:42.305964 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db5b3f8-0bd3-42b8-9205-e9d73631fe64 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:42.328373 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db5b3f8-0bd3-42b8-9205-e9d73631fe64 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:42.330337 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e51ca0c0-71cb-4cc8-9ae4-6bcaab69b495 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54b7518585df43f0ae4e070aaa22a4ad'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:42.331826 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e51ca0c0-71cb-4cc8-9ae4-6bcaab69b495 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54b7518585df43f0ae4e070aaa22a4ad'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:42.340217 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fc0a71-8af7-46fb-b14f-b16d5d586c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:42.340896 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc0a71-8af7-46fb-b14f-b16d5d586c1a admin admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:42.341169 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc0a71-8af7-46fb-b14f-b16d5d586c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:42.341435 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc0a71-8af7-46fb-b14f-b16d5d586c1a admin admin] PATH_INFO: `/v3/projects/2225a59df4474a67a1f78362fca3e890/users/af8d83b02a294109805a6640d21828c8/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:42.380169 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e51ca0c0-71cb-4cc8-9ae4-6bcaab69b495 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54b7518585df43f0ae4e070aaa22a4ad'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:42.381493 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e51ca0c0-71cb-4cc8-9ae4-6bcaab69b495 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54b7518585df43f0ae4e070aaa22a4ad'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:42.384802 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fc0a71-8af7-46fb-b14f-b16d5d586c1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2225a59df4474a67a1f78362fca3e890, user_id=af8d83b02a294109805a6640d21828c8, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:42.388806 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fc0a71-8af7-46fb-b14f-b16d5d586c1a admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:42.421234 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1168/2352] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:31:42 2022] PUT /identity/v3/projects/2225a59df4474a67a1f78362fca3e890/users/af8d83b02a294109805a6640d21828c8/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:31:42.431919 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd14f66-c29a-4e77-a1fd-e51357c01e85 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:42.432263 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd14f66-c29a-4e77-a1fd-e51357c01e85 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:42.432556 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd14f66-c29a-4e77-a1fd-e51357c01e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:42.443043 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1185/2353] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:31:41 2022] DELETE /identity/v3/users/54b7518585df43f0ae4e070aaa22a4ad => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:31:42.447288 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7d329-17a2-43ff-9381-bc6cf767a2d6 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:42.447611 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7d329-17a2-43ff-9381-bc6cf767a2d6 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:42.447890 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7d329-17a2-43ff-9381-bc6cf767a2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:42.488503 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-dcd14f66-c29a-4e77-a1fd-e51357c01e85 None None] MFA Rules not processed for user `af8d83b02a294109805a6640d21828c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:31:42.492220 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-dcd14f66-c29a-4e77-a1fd-e51357c01e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:42.493422 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-c1b7d329-17a2-43ff-9381-bc6cf767a2d6 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:31:42.494628 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-c1b7d329-17a2-43ff-9381-bc6cf767a2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:42.684969 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1169/2354] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:31:42 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:31:42.699110 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd14f66-c29a-4e77-a1fd-e51357c01e85 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:42.702541 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-dcd14f66-c29a-4e77-a1fd-e51357c01e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:42.770400 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1186/2355] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:31:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:31:42.781313 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b7d329-17a2-43ff-9381-bc6cf767a2d6 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:42.785563 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-c1b7d329-17a2-43ff-9381-bc6cf767a2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:42.884684 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd14f66-c29a-4e77-a1fd-e51357c01e85 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:42.899632 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9203f7-6ab0-4c7f-b834-06a7d38767c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:42.900273 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9203f7-6ab0-4c7f-b834-06a7d38767c3 service cinder] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:42.900706 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9203f7-6ab0-4c7f-b834-06a7d38767c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:42.900898 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9203f7-6ab0-4c7f-b834-06a7d38767c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:42.919385 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9203f7-6ab0-4c7f-b834-06a7d38767c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:42.922601 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:31:42.927264 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9203f7-6ab0-4c7f-b834-06a7d38767c3 service cinder] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:42.946314 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:31:42.951384 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1170/2356] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:31:42 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:31:42.981022 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b7d329-17a2-43ff-9381-bc6cf767a2d6 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:43.003353 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d38c6-4a7b-47e6-b035-7980ab87ac7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:43.004285 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d38c6-4a7b-47e6-b035-7980ab87ac7b service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:43.004734 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d38c6-4a7b-47e6-b035-7980ab87ac7b service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:43.005682 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d38c6-4a7b-47e6-b035-7980ab87ac7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:43.021423 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8d38c6-4a7b-47e6-b035-7980ab87ac7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:43.023849 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8d38c6-4a7b-47e6-b035-7980ab87ac7b service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:43.046114 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1187/2357] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:31:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:31:43.501018 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf08fd8-5733-4972-8023-fbb0c1c2be3a None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:43.501301 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf08fd8-5733-4972-8023-fbb0c1c2be3a None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:43.501755 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf08fd8-5733-4972-8023-fbb0c1c2be3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:43.548835 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-cbf08fd8-5733-4972-8023-fbb0c1c2be3a None None] MFA Rules not processed for user `edc11f8a9c5843939ec230e63ca7fa3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:31:43.549844 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-cbf08fd8-5733-4972-8023-fbb0c1c2be3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:43.759307 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1171/2358] 10.222.0.60 () {58 vars in 1009 bytes} [Tue Aug 30 01:31:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:31:43.784750 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d38c6-4a7b-47e6-b035-7980ab87ac7b service neutron] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:43.787203 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-2a8d38c6-4a7b-47e6-b035-7980ab87ac7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:43.956371 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d38c6-4a7b-47e6-b035-7980ab87ac7b service neutron] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:43.973849 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3362c21e-b4e5-49aa-80b4-597f2bf8aa77 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7de1f31ef84d529bf2c53ce0f7e38b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:43.974610 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362c21e-b4e5-49aa-80b4-597f2bf8aa77 service swift] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:43.974809 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362c21e-b4e5-49aa-80b4-597f2bf8aa77 service swift] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:43.975701 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362c21e-b4e5-49aa-80b4-597f2bf8aa77 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:44.001669 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3362c21e-b4e5-49aa-80b4-597f2bf8aa77 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:44.004782 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3362c21e-b4e5-49aa-80b4-597f2bf8aa77 service swift] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:44.038903 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1188/2359] 10.222.0.60 () {60 vars in 1384 bytes} [Tue Aug 30 01:31:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 01:31:44.074024 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1079e9-380b-4714-935b-e9230886174e None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:44.074488 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1079e9-380b-4714-935b-e9230886174e None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:44.074799 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1079e9-380b-4714-935b-e9230886174e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:44.150985 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-cb1079e9-380b-4714-935b-e9230886174e None None] MFA Rules not processed for user `6b718ad9162a43778ee997d4fa07c3f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:31:44.157477 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-cb1079e9-380b-4714-935b-e9230886174e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:44.401097 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1172/2360] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:31:44 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:31:44.649246 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3362c21e-b4e5-49aa-80b4-597f2bf8aa77 service swift] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:44.652447 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-3362c21e-b4e5-49aa-80b4-597f2bf8aa77 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:44.696112 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3362c21e-b4e5-49aa-80b4-597f2bf8aa77 service swift] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:44.725244 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a770c7-e4be-472d-bfa9-6ecbac1dea4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:44.726368 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a770c7-e4be-472d-bfa9-6ecbac1dea4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:44.728024 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a770c7-e4be-472d-bfa9-6ecbac1dea4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:44.728853 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a770c7-e4be-472d-bfa9-6ecbac1dea4f admin admin] PATH_INFO: `/v3/projects/cfefacc7251641feb134d79a966b5d61` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:44.734394 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a770c7-e4be-472d-bfa9-6ecbac1dea4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfefacc7251641feb134d79a966b5d61)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:44.739305 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a770c7-e4be-472d-bfa9-6ecbac1dea4f admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:44.826062 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1079e9-380b-4714-935b-e9230886174e None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:44.828223 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-cb1079e9-380b-4714-935b-e9230886174e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:44.867064 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-f1a770c7-e4be-472d-bfa9-6ecbac1dea4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfefacc7251641feb134d79a966b5d61', 'request_id': 'req-f1a770c7-e4be-472d-bfa9-6ecbac1dea4f'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:44.894498 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-f1a770c7-e4be-472d-bfa9-6ecbac1dea4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfefacc7251641feb134d79a966b5d61', 'request_id': 'req-f1a770c7-e4be-472d-bfa9-6ecbac1dea4f'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:44.918860 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-f1a770c7-e4be-472d-bfa9-6ecbac1dea4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfefacc7251641feb134d79a966b5d61', 'request_id': 'req-f1a770c7-e4be-472d-bfa9-6ecbac1dea4f'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:44.960197 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-f1a770c7-e4be-472d-bfa9-6ecbac1dea4f admin admin] The token cache is being invalidate because project cfefacc7251641feb134d79a966b5d61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:31:44.960490 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-f1a770c7-e4be-472d-bfa9-6ecbac1dea4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:44.966418 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-f1a770c7-e4be-472d-bfa9-6ecbac1dea4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:44.975750 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1189/2361] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:31:44 2022] DELETE /identity/v3/projects/cfefacc7251641feb134d79a966b5d61 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:31:44.981091 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a770c7-e4be-472d-bfa9-6ecbac1dea4f admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:44.985569 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-f1a770c7-e4be-472d-bfa9-6ecbac1dea4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:45.034571 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1079e9-380b-4714-935b-e9230886174e None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:45.134536 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:31:45.231974 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:31:45.250030 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a770c7-e4be-472d-bfa9-6ecbac1dea4f admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:45.270078 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3030e1-bf78-4f9f-8089-2d527e573880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:45.274938 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3030e1-bf78-4f9f-8089-2d527e573880 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:45.275126 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3030e1-bf78-4f9f-8089-2d527e573880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:45.275362 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3030e1-bf78-4f9f-8089-2d527e573880 admin admin] PATH_INFO: `/v3/users/ba4a35cf501b4341afb6a82144d036cf` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:45.283265 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3030e1-bf78-4f9f-8089-2d527e573880 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba4a35cf501b4341afb6a82144d036cf)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:45.286417 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3030e1-bf78-4f9f-8089-2d527e573880 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:45.313846 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b71b89b-950e-4f27-a246-2ed67919ecd0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8889145228a24fb6bd539a11925e62f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:45.314507 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71b89b-950e-4f27-a246-2ed67919ecd0 service nova] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:45.314787 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71b89b-950e-4f27-a246-2ed67919ecd0 service nova] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:45.315058 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71b89b-950e-4f27-a246-2ed67919ecd0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:45.331648 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-0b71b89b-950e-4f27-a246-2ed67919ecd0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:45.454917 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-8d3030e1-bf78-4f9f-8089-2d527e573880 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba4a35cf501b4341afb6a82144d036cf'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:45.468107 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-8d3030e1-bf78-4f9f-8089-2d527e573880 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba4a35cf501b4341afb6a82144d036cf'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:45.469328 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-8d3030e1-bf78-4f9f-8089-2d527e573880 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba4a35cf501b4341afb6a82144d036cf'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:45.502023 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-8d3030e1-bf78-4f9f-8089-2d527e573880 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba4a35cf501b4341afb6a82144d036cf'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:45.503803 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-8d3030e1-bf78-4f9f-8089-2d527e573880 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba4a35cf501b4341afb6a82144d036cf'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:45.542000 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1190/2362] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:31:44 2022] DELETE /identity/v3/users/ba4a35cf501b4341afb6a82144d036cf => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:31:45.674103 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b71b89b-950e-4f27-a246-2ed67919ecd0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:45.676432 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b71b89b-950e-4f27-a246-2ed67919ecd0 service nova] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:45.723120 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1173/2363] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:31:44 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 900 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:31:47.306429 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3030e1-bf78-4f9f-8089-2d527e573880 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:47.308142 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-8d3030e1-bf78-4f9f-8089-2d527e573880 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:47.550041 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3030e1-bf78-4f9f-8089-2d527e573880 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:47.560210 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e6223-8189-4208-96b0-d59cc5d4f6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:47.560994 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e6223-8189-4208-96b0-d59cc5d4f6bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:47.561450 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e6223-8189-4208-96b0-d59cc5d4f6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:47.561738 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e6223-8189-4208-96b0-d59cc5d4f6bb admin admin] PATH_INFO: `/v3/projects/d8071cbe4e2241e58ee37188c3205c50` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:47.562944 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e6223-8189-4208-96b0-d59cc5d4f6bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8071cbe4e2241e58ee37188c3205c50)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:47.564942 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e6223-8189-4208-96b0-d59cc5d4f6bb admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:47.858865 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-484e6223-8189-4208-96b0-d59cc5d4f6bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8071cbe4e2241e58ee37188c3205c50', 'request_id': 'req-484e6223-8189-4208-96b0-d59cc5d4f6bb'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:47.876350 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-484e6223-8189-4208-96b0-d59cc5d4f6bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8071cbe4e2241e58ee37188c3205c50', 'request_id': 'req-484e6223-8189-4208-96b0-d59cc5d4f6bb'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:47.900923 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-484e6223-8189-4208-96b0-d59cc5d4f6bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8071cbe4e2241e58ee37188c3205c50', 'request_id': 'req-484e6223-8189-4208-96b0-d59cc5d4f6bb'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:47.937633 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-484e6223-8189-4208-96b0-d59cc5d4f6bb admin admin] The token cache is being invalidate because project d8071cbe4e2241e58ee37188c3205c50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:31:47.938074 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-484e6223-8189-4208-96b0-d59cc5d4f6bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:47.940452 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-484e6223-8189-4208-96b0-d59cc5d4f6bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:47.944043 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1191/2364] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:31:47 2022] DELETE /identity/v3/projects/d8071cbe4e2241e58ee37188c3205c50 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:31:47.949645 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec014753-5b9c-43d2-8875-e90c8099644b None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:47.950638 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec014753-5b9c-43d2-8875-e90c8099644b None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:47.951073 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec014753-5b9c-43d2-8875-e90c8099644b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:48.014377 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-ec014753-5b9c-43d2-8875-e90c8099644b None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:31:48.018633 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-ec014753-5b9c-43d2-8875-e90c8099644b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:48.235030 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1174/2365] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:31:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:31:48.244302 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efb86c4-b9ca-4480-a0e5-6e0b22b2ceca None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:48.244829 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efb86c4-b9ca-4480-a0e5-6e0b22b2ceca None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:48.245246 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efb86c4-b9ca-4480-a0e5-6e0b22b2ceca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:48.323030 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:31:48.364415 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-9efb86c4-b9ca-4480-a0e5-6e0b22b2ceca None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:31:48.368066 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-9efb86c4-b9ca-4480-a0e5-6e0b22b2ceca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:48.406540 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1192/2366] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:31:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:31:48.407812 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec014753-5b9c-43d2-8875-e90c8099644b None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:48.438725 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec014753-5b9c-43d2-8875-e90c8099644b None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:48.457123 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2957e40d-e1ad-4b5a-9bd2-65c21236e437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:48.457853 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957e40d-e1ad-4b5a-9bd2-65c21236e437 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:48.458131 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957e40d-e1ad-4b5a-9bd2-65c21236e437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:48.458424 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957e40d-e1ad-4b5a-9bd2-65c21236e437 admin admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:48.459641 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2957e40d-e1ad-4b5a-9bd2-65c21236e437 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:31:48.459947 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2957e40d-e1ad-4b5a-9bd2-65c21236e437 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:48.476633 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2957e40d-e1ad-4b5a-9bd2-65c21236e437 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:48.526889 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efb86c4-b9ca-4480-a0e5-6e0b22b2ceca None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:48.528719 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1175/2367] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 30 01:31:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:31:48.539730 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efb86c4-b9ca-4480-a0e5-6e0b22b2ceca None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:48.579170 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef5d4d-b80d-4969-a342-a76c91401ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:48.580634 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef5d4d-b80d-4969-a342-a76c91401ca4 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:48.581219 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef5d4d-b80d-4969-a342-a76c91401ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:48.581827 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef5d4d-b80d-4969-a342-a76c91401ca4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:48.583419 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ef5d4d-b80d-4969-a342-a76c91401ca4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:48.619338 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ef5d4d-b80d-4969-a342-a76c91401ca4 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:48.758648 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1193/2368] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:31:48 2022] POST /identity/v3/projects => generated 385 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:31:48.762266 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2957e40d-e1ad-4b5a-9bd2-65c21236e437 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:48.801708 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2957e40d-e1ad-4b5a-9bd2-65c21236e437 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:48.986249 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:31:49.016598 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8236ec76-6b48-45a9-9902-f7b4e3026b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:49.018087 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236ec76-6b48-45a9-9902-f7b4e3026b9f admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:49.018571 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236ec76-6b48-45a9-9902-f7b4e3026b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:49.019264 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236ec76-6b48-45a9-9902-f7b4e3026b9f admin admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:49.020166 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8236ec76-6b48-45a9-9902-f7b4e3026b9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:49.022631 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8236ec76-6b48-45a9-9902-f7b4e3026b9f admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:49.096585 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1176/2369] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:31:48 2022] POST /identity/v3/users => generated 293 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:31:49.104576 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef5d4d-b80d-4969-a342-a76c91401ca4 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:49.123262 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef5d4d-b80d-4969-a342-a76c91401ca4 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:49.141405 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f14ace4-1715-4a17-8862-e425423bd934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:49.142456 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14ace4-1715-4a17-8862-e425423bd934 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:49.142565 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14ace4-1715-4a17-8862-e425423bd934 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:49.142856 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14ace4-1715-4a17-8862-e425423bd934 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:49.145546 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f14ace4-1715-4a17-8862-e425423bd934 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:49.147656 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f14ace4-1715-4a17-8862-e425423bd934 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:49.220602 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8236ec76-6b48-45a9-9902-f7b4e3026b9f admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:49.224853 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1194/2370] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:31:49.273840 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8236ec76-6b48-45a9-9902-f7b4e3026b9f admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:49.323816 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407a0593-eb11-4a79-a1f2-bf2c7810ba2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:49.324445 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a0593-eb11-4a79-a1f2-bf2c7810ba2a admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:49.324724 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a0593-eb11-4a79-a1f2-bf2c7810ba2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:49.324995 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a0593-eb11-4a79-a1f2-bf2c7810ba2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:49.325654 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407a0593-eb11-4a79-a1f2-bf2c7810ba2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:49.364960 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407a0593-eb11-4a79-a1f2-bf2c7810ba2a admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:49.384159 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f14ace4-1715-4a17-8862-e425423bd934 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:49.385356 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1177/2371] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:31:49.397098 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f14ace4-1715-4a17-8862-e425423bd934 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:49.404609 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c6367b-949c-401b-9524-1741d0d8b97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:49.405777 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c6367b-949c-401b-9524-1741d0d8b97b admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:49.406170 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c6367b-949c-401b-9524-1741d0d8b97b admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:49.406556 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c6367b-949c-401b-9524-1741d0d8b97b admin admin] PATH_INFO: `/v3/projects/c2762d19c83e4688a38b9ead546e28d3/users/ca82013299f74e0cb68f24276b52a30d/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:49.469690 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c6367b-949c-401b-9524-1741d0d8b97b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2762d19c83e4688a38b9ead546e28d3, user_id=ca82013299f74e0cb68f24276b52a30d, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:49.473100 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c6367b-949c-401b-9524-1741d0d8b97b admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:49.497161 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1195/2372] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:31:49 2022] PUT /identity/v3/projects/c2762d19c83e4688a38b9ead546e28d3/users/ca82013299f74e0cb68f24276b52a30d/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:31:49.509031 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df297332-26d2-4d3c-82af-840a3daf6e58 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:49.509411 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df297332-26d2-4d3c-82af-840a3daf6e58 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:49.509792 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df297332-26d2-4d3c-82af-840a3daf6e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:49.610352 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-df297332-26d2-4d3c-82af-840a3daf6e58 None None] MFA Rules not processed for user `ca82013299f74e0cb68f24276b52a30d`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:31:49.612453 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-df297332-26d2-4d3c-82af-840a3daf6e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:49.870542 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c6367b-949c-401b-9524-1741d0d8b97b admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:49.873212 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1178/2373] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:31:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:31:50.041554 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c6367b-949c-401b-9524-1741d0d8b97b admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:50.056838 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7063d7df-4802-409f-bcfd-ddbf72f826f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:50.062682 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063d7df-4802-409f-bcfd-ddbf72f826f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:50.063151 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063d7df-4802-409f-bcfd-ddbf72f826f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:50.063623 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063d7df-4802-409f-bcfd-ddbf72f826f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:50.064453 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7063d7df-4802-409f-bcfd-ddbf72f826f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:50.066586 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7063d7df-4802-409f-bcfd-ddbf72f826f8 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:50.153679 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df297332-26d2-4d3c-82af-840a3daf6e58 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:50.156052 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-df297332-26d2-4d3c-82af-840a3daf6e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:50.170619 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1196/2374] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:31:49 2022] POST /identity/v3/projects => generated 387 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:31:50.171639 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7063d7df-4802-409f-bcfd-ddbf72f826f8 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:50.181917 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df297332-26d2-4d3c-82af-840a3daf6e58 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:50.345420 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7063d7df-4802-409f-bcfd-ddbf72f826f8 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:50.358177 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38542eb7-4a4c-4b5d-ab64-fb471fe0ea8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:50.358826 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38542eb7-4a4c-4b5d-ab64-fb471fe0ea8f admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:50.359095 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38542eb7-4a4c-4b5d-ab64-fb471fe0ea8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:50.359370 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38542eb7-4a4c-4b5d-ab64-fb471fe0ea8f admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:50.360065 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38542eb7-4a4c-4b5d-ab64-fb471fe0ea8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:50.362739 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38542eb7-4a4c-4b5d-ab64-fb471fe0ea8f admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:50.399840 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d169c5d2-7530-4fea-9972-e301063666ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:50.406183 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d169c5d2-7530-4fea-9972-e301063666ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:50.406828 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d169c5d2-7530-4fea-9972-e301063666ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:50.407265 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d169c5d2-7530-4fea-9972-e301063666ab admin admin] PATH_INFO: `/v3/users/af8d83b02a294109805a6640d21828c8` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:50.409314 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1197/2375] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:31:50 2022] POST /identity/v3/users => generated 300 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:31:50.410413 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d169c5d2-7530-4fea-9972-e301063666ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=af8d83b02a294109805a6640d21828c8)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:50.411018 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38542eb7-4a4c-4b5d-ab64-fb471fe0ea8f admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:50.424006 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d169c5d2-7530-4fea-9972-e301063666ab admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:50.430360 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38542eb7-4a4c-4b5d-ab64-fb471fe0ea8f admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:50.446256 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbffb60-d97b-40ee-b8c4-a633210449ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:50.447230 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbffb60-d97b-40ee-b8c4-a633210449ea admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:50.447704 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbffb60-d97b-40ee-b8c4-a633210449ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:50.448190 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbffb60-d97b-40ee-b8c4-a633210449ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:50.449050 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbffb60-d97b-40ee-b8c4-a633210449ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:50.450948 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbffb60-d97b-40ee-b8c4-a633210449ea admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:50.484873 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1198/2376] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:31:50 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:31:50.496522 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbffb60-d97b-40ee-b8c4-a633210449ea admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:50.509731 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbffb60-d97b-40ee-b8c4-a633210449ea admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:50.533513 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc5428d-a156-4e93-9b34-2eea28fd8ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:50.534504 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5428d-a156-4e93-9b34-2eea28fd8ef5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:50.534953 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5428d-a156-4e93-9b34-2eea28fd8ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:50.535383 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5428d-a156-4e93-9b34-2eea28fd8ef5 admin admin] PATH_INFO: `/v3/projects/ba8122ca719346f790442a0d61d5f3fb/users/aa28d067f8a2493b9dd75e20f2733106/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:50.538812 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:31:50.566081 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc5428d-a156-4e93-9b34-2eea28fd8ef5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba8122ca719346f790442a0d61d5f3fb, user_id=aa28d067f8a2493b9dd75e20f2733106, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:50.592520 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc5428d-a156-4e93-9b34-2eea28fd8ef5 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:50.657323 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1199/2377] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:31:50 2022] PUT /identity/v3/projects/ba8122ca719346f790442a0d61d5f3fb/users/aa28d067f8a2493b9dd75e20f2733106/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:31:50.663171 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc5428d-a156-4e93-9b34-2eea28fd8ef5 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:50.678037 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-d169c5d2-7530-4fea-9972-e301063666ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af8d83b02a294109805a6640d21828c8'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:50.699209 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-d169c5d2-7530-4fea-9972-e301063666ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af8d83b02a294109805a6640d21828c8'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:50.705095 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-d169c5d2-7530-4fea-9972-e301063666ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af8d83b02a294109805a6640d21828c8'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:50.708178 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-d169c5d2-7530-4fea-9972-e301063666ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af8d83b02a294109805a6640d21828c8'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:50.733528 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:31:50.752906 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-d169c5d2-7530-4fea-9972-e301063666ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af8d83b02a294109805a6640d21828c8'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:50.789426 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1179/2378] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:31:50 2022] DELETE /identity/v3/users/af8d83b02a294109805a6640d21828c8 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:31:50.793610 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c76ee-b96f-45c7-b7fc-259aacbac93b None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:50.793941 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c76ee-b96f-45c7-b7fc-259aacbac93b None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:50.794162 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c76ee-b96f-45c7-b7fc-259aacbac93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:50.841939 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-7c9c76ee-b96f-45c7-b7fc-259aacbac93b None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:31:50.843582 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-7c9c76ee-b96f-45c7-b7fc-259aacbac93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:50.845029 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc5428d-a156-4e93-9b34-2eea28fd8ef5 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:50.958526 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bcbbc6-db0c-429e-970e-35b042bfed7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:50.960162 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bcbbc6-db0c-429e-970e-35b042bfed7a admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:50.960628 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bcbbc6-db0c-429e-970e-35b042bfed7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:50.961888 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bcbbc6-db0c-429e-970e-35b042bfed7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:50.962250 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bcbbc6-db0c-429e-970e-35b042bfed7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:51.004449 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bcbbc6-db0c-429e-970e-35b042bfed7a admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:51.041440 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1180/2380] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:31:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:31:51.042908 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c879ff5-9de4-42ed-8d93-630cdb75bce8 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:51.043196 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c879ff5-9de4-42ed-8d93-630cdb75bce8 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:51.043710 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c879ff5-9de4-42ed-8d93-630cdb75bce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:51.044433 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1200/2380] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:31:50 2022] GET /identity/v3/roles => generated 1420 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:31:51.045467 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bcbbc6-db0c-429e-970e-35b042bfed7a admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:51.048440 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-d4bcbbc6-db0c-429e-970e-35b042bfed7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:51.075570 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bcbbc6-db0c-429e-970e-35b042bfed7a admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:51.093528 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea39b8-9a21-49b9-b702-07ec804eb44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:51.093528 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea39b8-9a21-49b9-b702-07ec804eb44c admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:51.093890 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea39b8-9a21-49b9-b702-07ec804eb44c admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:51.094680 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea39b8-9a21-49b9-b702-07ec804eb44c admin admin] PATH_INFO: `/v3/projects/ba8122ca719346f790442a0d61d5f3fb/users/aa28d067f8a2493b9dd75e20f2733106/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:51.097554 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-5c879ff5-9de4-42ed-8d93-630cdb75bce8 None None] MFA Rules not processed for user `91bfcdadb42441538cd25b83c7143808`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:31:51.105301 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ea39b8-9a21-49b9-b702-07ec804eb44c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba8122ca719346f790442a0d61d5f3fb, user_id=aa28d067f8a2493b9dd75e20f2733106, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:51.106919 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-5c879ff5-9de4-42ed-8d93-630cdb75bce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:51.108713 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ea39b8-9a21-49b9-b702-07ec804eb44c admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:51.142038 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1201/2381] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:31:51 2022] PUT /identity/v3/projects/ba8122ca719346f790442a0d61d5f3fb/users/aa28d067f8a2493b9dd75e20f2733106/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:31:51.153645 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea39b8-9a21-49b9-b702-07ec804eb44c admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:51.155368 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-96ea39b8-9a21-49b9-b702-07ec804eb44c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:51.258878 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea39b8-9a21-49b9-b702-07ec804eb44c admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:51.269184 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d5070-ebd3-4110-8258-be4d55d5c3e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:51.269184 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d5070-ebd3-4110-8258-be4d55d5c3e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:51.269184 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d5070-ebd3-4110-8258-be4d55d5c3e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:51.269184 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d5070-ebd3-4110-8258-be4d55d5c3e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:51.314429 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1181/2382] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:31:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:31:51.322819 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daebdd5b-9be1-437e-8722-3c45a173fac4 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:51.324807 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daebdd5b-9be1-437e-8722-3c45a173fac4 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:51.325396 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daebdd5b-9be1-437e-8722-3c45a173fac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:51.371269 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:31:51.398207 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-daebdd5b-9be1-437e-8722-3c45a173fac4 None None] MFA Rules not processed for user `aa28d067f8a2493b9dd75e20f2733106`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:31:51.399664 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-daebdd5b-9be1-437e-8722-3c45a173fac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:51.531559 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4d5070-ebd3-4110-8258-be4d55d5c3e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:51.532945 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4d5070-ebd3-4110-8258-be4d55d5c3e9 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:51.534793 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1182/2383] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:31:51 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:31:51.547373 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1202/2384] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:31:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:31:51.961349 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daebdd5b-9be1-437e-8722-3c45a173fac4 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:51.967358 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-daebdd5b-9be1-437e-8722-3c45a173fac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:51.988074 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:31:52.133225 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daebdd5b-9be1-437e-8722-3c45a173fac4 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:52.148436 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23597143-68e4-4842-b25d-78bcd82c90ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:52.154484 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23597143-68e4-4842-b25d-78bcd82c90ab service cinder] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:52.154752 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23597143-68e4-4842-b25d-78bcd82c90ab service cinder] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:52.155125 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23597143-68e4-4842-b25d-78bcd82c90ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:52.207839 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23597143-68e4-4842-b25d-78bcd82c90ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:52.212349 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23597143-68e4-4842-b25d-78bcd82c90ab service cinder] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:52.268947 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d5070-ebd3-4110-8258-be4d55d5c3e9 service neutron] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:52.270487 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-3e4d5070-ebd3-4110-8258-be4d55d5c3e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:52.297837 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1183/2385] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:31:51 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:31:52.321624 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d5070-ebd3-4110-8258-be4d55d5c3e9 service neutron] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:52.348195 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daedc652-d04f-424c-ad04-0303a3778f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:52.350257 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daedc652-d04f-424c-ad04-0303a3778f3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:52.353033 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daedc652-d04f-424c-ad04-0303a3778f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:52.354337 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daedc652-d04f-424c-ad04-0303a3778f3e admin admin] PATH_INFO: `/v3/projects/2225a59df4474a67a1f78362fca3e890` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:52.362297 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daedc652-d04f-424c-ad04-0303a3778f3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2225a59df4474a67a1f78362fca3e890)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:52.370575 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daedc652-d04f-424c-ad04-0303a3778f3e admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:52.520100 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-daedc652-d04f-424c-ad04-0303a3778f3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2225a59df4474a67a1f78362fca3e890', 'request_id': 'req-daedc652-d04f-424c-ad04-0303a3778f3e'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:52.538258 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-daedc652-d04f-424c-ad04-0303a3778f3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2225a59df4474a67a1f78362fca3e890', 'request_id': 'req-daedc652-d04f-424c-ad04-0303a3778f3e'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:52.556517 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-daedc652-d04f-424c-ad04-0303a3778f3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2225a59df4474a67a1f78362fca3e890', 'request_id': 'req-daedc652-d04f-424c-ad04-0303a3778f3e'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:52.597988 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-daedc652-d04f-424c-ad04-0303a3778f3e admin admin] The token cache is being invalidate because project 2225a59df4474a67a1f78362fca3e890 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:31:52.598365 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-daedc652-d04f-424c-ad04-0303a3778f3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:52.599796 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-daedc652-d04f-424c-ad04-0303a3778f3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:52.611909 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1203/2386] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:31:52 2022] DELETE /identity/v3/projects/2225a59df4474a67a1f78362fca3e890 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:31:53.818038 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23597143-68e4-4842-b25d-78bcd82c90ab service cinder] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:53.838691 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23597143-68e4-4842-b25d-78bcd82c90ab service cinder] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:53.989677 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c770abb-dce9-469f-92b0-6758a07d47d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:53.990709 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c770abb-dce9-469f-92b0-6758a07d47d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:53.991197 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c770abb-dce9-469f-92b0-6758a07d47d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:53.991675 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c770abb-dce9-469f-92b0-6758a07d47d1 admin admin] PATH_INFO: `/v3/users/ca82013299f74e0cb68f24276b52a30d` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:53.993115 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c770abb-dce9-469f-92b0-6758a07d47d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca82013299f74e0cb68f24276b52a30d)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:53.995353 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c770abb-dce9-469f-92b0-6758a07d47d1 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:54.177922 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-3c770abb-dce9-469f-92b0-6758a07d47d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca82013299f74e0cb68f24276b52a30d'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:54.208340 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-3c770abb-dce9-469f-92b0-6758a07d47d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca82013299f74e0cb68f24276b52a30d'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:54.210165 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-3c770abb-dce9-469f-92b0-6758a07d47d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca82013299f74e0cb68f24276b52a30d'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:54.213806 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-3c770abb-dce9-469f-92b0-6758a07d47d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca82013299f74e0cb68f24276b52a30d'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:54.242763 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-3c770abb-dce9-469f-92b0-6758a07d47d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca82013299f74e0cb68f24276b52a30d'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:54.259235 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1184/2387] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:31:53 2022] DELETE /identity/v3/users/ca82013299f74e0cb68f24276b52a30d => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:31:54.263906 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516fb8e0-02de-4347-bcfa-cb0b3eacd240 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:54.264664 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516fb8e0-02de-4347-bcfa-cb0b3eacd240 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:54.264664 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516fb8e0-02de-4347-bcfa-cb0b3eacd240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:54.312898 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-516fb8e0-02de-4347-bcfa-cb0b3eacd240 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:31:54.315912 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-516fb8e0-02de-4347-bcfa-cb0b3eacd240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:54.470540 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1204/2388] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:31:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:31:54.492178 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c770abb-dce9-469f-92b0-6758a07d47d1 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:54.494164 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-3c770abb-dce9-469f-92b0-6758a07d47d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:54.678298 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:31:54.739808 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c770abb-dce9-469f-92b0-6758a07d47d1 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:54.744310 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741cd37b-dc70-44b2-b50b-8243c8ed4572 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:54.745286 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741cd37b-dc70-44b2-b50b-8243c8ed4572 service neutron] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:54.745646 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741cd37b-dc70-44b2-b50b-8243c8ed4572 service neutron] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:54.746058 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741cd37b-dc70-44b2-b50b-8243c8ed4572 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:54.781007 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741cd37b-dc70-44b2-b50b-8243c8ed4572 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:54.788242 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741cd37b-dc70-44b2-b50b-8243c8ed4572 service neutron] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:54.840184 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1185/2389] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:31:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:31:56.136261 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516fb8e0-02de-4347-bcfa-cb0b3eacd240 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:56.138364 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-516fb8e0-02de-4347-bcfa-cb0b3eacd240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:56.168764 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516fb8e0-02de-4347-bcfa-cb0b3eacd240 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:56.186562 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435268c4-7479-42bb-8f69-054365d57e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:56.188039 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435268c4-7479-42bb-8f69-054365d57e88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:56.188806 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435268c4-7479-42bb-8f69-054365d57e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:56.189473 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435268c4-7479-42bb-8f69-054365d57e88 admin admin] PATH_INFO: `/v3/projects/c2762d19c83e4688a38b9ead546e28d3` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:56.192540 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435268c4-7479-42bb-8f69-054365d57e88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2762d19c83e4688a38b9ead546e28d3)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:56.198862 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435268c4-7479-42bb-8f69-054365d57e88 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:56.274681 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:31:56.288325 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-435268c4-7479-42bb-8f69-054365d57e88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2762d19c83e4688a38b9ead546e28d3', 'request_id': 'req-435268c4-7479-42bb-8f69-054365d57e88'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:56.301419 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-435268c4-7479-42bb-8f69-054365d57e88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2762d19c83e4688a38b9ead546e28d3', 'request_id': 'req-435268c4-7479-42bb-8f69-054365d57e88'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:56.315602 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-435268c4-7479-42bb-8f69-054365d57e88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2762d19c83e4688a38b9ead546e28d3', 'request_id': 'req-435268c4-7479-42bb-8f69-054365d57e88'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:56.337685 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-435268c4-7479-42bb-8f69-054365d57e88 admin admin] The token cache is being invalidate because project c2762d19c83e4688a38b9ead546e28d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:31:56.338432 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-435268c4-7479-42bb-8f69-054365d57e88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:56.339759 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-435268c4-7479-42bb-8f69-054365d57e88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:56.347083 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1205/2390] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:31:56 2022] DELETE /identity/v3/projects/c2762d19c83e4688a38b9ead546e28d3 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:31:56.348728 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741cd37b-dc70-44b2-b50b-8243c8ed4572 service neutron] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:56.364328 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741cd37b-dc70-44b2-b50b-8243c8ed4572 service neutron] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:56.450901 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e97716-020e-4e10-8721-09c238de6a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:56.452430 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e97716-020e-4e10-8721-09c238de6a89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:56.453033 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e97716-020e-4e10-8721-09c238de6a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:56.453589 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e97716-020e-4e10-8721-09c238de6a89 admin admin] PATH_INFO: `/v3/users/aa28d067f8a2493b9dd75e20f2733106` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:56.455319 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e97716-020e-4e10-8721-09c238de6a89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa28d067f8a2493b9dd75e20f2733106)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:56.457801 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e97716-020e-4e10-8721-09c238de6a89 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:56.538940 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-b4e97716-020e-4e10-8721-09c238de6a89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa28d067f8a2493b9dd75e20f2733106'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:56.558300 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-b4e97716-020e-4e10-8721-09c238de6a89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa28d067f8a2493b9dd75e20f2733106'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:56.560148 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-b4e97716-020e-4e10-8721-09c238de6a89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa28d067f8a2493b9dd75e20f2733106'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:56.561913 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-b4e97716-020e-4e10-8721-09c238de6a89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa28d067f8a2493b9dd75e20f2733106'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:56.587039 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-b4e97716-020e-4e10-8721-09c238de6a89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa28d067f8a2493b9dd75e20f2733106'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:56.635361 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1186/2391] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:31:56 2022] DELETE /identity/v3/users/aa28d067f8a2493b9dd75e20f2733106 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:31:56.958299 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea4e53-e625-4d6f-a8a4-b395f0941673 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:56.958557 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea4e53-e625-4d6f-a8a4-b395f0941673 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:56.959479 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea4e53-e625-4d6f-a8a4-b395f0941673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:56.982109 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-d7ea4e53-e625-4d6f-a8a4-b395f0941673 None None] MFA Rules not processed for user `b9ee91e130434c8c9c7ce081dade1395`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:31:56.988397 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-d7ea4e53-e625-4d6f-a8a4-b395f0941673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:57.108448 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1206/2392] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:31:56 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:31:57.245037 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e97716-020e-4e10-8721-09c238de6a89 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:57.246515 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-b4e97716-020e-4e10-8721-09c238de6a89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:57.340574 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:31:57.348408 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e97716-020e-4e10-8721-09c238de6a89 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:57.357477 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a0ff75-f31e-4927-bf48-50da1ce1c53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:57.358205 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0ff75-f31e-4927-bf48-50da1ce1c53d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:57.358601 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0ff75-f31e-4927-bf48-50da1ce1c53d admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:57.358884 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0ff75-f31e-4927-bf48-50da1ce1c53d admin admin] PATH_INFO: `/v3/projects/ba8122ca719346f790442a0d61d5f3fb` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:57.366454 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a0ff75-f31e-4927-bf48-50da1ce1c53d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba8122ca719346f790442a0d61d5f3fb)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:57.374408 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a0ff75-f31e-4927-bf48-50da1ce1c53d admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:57.540333 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-27a0ff75-f31e-4927-bf48-50da1ce1c53d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba8122ca719346f790442a0d61d5f3fb', 'request_id': 'req-27a0ff75-f31e-4927-bf48-50da1ce1c53d'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:57.557773 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-27a0ff75-f31e-4927-bf48-50da1ce1c53d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba8122ca719346f790442a0d61d5f3fb', 'request_id': 'req-27a0ff75-f31e-4927-bf48-50da1ce1c53d'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:57.592065 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-27a0ff75-f31e-4927-bf48-50da1ce1c53d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba8122ca719346f790442a0d61d5f3fb', 'request_id': 'req-27a0ff75-f31e-4927-bf48-50da1ce1c53d'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:57.624178 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-27a0ff75-f31e-4927-bf48-50da1ce1c53d admin admin] The token cache is being invalidate because project ba8122ca719346f790442a0d61d5f3fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81447) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:31:57.624551 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-27a0ff75-f31e-4927-bf48-50da1ce1c53d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:57.626310 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-27a0ff75-f31e-4927-bf48-50da1ce1c53d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:31:57.637795 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e069bbc-50c1-48b4-93e3-172e44d0dba6 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:57.638432 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e069bbc-50c1-48b4-93e3-172e44d0dba6 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:57.638885 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e069bbc-50c1-48b4-93e3-172e44d0dba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:57.646945 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1187/2393] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:31:57 2022] DELETE /identity/v3/projects/ba8122ca719346f790442a0d61d5f3fb => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:31:57.666450 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-5e069bbc-50c1-48b4-93e3-172e44d0dba6 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:31:57.669089 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-5e069bbc-50c1-48b4-93e3-172e44d0dba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:57.788027 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4737a07-ba65-4144-a082-6ba6723322df None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:57.788439 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4737a07-ba65-4144-a082-6ba6723322df None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:57.788835 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4737a07-ba65-4144-a082-6ba6723322df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:57.793262 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1207/2394] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:31:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:31:57.823871 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-b4737a07-ba65-4144-a082-6ba6723322df None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:31:57.825258 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-b4737a07-ba65-4144-a082-6ba6723322df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:57.840185 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e069bbc-50c1-48b4-93e3-172e44d0dba6 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:57.840753 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1188/2395] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:31:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:31:57.859474 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e069bbc-50c1-48b4-93e3-172e44d0dba6 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:57.871912 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f3f6d4-a0be-4d2b-a3a0-4ece9c245ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:57.872853 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3f6d4-a0be-4d2b-a3a0-4ece9c245ba3 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:57.873330 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3f6d4-a0be-4d2b-a3a0-4ece9c245ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:57.874257 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3f6d4-a0be-4d2b-a3a0-4ece9c245ba3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:57.875277 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f3f6d4-a0be-4d2b-a3a0-4ece9c245ba3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:31:57.875886 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f3f6d4-a0be-4d2b-a3a0-4ece9c245ba3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:57.883520 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f3f6d4-a0be-4d2b-a3a0-4ece9c245ba3 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:57.953720 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1208/2396] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 30 01:31:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:31:57.959110 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4737a07-ba65-4144-a082-6ba6723322df None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:57.973269 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4737a07-ba65-4144-a082-6ba6723322df None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:57.998280 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b7d92d-2551-4dc9-8e8e-756be2d14489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:57.998923 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7d92d-2551-4dc9-8e8e-756be2d14489 admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:58.001354 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7d92d-2551-4dc9-8e8e-756be2d14489 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:58.001633 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7d92d-2551-4dc9-8e8e-756be2d14489 admin admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:58.002313 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b7d92d-2551-4dc9-8e8e-756be2d14489 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:58.010390 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b7d92d-2551-4dc9-8e8e-756be2d14489 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:58.087705 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1189/2397] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:31:57 2022] POST /identity/v3/projects => generated 371 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:31:58.089205 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f3f6d4-a0be-4d2b-a3a0-4ece9c245ba3 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:58.125154 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f3f6d4-a0be-4d2b-a3a0-4ece9c245ba3 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:58.267291 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bf03bc-d6c4-4d9c-90d8-9fc408cd1d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:58.268256 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf03bc-d6c4-4d9c-90d8-9fc408cd1d7a admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:58.268794 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf03bc-d6c4-4d9c-90d8-9fc408cd1d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:58.269171 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf03bc-d6c4-4d9c-90d8-9fc408cd1d7a admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:58.269980 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bf03bc-d6c4-4d9c-90d8-9fc408cd1d7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:58.275201 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bf03bc-d6c4-4d9c-90d8-9fc408cd1d7a admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:58.287413 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:31:58.311073 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1209/2398] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:31:58 2022] POST /identity/v3/users => generated 286 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:31:58.312287 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b7d92d-2551-4dc9-8e8e-756be2d14489 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:58.325593 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b7d92d-2551-4dc9-8e8e-756be2d14489 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:58.361758 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35faba2-60e9-4480-80db-c7990b6a7bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:58.363574 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35faba2-60e9-4480-80db-c7990b6a7bce admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:58.366640 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35faba2-60e9-4480-80db-c7990b6a7bce admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:58.367133 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35faba2-60e9-4480-80db-c7990b6a7bce admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:58.368049 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35faba2-60e9-4480-80db-c7990b6a7bce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:58.376672 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35faba2-60e9-4480-80db-c7990b6a7bce admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:58.429550 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1190/2399] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:31:58.433690 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bf03bc-d6c4-4d9c-90d8-9fc408cd1d7a admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:58.445883 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bf03bc-d6c4-4d9c-90d8-9fc408cd1d7a admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:58.466414 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3babfb79-74bd-4bfe-9187-795eb126d58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:58.469782 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3babfb79-74bd-4bfe-9187-795eb126d58e admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:58.471781 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3babfb79-74bd-4bfe-9187-795eb126d58e admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:58.472077 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3babfb79-74bd-4bfe-9187-795eb126d58e admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:58.473362 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3babfb79-74bd-4bfe-9187-795eb126d58e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:58.477049 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3babfb79-74bd-4bfe-9187-795eb126d58e admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:58.522878 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1210/2400] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:31:58.527152 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35faba2-60e9-4480-80db-c7990b6a7bce admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:58.542855 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35faba2-60e9-4480-80db-c7990b6a7bce admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:58.552127 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804bf5df-ee48-45cc-b3d8-9c77ba79f002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:58.553554 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804bf5df-ee48-45cc-b3d8-9c77ba79f002 admin admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:58.553811 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804bf5df-ee48-45cc-b3d8-9c77ba79f002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:58.554087 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804bf5df-ee48-45cc-b3d8-9c77ba79f002 admin admin] PATH_INFO: `/v3/projects/e71a2d25e03d4192a61d4a5ddc69f312/users/3d570a850abf41eda292efa5b88b4326/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:58.593310 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbca360-aad4-4e15-b950-949192aa2771 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:58.593310 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbca360-aad4-4e15-b950-949192aa2771 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:58.593310 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbca360-aad4-4e15-b950-949192aa2771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:58.593853 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804bf5df-ee48-45cc-b3d8-9c77ba79f002 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e71a2d25e03d4192a61d4a5ddc69f312, user_id=3d570a850abf41eda292efa5b88b4326, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:58.601721 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804bf5df-ee48-45cc-b3d8-9c77ba79f002 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:58.636790 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1191/2401] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:31:58 2022] PUT /identity/v3/projects/e71a2d25e03d4192a61d4a5ddc69f312/users/3d570a850abf41eda292efa5b88b4326/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:31:58.638280 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd86f4fc-435f-4dac-9371-e997d91a69f6 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:58.638566 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd86f4fc-435f-4dac-9371-e997d91a69f6 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:58.638837 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd86f4fc-435f-4dac-9371-e997d91a69f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:58.642846 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-dfbca360-aad4-4e15-b950-949192aa2771 None None] MFA Rules not processed for user `edc11f8a9c5843939ec230e63ca7fa3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:31:58.650085 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-dfbca360-aad4-4e15-b950-949192aa2771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:58.686864 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-cd86f4fc-435f-4dac-9371-e997d91a69f6 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:31:58.688414 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-cd86f4fc-435f-4dac-9371-e997d91a69f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:58.812046 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1192/2402] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:31:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:31:58.827764 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1211/2403] 10.222.0.60 () {58 vars in 967 bytes} [Tue Aug 30 01:31:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:31:58.849414 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd86f4fc-435f-4dac-9371-e997d91a69f6 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:58.852289 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-cd86f4fc-435f-4dac-9371-e997d91a69f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:58.886220 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbca360-aad4-4e15-b950-949192aa2771 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:31:58.887980 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-dfbca360-aad4-4e15-b950-949192aa2771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:31:58.899195 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:31:58.988660 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd86f4fc-435f-4dac-9371-e997d91a69f6 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:58.994377 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a9366a-0749-4d54-9168-f40dcbbd5e65 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7de1f31ef84d529bf2c53ce0f7e38b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:58.995152 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a9366a-0749-4d54-9168-f40dcbbd5e65 service swift] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:58.995449 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a9366a-0749-4d54-9168-f40dcbbd5e65 service swift] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:58.996026 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a9366a-0749-4d54-9168-f40dcbbd5e65 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:59.009892 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a9366a-0749-4d54-9168-f40dcbbd5e65 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:59.011784 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a9366a-0749-4d54-9168-f40dcbbd5e65 service swift] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:59.023482 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1193/2404] 10.222.0.60 () {60 vars in 1384 bytes} [Tue Aug 30 01:31:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 01:31:59.030304 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbca360-aad4-4e15-b950-949192aa2771 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:31:59.035879 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a79e1c-3a5b-4ddb-97c8-8b9f95d63cbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:31:59.037227 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a79e1c-3a5b-4ddb-97c8-8b9f95d63cbc service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:31:59.038190 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a79e1c-3a5b-4ddb-97c8-8b9f95d63cbc service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:31:59.038472 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a79e1c-3a5b-4ddb-97c8-8b9f95d63cbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:31:59.059166 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a79e1c-3a5b-4ddb-97c8-8b9f95d63cbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:31:59.062558 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a79e1c-3a5b-4ddb-97c8-8b9f95d63cbc service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:31:59.088951 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1212/2405] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:31:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:32:00.877507 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9993e-d3c3-4e47-9756-442577a6e7b9 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:00.878538 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9993e-d3c3-4e47-9756-442577a6e7b9 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:00.879002 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9993e-d3c3-4e47-9756-442577a6e7b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:00.949915 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-18e9993e-d3c3-4e47-9756-442577a6e7b9 None None] MFA Rules not processed for user `3d570a850abf41eda292efa5b88b4326`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:32:00.952299 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-18e9993e-d3c3-4e47-9756-442577a6e7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:32:01.230050 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1194/2406] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:32:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:32:01.231770 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a79e1c-3a5b-4ddb-97c8-8b9f95d63cbc service neutron] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:32:01.249823 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a79e1c-3a5b-4ddb-97c8-8b9f95d63cbc service neutron] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:32:01.257128 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab92a69b-5906-4880-af68-35b98a6819ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:32:01.258067 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92a69b-5906-4880-af68-35b98a6819ee admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:01.258568 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92a69b-5906-4880-af68-35b98a6819ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:01.259017 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92a69b-5906-4880-af68-35b98a6819ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:01.259887 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab92a69b-5906-4880-af68-35b98a6819ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:32:01.262350 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab92a69b-5906-4880-af68-35b98a6819ee admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:32:01.354950 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1213/2407] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:32:01 2022] POST /identity/v3/projects => generated 373 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:32:01.361380 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e9993e-d3c3-4e47-9756-442577a6e7b9 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:32:01.415672 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e9993e-d3c3-4e47-9756-442577a6e7b9 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:32:01.627244 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c1bd98-0911-4b78-aa87-785ee28b726c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:32:01.628193 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c1bd98-0911-4b78-aa87-785ee28b726c admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:01.628737 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c1bd98-0911-4b78-aa87-785ee28b726c admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:01.629176 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c1bd98-0911-4b78-aa87-785ee28b726c admin admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:01.632426 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c1bd98-0911-4b78-aa87-785ee28b726c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:32:01.634615 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c1bd98-0911-4b78-aa87-785ee28b726c admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:32:01.698587 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1195/2408] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:32:01 2022] POST /identity/v3/users => generated 293 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:32:01.712189 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab92a69b-5906-4880-af68-35b98a6819ee admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:32:01.737281 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab92a69b-5906-4880-af68-35b98a6819ee admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:32:01.748856 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c0754-f56f-4ff0-bf13-8d53e5b17a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:32:01.749758 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c0754-f56f-4ff0-bf13-8d53e5b17a79 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:01.750370 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c0754-f56f-4ff0-bf13-8d53e5b17a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:01.750918 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c0754-f56f-4ff0-bf13-8d53e5b17a79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:01.751942 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5c0754-f56f-4ff0-bf13-8d53e5b17a79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:32:01.754488 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5c0754-f56f-4ff0-bf13-8d53e5b17a79 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:32:01.781899 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1214/2409] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:32:01 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:32:01.782506 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c1bd98-0911-4b78-aa87-785ee28b726c admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:32:01.816215 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c1bd98-0911-4b78-aa87-785ee28b726c admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:32:01.845514 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0af1c82-dbe9-47de-bcb8-17f8f6356a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:32:01.849041 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af1c82-dbe9-47de-bcb8-17f8f6356a35 admin admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:01.849818 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af1c82-dbe9-47de-bcb8-17f8f6356a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:01.850486 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af1c82-dbe9-47de-bcb8-17f8f6356a35 admin admin] PATH_INFO: `/v3/projects/ab1894d1c6224d66a0367788aacd68f2/users/9a064b04a343447e963f317492d961ba/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:01.890149 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0af1c82-dbe9-47de-bcb8-17f8f6356a35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab1894d1c6224d66a0367788aacd68f2, user_id=9a064b04a343447e963f317492d961ba, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:32:01.897753 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0af1c82-dbe9-47de-bcb8-17f8f6356a35 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:32:01.930600 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1196/2410] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:32:01 2022] PUT /identity/v3/projects/ab1894d1c6224d66a0367788aacd68f2/users/9a064b04a343447e963f317492d961ba/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:32:01.938765 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c0754-f56f-4ff0-bf13-8d53e5b17a79 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:32:01.954400 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c0754-f56f-4ff0-bf13-8d53e5b17a79 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:32:02.097751 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:32:02.108887 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa40dc02-cc26-483d-bc12-a7bc1159715f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:32:02.109675 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40dc02-cc26-483d-bc12-a7bc1159715f admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:02.110237 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40dc02-cc26-483d-bc12-a7bc1159715f admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:02.110614 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40dc02-cc26-483d-bc12-a7bc1159715f admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:02.111484 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa40dc02-cc26-483d-bc12-a7bc1159715f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:32:02.114274 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa40dc02-cc26-483d-bc12-a7bc1159715f admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:32:02.132348 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1215/2411] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:32:01 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:32:02.132977 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0af1c82-dbe9-47de-bcb8-17f8f6356a35 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:32:02.147572 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0af1c82-dbe9-47de-bcb8-17f8f6356a35 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:32:02.156619 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ae7250-2c8e-4c28-a745-23c86f659b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:32:02.157307 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae7250-2c8e-4c28-a745-23c86f659b79 admin admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:02.157584 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae7250-2c8e-4c28-a745-23c86f659b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:02.157853 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae7250-2c8e-4c28-a745-23c86f659b79 admin admin] PATH_INFO: `/v3/projects/ab1894d1c6224d66a0367788aacd68f2/users/9a064b04a343447e963f317492d961ba/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:02.163308 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ae7250-2c8e-4c28-a745-23c86f659b79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab1894d1c6224d66a0367788aacd68f2, user_id=9a064b04a343447e963f317492d961ba, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:32:02.166033 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ae7250-2c8e-4c28-a745-23c86f659b79 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:32:02.169125 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:32:02.188497 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1197/2412] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:32:02 2022] PUT /identity/v3/projects/ab1894d1c6224d66a0367788aacd68f2/users/9a064b04a343447e963f317492d961ba/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:32:02.883100 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa40dc02-cc26-483d-bc12-a7bc1159715f admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:32:02.885151 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-fa40dc02-cc26-483d-bc12-a7bc1159715f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:32:02.923612 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa40dc02-cc26-483d-bc12-a7bc1159715f admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:32:03.038760 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67a4184-4d8b-4e28-82b6-94d4d5d08c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:32:03.039421 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a4184-4d8b-4e28-82b6-94d4d5d08c56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:03.039755 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a4184-4d8b-4e28-82b6-94d4d5d08c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:03.040035 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a4184-4d8b-4e28-82b6-94d4d5d08c56 admin admin] PATH_INFO: `/v3/users/9c090ad3fe494672b5fece2ed600057e` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:03.041491 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67a4184-4d8b-4e28-82b6-94d4d5d08c56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c090ad3fe494672b5fece2ed600057e)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:32:03.043511 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67a4184-4d8b-4e28-82b6-94d4d5d08c56 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:32:03.111911 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e67a4184-4d8b-4e28-82b6-94d4d5d08c56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c090ad3fe494672b5fece2ed600057e'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:32:03.128107 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e67a4184-4d8b-4e28-82b6-94d4d5d08c56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c090ad3fe494672b5fece2ed600057e'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:32:03.128959 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e67a4184-4d8b-4e28-82b6-94d4d5d08c56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c090ad3fe494672b5fece2ed600057e'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:32:03.153130 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e67a4184-4d8b-4e28-82b6-94d4d5d08c56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c090ad3fe494672b5fece2ed600057e'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:32:03.153910 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e67a4184-4d8b-4e28-82b6-94d4d5d08c56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c090ad3fe494672b5fece2ed600057e'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:32:03.170464 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1216/2413] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:32:02 2022] DELETE /identity/v3/users/9c090ad3fe494672b5fece2ed600057e => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:32:03.423098 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e3a8a-1f4a-478a-af5d-cdfb7504292c None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:03.423892 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e3a8a-1f4a-478a-af5d-cdfb7504292c None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:03.423892 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e3a8a-1f4a-478a-af5d-cdfb7504292c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:03.468010 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-131e3a8a-1f4a-478a-af5d-cdfb7504292c None None] MFA Rules not processed for user `9a064b04a343447e963f317492d961ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:32:03.471980 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-131e3a8a-1f4a-478a-af5d-cdfb7504292c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:32:03.559139 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67a4184-4d8b-4e28-82b6-94d4d5d08c56 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:32:03.561266 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-e67a4184-4d8b-4e28-82b6-94d4d5d08c56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:32:03.589777 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1198/2414] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:32:03 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:32:03.604395 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8ed39-5e76-40e6-b2ae-85ff4d3bc353 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:03.606075 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8ed39-5e76-40e6-b2ae-85ff4d3bc353 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:03.606562 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8ed39-5e76-40e6-b2ae-85ff4d3bc353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:03.654464 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-ada8ed39-5e76-40e6-b2ae-85ff4d3bc353 None None] MFA Rules not processed for user `3d570a850abf41eda292efa5b88b4326`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:32:03.657580 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-ada8ed39-5e76-40e6-b2ae-85ff4d3bc353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:32:03.683865 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67a4184-4d8b-4e28-82b6-94d4d5d08c56 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:32:03.696050 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf21afe-a79c-4b7a-8b56-a43ee1d38ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:32:03.696778 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf21afe-a79c-4b7a-8b56-a43ee1d38ae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:03.697145 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf21afe-a79c-4b7a-8b56-a43ee1d38ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:03.697484 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf21afe-a79c-4b7a-8b56-a43ee1d38ae4 admin admin] PATH_INFO: `/v3/projects/d75b1164a0ad407f98c9984df3366bc1` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:03.698710 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf21afe-a79c-4b7a-8b56-a43ee1d38ae4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d75b1164a0ad407f98c9984df3366bc1)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:32:03.701149 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf21afe-a79c-4b7a-8b56-a43ee1d38ae4 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:32:03.715741 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:32:03.738275 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1199/2415] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:32:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:32:03.752676 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada8ed39-5e76-40e6-b2ae-85ff4d3bc353 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:32:03.754804 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-ada8ed39-5e76-40e6-b2ae-85ff4d3bc353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:32:03.799674 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-edf21afe-a79c-4b7a-8b56-a43ee1d38ae4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd75b1164a0ad407f98c9984df3366bc1', 'request_id': 'req-edf21afe-a79c-4b7a-8b56-a43ee1d38ae4'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:32:03.809952 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-edf21afe-a79c-4b7a-8b56-a43ee1d38ae4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd75b1164a0ad407f98c9984df3366bc1', 'request_id': 'req-edf21afe-a79c-4b7a-8b56-a43ee1d38ae4'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:32:03.821202 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-edf21afe-a79c-4b7a-8b56-a43ee1d38ae4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd75b1164a0ad407f98c9984df3366bc1', 'request_id': 'req-edf21afe-a79c-4b7a-8b56-a43ee1d38ae4'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:32:03.840567 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-edf21afe-a79c-4b7a-8b56-a43ee1d38ae4 admin admin] The token cache is being invalidate because project d75b1164a0ad407f98c9984df3366bc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:32:03.841001 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-edf21afe-a79c-4b7a-8b56-a43ee1d38ae4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:32:03.841728 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-edf21afe-a79c-4b7a-8b56-a43ee1d38ae4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:32:03.843242 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1217/2416] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:32:03 2022] DELETE /identity/v3/projects/d75b1164a0ad407f98c9984df3366bc1 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:32:03.852568 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ebc069-9782-4e1b-864f-3a01e580850c None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:03.852568 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ebc069-9782-4e1b-864f-3a01e580850c None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:03.852568 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ebc069-9782-4e1b-864f-3a01e580850c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:03.873353 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-09ebc069-9782-4e1b-864f-3a01e580850c None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:32:03.874594 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-09ebc069-9782-4e1b-864f-3a01e580850c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:32:03.884664 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada8ed39-5e76-40e6-b2ae-85ff4d3bc353 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:32:03.918127 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:32:03.986666 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1218/2417] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:32:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:32:03.994202 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f16f2-615b-44cf-86e9-58734e441e10 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:03.994532 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f16f2-615b-44cf-86e9-58734e441e10 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:03.994789 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f16f2-615b-44cf-86e9-58734e441e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:04.013791 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de6fdce-dedb-485b-845a-5eca5065a32d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8889145228a24fb6bd539a11925e62f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:32:04.016933 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6fdce-dedb-485b-845a-5eca5065a32d service nova] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:04.016933 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6fdce-dedb-485b-845a-5eca5065a32d service nova] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:04.016933 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6fdce-dedb-485b-845a-5eca5065a32d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:04.019189 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-013f16f2-615b-44cf-86e9-58734e441e10 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:32:04.020482 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-013f16f2-615b-44cf-86e9-58734e441e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:32:04.022425 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-1de6fdce-dedb-485b-845a-5eca5065a32d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:32:04.033620 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1219/2418] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:32:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:32:04.038354 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013f16f2-615b-44cf-86e9-58734e441e10 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:32:04.048597 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013f16f2-615b-44cf-86e9-58734e441e10 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:32:04.058217 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9a59c2-924a-4c6a-9528-03b21e6352c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:32:04.058666 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a59c2-924a-4c6a-9528-03b21e6352c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:04.058944 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a59c2-924a-4c6a-9528-03b21e6352c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:04.059215 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a59c2-924a-4c6a-9528-03b21e6352c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:04.059928 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9a59c2-924a-4c6a-9528-03b21e6352c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:32:04.060231 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9a59c2-924a-4c6a-9528-03b21e6352c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:32:04.061871 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9a59c2-924a-4c6a-9528-03b21e6352c9 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:32:04.084671 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1220/2419] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 30 01:32:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:32:04.088765 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9a59c2-924a-4c6a-9528-03b21e6352c9 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:32:04.110308 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9a59c2-924a-4c6a-9528-03b21e6352c9 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:32:04.116410 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de6fdce-dedb-485b-845a-5eca5065a32d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:32:04.120970 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de6fdce-dedb-485b-845a-5eca5065a32d service nova] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:32:04.126601 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cff91b-595b-43b0-852b-3ebdd8a856d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:32:04.128474 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cff91b-595b-43b0-852b-3ebdd8a856d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:04.129217 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cff91b-595b-43b0-852b-3ebdd8a856d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:04.129716 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cff91b-595b-43b0-852b-3ebdd8a856d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:04.131690 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cff91b-595b-43b0-852b-3ebdd8a856d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:32:04.132173 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1200/2420] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:32:03 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:32:04.134151 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cff91b-595b-43b0-852b-3ebdd8a856d2 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:32:04.182591 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1221/2421] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:32:04 2022] POST /identity/v3/projects => generated 383 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:32:04.187654 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de6fdce-dedb-485b-845a-5eca5065a32d service nova] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:32:04.201211 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de6fdce-dedb-485b-845a-5eca5065a32d service nova] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:32:04.288315 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8713035-0b8e-464c-a6b1-ff7137b7390c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:32:04.288611 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8713035-0b8e-464c-a6b1-ff7137b7390c admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:04.290057 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8713035-0b8e-464c-a6b1-ff7137b7390c admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:04.290057 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8713035-0b8e-464c-a6b1-ff7137b7390c admin admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:04.290057 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8713035-0b8e-464c-a6b1-ff7137b7390c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:32:04.291945 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8713035-0b8e-464c-a6b1-ff7137b7390c admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:32:04.321366 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1201/2422] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:32:04 2022] POST /identity/v3/users => generated 292 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:32:04.325444 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cff91b-595b-43b0-852b-3ebdd8a856d2 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:32:04.339248 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cff91b-595b-43b0-852b-3ebdd8a856d2 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:32:04.345483 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a47a66-044e-4828-8881-faf6fc46e008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:32:04.346096 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a47a66-044e-4828-8881-faf6fc46e008 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:04.346445 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a47a66-044e-4828-8881-faf6fc46e008 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:04.346730 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a47a66-044e-4828-8881-faf6fc46e008 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:04.347505 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a47a66-044e-4828-8881-faf6fc46e008 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:32:04.349171 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a47a66-044e-4828-8881-faf6fc46e008 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:32:04.362597 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1222/2423] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:32:04 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:32:04.366697 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8713035-0b8e-464c-a6b1-ff7137b7390c admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:32:04.378263 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8713035-0b8e-464c-a6b1-ff7137b7390c admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:32:04.384700 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d936489e-303c-4470-a798-5f03a42b57e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:32:04.385320 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936489e-303c-4470-a798-5f03a42b57e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:04.385671 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936489e-303c-4470-a798-5f03a42b57e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:04.385949 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936489e-303c-4470-a798-5f03a42b57e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:04.386601 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d936489e-303c-4470-a798-5f03a42b57e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:32:04.390810 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d936489e-303c-4470-a798-5f03a42b57e9 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:32:04.407477 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a47a66-044e-4828-8881-faf6fc46e008 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:32:04.414606 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1202/2424] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:32:04 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:32:04.419461 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a47a66-044e-4828-8881-faf6fc46e008 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:32:04.425700 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8316e25d-9a80-4161-a034-d6b3d7889317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:32:04.426667 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8316e25d-9a80-4161-a034-d6b3d7889317 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:04.427065 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8316e25d-9a80-4161-a034-d6b3d7889317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:04.427532 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8316e25d-9a80-4161-a034-d6b3d7889317 admin admin] PATH_INFO: `/v3/projects/04fcedb090aa47a892fbacf37c9b25e4/users/65516bd166104306a65071d951a65474/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:04.452343 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8316e25d-9a80-4161-a034-d6b3d7889317 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04fcedb090aa47a892fbacf37c9b25e4, user_id=65516bd166104306a65071d951a65474, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:32:04.455283 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8316e25d-9a80-4161-a034-d6b3d7889317 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:32:04.475080 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1223/2425] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:32:04 2022] PUT /identity/v3/projects/04fcedb090aa47a892fbacf37c9b25e4/users/65516bd166104306a65071d951a65474/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:32:04.480525 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11db681-c47c-4dab-b370-4aceb682907d None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:04.480525 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11db681-c47c-4dab-b370-4aceb682907d None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:04.481135 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11db681-c47c-4dab-b370-4aceb682907d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:04.502928 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-b11db681-c47c-4dab-b370-4aceb682907d None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:32:04.504010 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-b11db681-c47c-4dab-b370-4aceb682907d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:32:04.548875 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:32:04.604321 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1203/2426] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:32:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:32:04.619645 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8316e25d-9a80-4161-a034-d6b3d7889317 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:32:04.621118 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-8316e25d-9a80-4161-a034-d6b3d7889317 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:32:04.658578 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:32:04.737432 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8316e25d-9a80-4161-a034-d6b3d7889317 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:32:04.742283 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d79e4b-7a30-4b24-a3e2-8c8bb3db82e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:32:04.742967 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d79e4b-7a30-4b24-a3e2-8c8bb3db82e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:04.743251 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d79e4b-7a30-4b24-a3e2-8c8bb3db82e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:04.743553 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d79e4b-7a30-4b24-a3e2-8c8bb3db82e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:04.756123 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d79e4b-7a30-4b24-a3e2-8c8bb3db82e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:32:04.757743 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d79e4b-7a30-4b24-a3e2-8c8bb3db82e1 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:32:04.777379 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1224/2427] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:32:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:32:08.457688 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901fe09-50ca-4b3d-9603-60d3de01208e None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:08.459100 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901fe09-50ca-4b3d-9603-60d3de01208e None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:08.460905 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901fe09-50ca-4b3d-9603-60d3de01208e None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:08.463732 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1204/2428] 10.222.0.60 () {54 vars in 921 bytes} [Tue Aug 30 01:32:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:32:08.478915 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf60dfe3-e876-45ec-994a-c9e04034fbe1 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:08.479639 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf60dfe3-e876-45ec-994a-c9e04034fbe1 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:08.479974 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf60dfe3-e876-45ec-994a-c9e04034fbe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:08.533768 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-bf60dfe3-e876-45ec-994a-c9e04034fbe1 None None] MFA Rules not processed for user `8889145228a24fb6bd539a11925e62f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:32:08.540209 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-bf60dfe3-e876-45ec-994a-c9e04034fbe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:32:08.735123 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1225/2429] 10.222.0.60 () {58 vars in 1018 bytes} [Tue Aug 30 01:32:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:32:08.750443 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0901fe09-50ca-4b3d-9603-60d3de01208e None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:32:08.752676 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-0901fe09-50ca-4b3d-9603-60d3de01208e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:32:08.893506 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0901fe09-50ca-4b3d-9603-60d3de01208e None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:32:08.901873 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea1663-0887-4341-a273-fd24c2be00b3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2de6decc90df4df58217d5eed9c5e190', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:32:08.902984 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea1663-0887-4341-a273-fd24c2be00b3 service glance] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:08.903858 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea1663-0887-4341-a273-fd24c2be00b3 service glance] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:08.904464 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea1663-0887-4341-a273-fd24c2be00b3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:08.935087 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea1663-0887-4341-a273-fd24c2be00b3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:32:08.937008 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea1663-0887-4341-a273-fd24c2be00b3 service glance] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:32:08.975179 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1205/2430] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:32:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:32:09.102037 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a5183-27d1-455b-9fc3-1b79891b91f5 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:09.102408 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a5183-27d1-455b-9fc3-1b79891b91f5 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:09.102869 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a5183-27d1-455b-9fc3-1b79891b91f5 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:09.104291 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1226/2431] 10.222.0.60 () {54 vars in 921 bytes} [Tue Aug 30 01:32:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:32:09.109931 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59136b70-36d7-4575-bb31-6432f80e39ee None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:09.110256 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59136b70-36d7-4575-bb31-6432f80e39ee None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:09.110511 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59136b70-36d7-4575-bb31-6432f80e39ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:09.156529 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-59136b70-36d7-4575-bb31-6432f80e39ee None None] MFA Rules not processed for user `61e48e00a0c34949a4fffae8c372304e`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:32:09.162314 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-59136b70-36d7-4575-bb31-6432f80e39ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:32:09.193978 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1206/2432] 10.222.0.60 () {58 vars in 1018 bytes} [Tue Aug 30 01:32:09 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:32:09.223587 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a5183-27d1-455b-9fc3-1b79891b91f5 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:32:09.240476 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a5183-27d1-455b-9fc3-1b79891b91f5 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:32:09.244769 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a82e18-4587-45ab-bb4d-a8aae0753228 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:32:09.245246 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a82e18-4587-45ab-bb4d-a8aae0753228 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:09.245704 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a82e18-4587-45ab-bb4d-a8aae0753228 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:09.246138 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a82e18-4587-45ab-bb4d-a8aae0753228 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:09.262716 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a82e18-4587-45ab-bb4d-a8aae0753228 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:32:09.264230 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a82e18-4587-45ab-bb4d-a8aae0753228 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:32:09.282654 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1227/2433] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:32:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:32:09.555056 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8889054-aeef-4b96-951f-fc2356a5e10b None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:09.555637 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8889054-aeef-4b96-951f-fc2356a5e10b None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:09.555736 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8889054-aeef-4b96-951f-fc2356a5e10b None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:09.557201 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1207/2434] 10.222.0.60 () {54 vars in 921 bytes} [Tue Aug 30 01:32:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:32:09.564207 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d58f0-7e9c-40f0-8a06-17f04e23ecf4 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:09.564755 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d58f0-7e9c-40f0-8a06-17f04e23ecf4 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:09.564755 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d58f0-7e9c-40f0-8a06-17f04e23ecf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:09.619011 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-213d58f0-7e9c-40f0-8a06-17f04e23ecf4 None None] MFA Rules not processed for user `8889145228a24fb6bd539a11925e62f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:32:09.620355 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-213d58f0-7e9c-40f0-8a06-17f04e23ecf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:32:09.633236 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1228/2435] 10.222.0.60 () {58 vars in 1018 bytes} [Tue Aug 30 01:32:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:32:09.667875 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8889054-aeef-4b96-951f-fc2356a5e10b None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:32:09.690112 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8889054-aeef-4b96-951f-fc2356a5e10b None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:32:09.695070 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7a0076-5766-407a-b0f1-c307306b0043 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:32:09.696036 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a0076-5766-407a-b0f1-c307306b0043 service neutron] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:09.696549 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a0076-5766-407a-b0f1-c307306b0043 service neutron] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:09.697061 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a0076-5766-407a-b0f1-c307306b0043 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:09.712588 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7a0076-5766-407a-b0f1-c307306b0043 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:32:09.714359 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7a0076-5766-407a-b0f1-c307306b0043 service neutron] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:32:09.731481 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1208/2436] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:32:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:32:12.248503 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c7a42-d767-47af-b873-97a5ae38d0d5 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:12.249498 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c7a42-d767-47af-b873-97a5ae38d0d5 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:12.249923 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c7a42-d767-47af-b873-97a5ae38d0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:12.289546 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-329c7a42-d767-47af-b873-97a5ae38d0d5 None None] MFA Rules not processed for user `65516bd166104306a65071d951a65474`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:32:12.290831 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-329c7a42-d767-47af-b873-97a5ae38d0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:32:12.395514 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1229/2437] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:32:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:32:12.401058 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7a0076-5766-407a-b0f1-c307306b0043 service neutron] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:32:12.413651 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7a0076-5766-407a-b0f1-c307306b0043 service neutron] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:32:12.418529 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a4677-8a49-4f98-b731-618e29e7da8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:32:12.419256 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a4677-8a49-4f98-b731-618e29e7da8a admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:12.419781 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a4677-8a49-4f98-b731-618e29e7da8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:12.420118 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a4677-8a49-4f98-b731-618e29e7da8a admin admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:12.420924 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2a4677-8a49-4f98-b731-618e29e7da8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:32:12.422915 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2a4677-8a49-4f98-b731-618e29e7da8a admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:32:12.458089 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1209/2438] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:32:12 2022] POST /identity/v3/projects => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:32:12.462591 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329c7a42-d767-47af-b873-97a5ae38d0d5 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:32:12.474826 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329c7a42-d767-47af-b873-97a5ae38d0d5 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:32:12.503710 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:32:12.544249 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c2adab-a673-49ff-871c-2dd883a0e951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:32:12.544947 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c2adab-a673-49ff-871c-2dd883a0e951 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:12.545296 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c2adab-a673-49ff-871c-2dd883a0e951 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:12.545636 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c2adab-a673-49ff-871c-2dd883a0e951 admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:12.546513 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c2adab-a673-49ff-871c-2dd883a0e951 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:32:12.548429 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c2adab-a673-49ff-871c-2dd883a0e951 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:32:12.574148 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1230/2439] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:32:12 2022] POST /identity/v3/users => generated 298 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:32:12.578432 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a4677-8a49-4f98-b731-618e29e7da8a admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:32:12.589328 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a4677-8a49-4f98-b731-618e29e7da8a admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:32:12.593923 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c404303-5646-4d0f-837d-af1a8d71e75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:32:12.594540 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c404303-5646-4d0f-837d-af1a8d71e75a admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:12.594818 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c404303-5646-4d0f-837d-af1a8d71e75a admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:12.595088 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c404303-5646-4d0f-837d-af1a8d71e75a admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:12.595795 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c404303-5646-4d0f-837d-af1a8d71e75a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:32:12.597487 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c404303-5646-4d0f-837d-af1a8d71e75a admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:32:12.609231 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1210/2440] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:32:12.613547 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c2adab-a673-49ff-871c-2dd883a0e951 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:32:12.625221 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c2adab-a673-49ff-871c-2dd883a0e951 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:32:12.630512 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef021737-b454-4ac1-907b-b0be75a5cbbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:32:12.631362 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef021737-b454-4ac1-907b-b0be75a5cbbd admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:12.631840 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef021737-b454-4ac1-907b-b0be75a5cbbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:12.632123 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef021737-b454-4ac1-907b-b0be75a5cbbd admin admin] PATH_INFO: `/v3/projects/a137c5a6f09c403888e92e93d638a257/users/ddfb8d9f533042f8a8f88f33d55a741d/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:12.647892 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef021737-b454-4ac1-907b-b0be75a5cbbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a137c5a6f09c403888e92e93d638a257, user_id=ddfb8d9f533042f8a8f88f33d55a741d, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:32:12.650570 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef021737-b454-4ac1-907b-b0be75a5cbbd admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:32:12.664240 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1231/2441] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:32:12 2022] PUT /identity/v3/projects/a137c5a6f09c403888e92e93d638a257/users/ddfb8d9f533042f8a8f88f33d55a741d/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:32:12.668131 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c404303-5646-4d0f-837d-af1a8d71e75a admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:32:12.680283 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c404303-5646-4d0f-837d-af1a8d71e75a admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:32:12.742374 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35147a91-6bda-4503-ae11-403ad2efc09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:32:12.743014 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35147a91-6bda-4503-ae11-403ad2efc09d admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:12.743291 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35147a91-6bda-4503-ae11-403ad2efc09d admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:12.743595 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35147a91-6bda-4503-ae11-403ad2efc09d admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:12.744250 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35147a91-6bda-4503-ae11-403ad2efc09d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:32:12.746206 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35147a91-6bda-4503-ae11-403ad2efc09d admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:32:12.756919 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1211/2442] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:32:12.761157 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef021737-b454-4ac1-907b-b0be75a5cbbd admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:32:12.771604 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef021737-b454-4ac1-907b-b0be75a5cbbd admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:32:12.776212 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e205237e-ea09-4598-a467-54aa6e309a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:32:12.776859 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205237e-ea09-4598-a467-54aa6e309a13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:12.777138 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205237e-ea09-4598-a467-54aa6e309a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:12.777413 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205237e-ea09-4598-a467-54aa6e309a13 admin admin] PATH_INFO: `/v3/projects/a137c5a6f09c403888e92e93d638a257/users/ddfb8d9f533042f8a8f88f33d55a741d/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:12.779752 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e205237e-ea09-4598-a467-54aa6e309a13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a137c5a6f09c403888e92e93d638a257, user_id=ddfb8d9f533042f8a8f88f33d55a741d, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:32:12.782419 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e205237e-ea09-4598-a467-54aa6e309a13 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:32:12.793962 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1232/2443] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:32:12 2022] PUT /identity/v3/projects/a137c5a6f09c403888e92e93d638a257/users/ddfb8d9f533042f8a8f88f33d55a741d/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:32:15.377830 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3101a1b8-754e-4238-a4c4-ac0d3f0f7e5f None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:15.379274 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3101a1b8-754e-4238-a4c4-ac0d3f0f7e5f None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:15.379943 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3101a1b8-754e-4238-a4c4-ac0d3f0f7e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:15.416316 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-3101a1b8-754e-4238-a4c4-ac0d3f0f7e5f None None] MFA Rules not processed for user `edc11f8a9c5843939ec230e63ca7fa3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:32:15.417787 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-3101a1b8-754e-4238-a4c4-ac0d3f0f7e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:32:15.475061 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:32:15.533095 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1212/2444] 10.222.0.60 () {58 vars in 1009 bytes} [Tue Aug 30 01:32:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:32:15.546664 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e205237e-ea09-4598-a467-54aa6e309a13 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:32:15.550940 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-e205237e-ea09-4598-a467-54aa6e309a13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:32:15.680073 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e205237e-ea09-4598-a467-54aa6e309a13 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:32:15.686306 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f35ac-e8c9-451f-8235-e84ee3c1996b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7de1f31ef84d529bf2c53ce0f7e38b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:32:15.686901 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f35ac-e8c9-451f-8235-e84ee3c1996b service swift] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:15.687316 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f35ac-e8c9-451f-8235-e84ee3c1996b service swift] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:15.687622 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f35ac-e8c9-451f-8235-e84ee3c1996b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:15.704137 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03f35ac-e8c9-451f-8235-e84ee3c1996b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:32:15.705802 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03f35ac-e8c9-451f-8235-e84ee3c1996b service swift] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:32:15.717048 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1233/2445] 10.222.0.60 () {60 vars in 1384 bytes} [Tue Aug 30 01:32:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 01:32:21.216181 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af1652-6728-484a-9682-43ba900a177e None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:21.216799 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af1652-6728-484a-9682-43ba900a177e None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:21.217748 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af1652-6728-484a-9682-43ba900a177e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:21.285180 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-13af1652-6728-484a-9682-43ba900a177e None None] MFA Rules not processed for user `ddfb8d9f533042f8a8f88f33d55a741d`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:32:21.287922 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-13af1652-6728-484a-9682-43ba900a177e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:32:21.402953 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1213/2446] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:32:21 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:32:21.416993 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f35ac-e8c9-451f-8235-e84ee3c1996b service swift] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:32:21.488583 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f35ac-e8c9-451f-8235-e84ee3c1996b service swift] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:32:21.492671 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebdc625-d443-4ad4-82c9-041ecc6ab6bf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2de6decc90df4df58217d5eed9c5e190', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:32:21.493275 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebdc625-d443-4ad4-82c9-041ecc6ab6bf service glance] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:21.493552 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebdc625-d443-4ad4-82c9-041ecc6ab6bf service glance] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:21.493822 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebdc625-d443-4ad4-82c9-041ecc6ab6bf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:21.524231 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:32:21.576511 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebdc625-d443-4ad4-82c9-041ecc6ab6bf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:32:21.576511 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebdc625-d443-4ad4-82c9-041ecc6ab6bf service glance] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:32:21.592353 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1234/2447] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:32:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:32:21.812856 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170bd9d-904a-4ceb-a6d7-f7171f48bceb None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:21.813143 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170bd9d-904a-4ceb-a6d7-f7171f48bceb None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:21.813417 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170bd9d-904a-4ceb-a6d7-f7171f48bceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:21.842615 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-2170bd9d-904a-4ceb-a6d7-f7171f48bceb None None] MFA Rules not processed for user `edc11f8a9c5843939ec230e63ca7fa3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:32:21.843865 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-2170bd9d-904a-4ceb-a6d7-f7171f48bceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:32:21.852703 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1214/2448] 10.222.0.60 () {58 vars in 1009 bytes} [Tue Aug 30 01:32:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:32:21.908061 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebdc625-d443-4ad4-82c9-041ecc6ab6bf service glance] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:32:21.932469 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebdc625-d443-4ad4-82c9-041ecc6ab6bf service glance] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:32:21.952338 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea36516-4c3b-4bd1-95a1-8974b50c0280 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7de1f31ef84d529bf2c53ce0f7e38b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:32:21.953038 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea36516-4c3b-4bd1-95a1-8974b50c0280 service swift] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:21.953383 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea36516-4c3b-4bd1-95a1-8974b50c0280 service swift] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:21.953654 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea36516-4c3b-4bd1-95a1-8974b50c0280 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:21.964842 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea36516-4c3b-4bd1-95a1-8974b50c0280 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:32:21.967662 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea36516-4c3b-4bd1-95a1-8974b50c0280 service swift] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:32:21.998317 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1235/2449] 10.222.0.60 () {60 vars in 1384 bytes} [Tue Aug 30 01:32:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 01:32:31.081846 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2170bd9d-904a-4ceb-a6d7-f7171f48bceb None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:32:31.083378 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-2170bd9d-904a-4ceb-a6d7-f7171f48bceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:32:31.171951 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2170bd9d-904a-4ceb-a6d7-f7171f48bceb None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:32:31.178006 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da64804-0a36-400b-9d6b-033482232c81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:32:31.178891 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da64804-0a36-400b-9d6b-033482232c81 service cinder] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:31.179251 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da64804-0a36-400b-9d6b-033482232c81 service cinder] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:31.179626 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da64804-0a36-400b-9d6b-033482232c81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:31.182496 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-3da64804-0a36-400b-9d6b-033482232c81 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:32:31.296549 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da64804-0a36-400b-9d6b-033482232c81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:32:31.298147 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da64804-0a36-400b-9d6b-033482232c81 service cinder] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:32:31.302861 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:32:31.312227 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1215/2450] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:32:31 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:32:31.982401 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=22 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:32:34.586997 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b3b02-2ec5-4dbf-b265-fb98cc0ec2d5 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:34.587836 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b3b02-2ec5-4dbf-b265-fb98cc0ec2d5 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:34.587836 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b3b02-2ec5-4dbf-b265-fb98cc0ec2d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:34.621678 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-b96b3b02-2ec5-4dbf-b265-fb98cc0ec2d5 None None] MFA Rules not processed for user `65516bd166104306a65071d951a65474`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:32:34.624124 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-b96b3b02-2ec5-4dbf-b265-fb98cc0ec2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:32:34.637794 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1236/2451] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:32:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:32:38.864872 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da64804-0a36-400b-9d6b-033482232c81 service cinder] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:32:38.866525 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-3da64804-0a36-400b-9d6b-033482232c81 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:32:38.947057 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da64804-0a36-400b-9d6b-033482232c81 service cinder] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:32:38.953976 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4875a3d-6bf3-45c3-9bfd-8f447941e062 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8dbb4742c3944b9ad389e9628b5a047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:32:38.955406 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4875a3d-6bf3-45c3-9bfd-8f447941e062 service placement] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:38.955406 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4875a3d-6bf3-45c3-9bfd-8f447941e062 service placement] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:38.955406 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4875a3d-6bf3-45c3-9bfd-8f447941e062 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:38.958354 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-e4875a3d-6bf3-45c3-9bfd-8f447941e062 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:32:38.972339 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4875a3d-6bf3-45c3-9bfd-8f447941e062 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:32:38.974699 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4875a3d-6bf3-45c3-9bfd-8f447941e062 service placement] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:32:38.985133 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1216/2452] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:32:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:32:40.384529 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86e01e-7ea5-41e2-98b7-1022fdaeb8de None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:40.385132 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86e01e-7ea5-41e2-98b7-1022fdaeb8de None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:40.385132 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86e01e-7ea5-41e2-98b7-1022fdaeb8de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:40.409331 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-8c86e01e-7ea5-41e2-98b7-1022fdaeb8de None None] MFA Rules not processed for user `edc11f8a9c5843939ec230e63ca7fa3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:32:40.411353 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-8c86e01e-7ea5-41e2-98b7-1022fdaeb8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:32:40.419910 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1237/2453] 10.222.0.60 () {58 vars in 967 bytes} [Tue Aug 30 01:32:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:32:40.435090 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4875a3d-6bf3-45c3-9bfd-8f447941e062 service placement] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:32:40.455917 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4875a3d-6bf3-45c3-9bfd-8f447941e062 service placement] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:32:40.462482 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a4832b-2ab5-4588-aed4-cf6f81db71df service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7de1f31ef84d529bf2c53ce0f7e38b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:32:40.463457 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a4832b-2ab5-4588-aed4-cf6f81db71df service swift] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:40.463872 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a4832b-2ab5-4588-aed4-cf6f81db71df service swift] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:40.464319 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a4832b-2ab5-4588-aed4-cf6f81db71df service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:40.477420 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a4832b-2ab5-4588-aed4-cf6f81db71df service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:32:40.479300 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a4832b-2ab5-4588-aed4-cf6f81db71df service swift] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:32:40.489464 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1217/2454] 10.222.0.60 () {60 vars in 1384 bytes} [Tue Aug 30 01:32:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 01:32:41.652944 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5014292d-48ef-47e1-b830-e48b0383e879 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:41.653460 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5014292d-48ef-47e1-b830-e48b0383e879 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:41.653460 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5014292d-48ef-47e1-b830-e48b0383e879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:41.674645 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-5014292d-48ef-47e1-b830-e48b0383e879 None None] MFA Rules not processed for user `edc11f8a9c5843939ec230e63ca7fa3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:32:41.678476 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-5014292d-48ef-47e1-b830-e48b0383e879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:32:41.688263 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1238/2455] 10.222.0.60 () {58 vars in 1009 bytes} [Tue Aug 30 01:32:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:32:41.713424 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a4832b-2ab5-4588-aed4-cf6f81db71df service swift] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:32:41.730734 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a4832b-2ab5-4588-aed4-cf6f81db71df service swift] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:32:41.744542 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ea7ca4-0f3f-4666-8e66-76667c1935f4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7de1f31ef84d529bf2c53ce0f7e38b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:32:41.745385 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea7ca4-0f3f-4666-8e66-76667c1935f4 service swift] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:41.745980 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea7ca4-0f3f-4666-8e66-76667c1935f4 service swift] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:41.746314 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea7ca4-0f3f-4666-8e66-76667c1935f4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:41.764284 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ea7ca4-0f3f-4666-8e66-76667c1935f4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:32:41.766239 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ea7ca4-0f3f-4666-8e66-76667c1935f4 service swift] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:32:41.777406 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1218/2456] 10.222.0.60 () {60 vars in 1384 bytes} [Tue Aug 30 01:32:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 01:32:51.668375 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=9 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:32:51.772653 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=45 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:32:55.679606 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5014292d-48ef-47e1-b830-e48b0383e879 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:32:55.681200 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-5014292d-48ef-47e1-b830-e48b0383e879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:32:55.817136 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5014292d-48ef-47e1-b830-e48b0383e879 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:32:55.821356 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d5536-edfd-4bed-a4fb-f784f85f6614 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:32:55.821975 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d5536-edfd-4bed-a4fb-f784f85f6614 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:55.822257 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d5536-edfd-4bed-a4fb-f784f85f6614 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:55.822531 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d5536-edfd-4bed-a4fb-f784f85f6614 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:55.825090 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-361d5536-edfd-4bed-a4fb-f784f85f6614 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:32:55.953300 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361d5536-edfd-4bed-a4fb-f784f85f6614 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:32:55.955810 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361d5536-edfd-4bed-a4fb-f784f85f6614 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:32:55.970712 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1239/2457] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:32:55 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:32:56.857433 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ea7ca4-0f3f-4666-8e66-76667c1935f4 service swift] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:32:56.859005 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-24ea7ca4-0f3f-4666-8e66-76667c1935f4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:32:56.946834 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ea7ca4-0f3f-4666-8e66-76667c1935f4 service swift] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:32:56.952611 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d5f1e-4baa-43a9-908b-50514d030b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:32:56.953584 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d5f1e-4baa-43a9-908b-50514d030b42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:56.953933 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d5f1e-4baa-43a9-908b-50514d030b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:56.954278 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d5f1e-4baa-43a9-908b-50514d030b42 admin admin] PATH_INFO: `/v3/users/3d570a850abf41eda292efa5b88b4326` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:56.955978 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79d5f1e-4baa-43a9-908b-50514d030b42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d570a850abf41eda292efa5b88b4326)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:32:56.959002 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79d5f1e-4baa-43a9-908b-50514d030b42 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:32:57.023162 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-d79d5f1e-4baa-43a9-908b-50514d030b42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d570a850abf41eda292efa5b88b4326'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:32:57.033389 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-d79d5f1e-4baa-43a9-908b-50514d030b42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d570a850abf41eda292efa5b88b4326'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:32:57.034132 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-d79d5f1e-4baa-43a9-908b-50514d030b42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d570a850abf41eda292efa5b88b4326'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:32:57.034779 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-d79d5f1e-4baa-43a9-908b-50514d030b42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d570a850abf41eda292efa5b88b4326'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:32:57.053530 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-d79d5f1e-4baa-43a9-908b-50514d030b42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d570a850abf41eda292efa5b88b4326'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:32:57.066931 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1219/2458] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:32:56 2022] DELETE /identity/v3/users/3d570a850abf41eda292efa5b88b4326 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:32:57.244614 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d5536-edfd-4bed-a4fb-f784f85f6614 service neutron] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:32:57.258115 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d5536-edfd-4bed-a4fb-f784f85f6614 service neutron] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:32:57.323332 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fbbfca-43c1-46f2-a635-a6295c7b9b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:32:57.324022 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fbbfca-43c1-46f2-a635-a6295c7b9b9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:57.324304 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fbbfca-43c1-46f2-a635-a6295c7b9b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:57.324575 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fbbfca-43c1-46f2-a635-a6295c7b9b9e admin admin] PATH_INFO: `/v3/projects/e71a2d25e03d4192a61d4a5ddc69f312` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:57.325730 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fbbfca-43c1-46f2-a635-a6295c7b9b9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e71a2d25e03d4192a61d4a5ddc69f312)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:32:57.327756 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fbbfca-43c1-46f2-a635-a6295c7b9b9e admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:32:57.377840 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-65fbbfca-43c1-46f2-a635-a6295c7b9b9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e71a2d25e03d4192a61d4a5ddc69f312', 'request_id': 'req-65fbbfca-43c1-46f2-a635-a6295c7b9b9e'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:32:57.381786 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:32:57.387258 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-65fbbfca-43c1-46f2-a635-a6295c7b9b9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e71a2d25e03d4192a61d4a5ddc69f312', 'request_id': 'req-65fbbfca-43c1-46f2-a635-a6295c7b9b9e'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:32:57.397704 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-65fbbfca-43c1-46f2-a635-a6295c7b9b9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e71a2d25e03d4192a61d4a5ddc69f312', 'request_id': 'req-65fbbfca-43c1-46f2-a635-a6295c7b9b9e'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:32:57.411218 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-65fbbfca-43c1-46f2-a635-a6295c7b9b9e admin admin] The token cache is being invalidate because project e71a2d25e03d4192a61d4a5ddc69f312 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:32:57.411640 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-65fbbfca-43c1-46f2-a635-a6295c7b9b9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:32:57.412449 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-65fbbfca-43c1-46f2-a635-a6295c7b9b9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:32:57.414189 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1240/2459] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:32:57 2022] DELETE /identity/v3/projects/e71a2d25e03d4192a61d4a5ddc69f312 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:32:57.418506 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d5f1e-4baa-43a9-908b-50514d030b42 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:32:57.420150 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-d79d5f1e-4baa-43a9-908b-50514d030b42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:32:57.433563 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d5f1e-4baa-43a9-908b-50514d030b42 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:32:57.493423 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f2c080-35bd-4714-becd-f6de40ba410a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:32:57.494056 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f2c080-35bd-4714-becd-f6de40ba410a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:57.494334 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f2c080-35bd-4714-becd-f6de40ba410a admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:57.494609 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f2c080-35bd-4714-becd-f6de40ba410a admin admin] PATH_INFO: `/v3/users/9a064b04a343447e963f317492d961ba` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:57.495868 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f2c080-35bd-4714-becd-f6de40ba410a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a064b04a343447e963f317492d961ba)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:32:57.497724 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f2c080-35bd-4714-becd-f6de40ba410a admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:32:57.523234 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:32:57.553340 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-86f2c080-35bd-4714-becd-f6de40ba410a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a064b04a343447e963f317492d961ba'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:32:57.562378 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-86f2c080-35bd-4714-becd-f6de40ba410a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a064b04a343447e963f317492d961ba'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:32:57.563026 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-86f2c080-35bd-4714-becd-f6de40ba410a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a064b04a343447e963f317492d961ba'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:32:57.563688 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-86f2c080-35bd-4714-becd-f6de40ba410a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a064b04a343447e963f317492d961ba'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:32:57.576829 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-86f2c080-35bd-4714-becd-f6de40ba410a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a064b04a343447e963f317492d961ba'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:32:57.589662 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1220/2460] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:32:57 2022] DELETE /identity/v3/users/9a064b04a343447e963f317492d961ba => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:32:57.830121 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fbbfca-43c1-46f2-a635-a6295c7b9b9e admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:32:57.832295 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-65fbbfca-43c1-46f2-a635-a6295c7b9b9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:32:57.862507 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fbbfca-43c1-46f2-a635-a6295c7b9b9e admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:32:57.954116 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0cb83e-d3f0-4cdd-b16e-9ce84ac80d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:32:57.955300 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0cb83e-d3f0-4cdd-b16e-9ce84ac80d3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:57.955699 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0cb83e-d3f0-4cdd-b16e-9ce84ac80d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:57.956282 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0cb83e-d3f0-4cdd-b16e-9ce84ac80d3e admin admin] PATH_INFO: `/v3/projects/ab1894d1c6224d66a0367788aacd68f2` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:57.957951 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0cb83e-d3f0-4cdd-b16e-9ce84ac80d3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab1894d1c6224d66a0367788aacd68f2)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:32:57.961524 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0cb83e-d3f0-4cdd-b16e-9ce84ac80d3e admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:32:58.065839 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-dc0cb83e-d3f0-4cdd-b16e-9ce84ac80d3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab1894d1c6224d66a0367788aacd68f2', 'request_id': 'req-dc0cb83e-d3f0-4cdd-b16e-9ce84ac80d3e'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:32:58.082566 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-dc0cb83e-d3f0-4cdd-b16e-9ce84ac80d3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab1894d1c6224d66a0367788aacd68f2', 'request_id': 'req-dc0cb83e-d3f0-4cdd-b16e-9ce84ac80d3e'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:32:58.095319 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-dc0cb83e-d3f0-4cdd-b16e-9ce84ac80d3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab1894d1c6224d66a0367788aacd68f2', 'request_id': 'req-dc0cb83e-d3f0-4cdd-b16e-9ce84ac80d3e'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:32:58.120539 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-dc0cb83e-d3f0-4cdd-b16e-9ce84ac80d3e admin admin] The token cache is being invalidate because project ab1894d1c6224d66a0367788aacd68f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:32:58.120968 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-dc0cb83e-d3f0-4cdd-b16e-9ce84ac80d3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:32:58.121713 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-dc0cb83e-d3f0-4cdd-b16e-9ce84ac80d3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:32:58.133285 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1241/2461] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:32:57 2022] DELETE /identity/v3/projects/ab1894d1c6224d66a0367788aacd68f2 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:32:58.136003 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d9b1a-7208-4e3e-b0a8-2b1da355a398 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:58.136859 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d9b1a-7208-4e3e-b0a8-2b1da355a398 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:58.137335 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d9b1a-7208-4e3e-b0a8-2b1da355a398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:58.165221 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-be5d9b1a-7208-4e3e-b0a8-2b1da355a398 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:32:58.166526 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-be5d9b1a-7208-4e3e-b0a8-2b1da355a398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:32:58.247321 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1221/2462] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:32:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:32:58.249924 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d340f758-8913-42ef-8d0f-abc1801aed78 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:58.250391 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d340f758-8913-42ef-8d0f-abc1801aed78 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:58.250502 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d340f758-8913-42ef-8d0f-abc1801aed78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:58.272078 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-d340f758-8913-42ef-8d0f-abc1801aed78 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:32:58.273344 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-d340f758-8913-42ef-8d0f-abc1801aed78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:32:58.286912 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1242/2463] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:32:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:32:58.291124 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d9b1a-7208-4e3e-b0a8-2b1da355a398 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:32:58.303864 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d9b1a-7208-4e3e-b0a8-2b1da355a398 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:32:58.309027 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee60cad8-b69e-4c7b-8e05-a8ef5beb3b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:32:58.309438 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60cad8-b69e-4c7b-8e05-a8ef5beb3b7a admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:58.309725 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60cad8-b69e-4c7b-8e05-a8ef5beb3b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:58.309995 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60cad8-b69e-4c7b-8e05-a8ef5beb3b7a admin admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:58.310648 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee60cad8-b69e-4c7b-8e05-a8ef5beb3b7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:32:58.310965 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee60cad8-b69e-4c7b-8e05-a8ef5beb3b7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:32:58.312596 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee60cad8-b69e-4c7b-8e05-a8ef5beb3b7a admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:32:58.325663 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1222/2464] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 30 01:32:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:32:58.330430 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d340f758-8913-42ef-8d0f-abc1801aed78 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:32:58.341360 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d340f758-8913-42ef-8d0f-abc1801aed78 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:32:58.346242 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c738e226-30d7-4ec2-a209-c3a125bda179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:32:58.346850 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c738e226-30d7-4ec2-a209-c3a125bda179 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:58.347131 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c738e226-30d7-4ec2-a209-c3a125bda179 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:58.347401 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c738e226-30d7-4ec2-a209-c3a125bda179 admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:58.348076 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c738e226-30d7-4ec2-a209-c3a125bda179 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:32:58.350725 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c738e226-30d7-4ec2-a209-c3a125bda179 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:32:58.380257 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1243/2465] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:32:58 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:32:58.384599 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee60cad8-b69e-4c7b-8e05-a8ef5beb3b7a admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:32:58.398989 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee60cad8-b69e-4c7b-8e05-a8ef5beb3b7a admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:32:58.505575 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef2572-b804-496f-a07e-bafecbdf993e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:32:58.506509 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef2572-b804-496f-a07e-bafecbdf993e admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:58.506786 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef2572-b804-496f-a07e-bafecbdf993e admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:58.507054 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef2572-b804-496f-a07e-bafecbdf993e admin admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:58.507775 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ef2572-b804-496f-a07e-bafecbdf993e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:32:58.510119 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ef2572-b804-496f-a07e-bafecbdf993e admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:32:58.560659 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1223/2466] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:32:58 2022] POST /identity/v3/users => generated 287 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:32:58.565113 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c738e226-30d7-4ec2-a209-c3a125bda179 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:32:58.582209 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c738e226-30d7-4ec2-a209-c3a125bda179 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:32:58.588267 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b762911b-56aa-477d-a20e-419bcc45e303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:32:58.592783 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b762911b-56aa-477d-a20e-419bcc45e303 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:58.592783 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b762911b-56aa-477d-a20e-419bcc45e303 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:58.592783 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b762911b-56aa-477d-a20e-419bcc45e303 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:58.592783 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b762911b-56aa-477d-a20e-419bcc45e303 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:32:58.592783 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b762911b-56aa-477d-a20e-419bcc45e303 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:32:58.623008 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1244/2467] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:32:58 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:32:58.627599 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef2572-b804-496f-a07e-bafecbdf993e admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:32:58.645121 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef2572-b804-496f-a07e-bafecbdf993e admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:32:58.650873 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c05f1-d337-46c8-bed6-7a302f4c087f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:32:58.651755 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c05f1-d337-46c8-bed6-7a302f4c087f admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:58.652128 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c05f1-d337-46c8-bed6-7a302f4c087f admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:58.652494 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c05f1-d337-46c8-bed6-7a302f4c087f admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:58.653241 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170c05f1-d337-46c8-bed6-7a302f4c087f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:32:58.667695 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170c05f1-d337-46c8-bed6-7a302f4c087f admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:32:58.667978 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1224/2468] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:32:58 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:32:58.672169 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b762911b-56aa-477d-a20e-419bcc45e303 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:32:58.683058 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b762911b-56aa-477d-a20e-419bcc45e303 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:32:58.689140 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d782a0-c40b-4907-807b-a95c8ee3a7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:32:58.689878 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d782a0-c40b-4907-807b-a95c8ee3a7a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:58.690227 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d782a0-c40b-4907-807b-a95c8ee3a7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:58.690568 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d782a0-c40b-4907-807b-a95c8ee3a7a0 admin admin] PATH_INFO: `/v3/projects/040121bc700241a0839e1d418f855d2c/users/c4037b6643324ecfb68a3acb70eb4fe9/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:58.709730 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d782a0-c40b-4907-807b-a95c8ee3a7a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=040121bc700241a0839e1d418f855d2c, user_id=c4037b6643324ecfb68a3acb70eb4fe9, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:32:58.713192 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d782a0-c40b-4907-807b-a95c8ee3a7a0 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:32:58.728663 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1245/2469] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:32:58 2022] PUT /identity/v3/projects/040121bc700241a0839e1d418f855d2c/users/c4037b6643324ecfb68a3acb70eb4fe9/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:32:58.738058 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800c119-74d6-486c-b3f4-dca2afbba5f2 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:58.738419 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800c119-74d6-486c-b3f4-dca2afbba5f2 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:58.738762 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800c119-74d6-486c-b3f4-dca2afbba5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:58.747346 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:32:58.780180 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-8800c119-74d6-486c-b3f4-dca2afbba5f2 None None] MFA Rules not processed for user `c4037b6643324ecfb68a3acb70eb4fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:32:58.781590 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-8800c119-74d6-486c-b3f4-dca2afbba5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:32:58.875745 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1225/2470] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:32:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:32:58.887582 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d782a0-c40b-4907-807b-a95c8ee3a7a0 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:32:58.889282 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-c6d782a0-c40b-4907-807b-a95c8ee3a7a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:32:58.917010 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:32:59.003839 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d782a0-c40b-4907-807b-a95c8ee3a7a0 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:32:59.015667 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a69f5-cf19-44be-8ef1-60ce890237af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:32:59.016312 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a69f5-cf19-44be-8ef1-60ce890237af service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:59.016604 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a69f5-cf19-44be-8ef1-60ce890237af service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:59.016872 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a69f5-cf19-44be-8ef1-60ce890237af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:59.038843 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24a69f5-cf19-44be-8ef1-60ce890237af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:32:59.040821 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24a69f5-cf19-44be-8ef1-60ce890237af service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:32:59.063407 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1246/2471] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:32:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:32:59.107098 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8800c119-74d6-486c-b3f4-dca2afbba5f2 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:32:59.198364 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8800c119-74d6-486c-b3f4-dca2afbba5f2 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:32:59.206376 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf7f61a-26a4-4ab5-b741-32b1bd8b46d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:32:59.207103 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7f61a-26a4-4ab5-b741-32b1bd8b46d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:59.207465 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7f61a-26a4-4ab5-b741-32b1bd8b46d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:59.207755 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7f61a-26a4-4ab5-b741-32b1bd8b46d5 admin admin] PATH_INFO: `/v3/users/c4037b6643324ecfb68a3acb70eb4fe9` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:59.208910 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf7f61a-26a4-4ab5-b741-32b1bd8b46d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4037b6643324ecfb68a3acb70eb4fe9)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:32:59.211105 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf7f61a-26a4-4ab5-b741-32b1bd8b46d5 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:32:59.260360 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-ddf7f61a-26a4-4ab5-b741-32b1bd8b46d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4037b6643324ecfb68a3acb70eb4fe9'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:32:59.269209 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-ddf7f61a-26a4-4ab5-b741-32b1bd8b46d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4037b6643324ecfb68a3acb70eb4fe9'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:32:59.269825 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-ddf7f61a-26a4-4ab5-b741-32b1bd8b46d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4037b6643324ecfb68a3acb70eb4fe9'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:32:59.271834 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-ddf7f61a-26a4-4ab5-b741-32b1bd8b46d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4037b6643324ecfb68a3acb70eb4fe9'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:32:59.284702 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-ddf7f61a-26a4-4ab5-b741-32b1bd8b46d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4037b6643324ecfb68a3acb70eb4fe9'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:32:59.297431 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1226/2472] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:32:59 2022] DELETE /identity/v3/users/c4037b6643324ecfb68a3acb70eb4fe9 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:32:59.302621 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615e94b-c1c0-44f4-8826-d39429e3d5dd None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:59.303137 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615e94b-c1c0-44f4-8826-d39429e3d5dd None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:59.303238 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615e94b-c1c0-44f4-8826-d39429e3d5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:59.322590 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-7615e94b-c1c0-44f4-8826-d39429e3d5dd None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:32:59.323917 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-7615e94b-c1c0-44f4-8826-d39429e3d5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:32:59.384570 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1247/2473] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:32:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:32:59.394457 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf7f61a-26a4-4ab5-b741-32b1bd8b46d5 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:32:59.395950 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-ddf7f61a-26a4-4ab5-b741-32b1bd8b46d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:32:59.411344 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:32:59.463205 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf7f61a-26a4-4ab5-b741-32b1bd8b46d5 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:32:59.466795 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71764c74-363f-437c-a5ea-2cac0dc530bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:32:59.467410 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71764c74-363f-437c-a5ea-2cac0dc530bc service neutron] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:59.467716 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71764c74-363f-437c-a5ea-2cac0dc530bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:59.467990 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71764c74-363f-437c-a5ea-2cac0dc530bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:59.478203 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71764c74-363f-437c-a5ea-2cac0dc530bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:32:59.479689 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71764c74-363f-437c-a5ea-2cac0dc530bc service neutron] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:32:59.491199 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1227/2474] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:32:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:32:59.903138 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7615e94b-c1c0-44f4-8826-d39429e3d5dd None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:32:59.904809 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-7615e94b-c1c0-44f4-8826-d39429e3d5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:32:59.923943 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7615e94b-c1c0-44f4-8826-d39429e3d5dd None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:32:59.933878 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57e30b-13d9-4f85-a5f3-d507b962e6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:32:59.935165 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57e30b-13d9-4f85-a5f3-d507b962e6e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:32:59.935762 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57e30b-13d9-4f85-a5f3-d507b962e6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:32:59.936115 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57e30b-13d9-4f85-a5f3-d507b962e6e4 admin admin] PATH_INFO: `/v3/projects/040121bc700241a0839e1d418f855d2c` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:32:59.937789 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c57e30b-13d9-4f85-a5f3-d507b962e6e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=040121bc700241a0839e1d418f855d2c)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:32:59.941027 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c57e30b-13d9-4f85-a5f3-d507b962e6e4 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:33:00.013944 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-6c57e30b-13d9-4f85-a5f3-d507b962e6e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '040121bc700241a0839e1d418f855d2c', 'request_id': 'req-6c57e30b-13d9-4f85-a5f3-d507b962e6e4'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:33:00.025475 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-6c57e30b-13d9-4f85-a5f3-d507b962e6e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '040121bc700241a0839e1d418f855d2c', 'request_id': 'req-6c57e30b-13d9-4f85-a5f3-d507b962e6e4'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:33:00.038271 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-6c57e30b-13d9-4f85-a5f3-d507b962e6e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '040121bc700241a0839e1d418f855d2c', 'request_id': 'req-6c57e30b-13d9-4f85-a5f3-d507b962e6e4'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:33:00.051543 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-6c57e30b-13d9-4f85-a5f3-d507b962e6e4 admin admin] The token cache is being invalidate because project 040121bc700241a0839e1d418f855d2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:33:00.052038 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-6c57e30b-13d9-4f85-a5f3-d507b962e6e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:33:00.052776 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-6c57e30b-13d9-4f85-a5f3-d507b962e6e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:33:00.054636 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1248/2475] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:32:59 2022] DELETE /identity/v3/projects/040121bc700241a0839e1d418f855d2c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:33:00.059283 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ae516-559b-410f-94c9-d2b65d84ea6f None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:33:00.059706 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ae516-559b-410f-94c9-d2b65d84ea6f None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:33:00.060350 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ae516-559b-410f-94c9-d2b65d84ea6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:33:00.086089 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-ae0ae516-559b-410f-94c9-d2b65d84ea6f None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:33:00.088844 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-ae0ae516-559b-410f-94c9-d2b65d84ea6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:33:00.170151 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1228/2476] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:33:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:33:00.177694 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e8840-9a61-4ace-922f-20329bc2bf8e None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:33:00.177976 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e8840-9a61-4ace-922f-20329bc2bf8e None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:33:00.178247 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e8840-9a61-4ace-922f-20329bc2bf8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:33:00.210979 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-225e8840-9a61-4ace-922f-20329bc2bf8e None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:33:00.212467 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-225e8840-9a61-4ace-922f-20329bc2bf8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:33:00.226660 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1249/2477] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:33:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:33:00.228244 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0ae516-559b-410f-94c9-d2b65d84ea6f None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:33:00.242133 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0ae516-559b-410f-94c9-d2b65d84ea6f None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:33:00.247270 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf7795e-566d-487c-909d-5f57461d7a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:33:00.248018 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf7795e-566d-487c-909d-5f57461d7a67 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:33:00.248359 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf7795e-566d-487c-909d-5f57461d7a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:33:00.248705 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf7795e-566d-487c-909d-5f57461d7a67 admin admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:33:00.249429 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf7795e-566d-487c-909d-5f57461d7a67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:33:00.249797 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf7795e-566d-487c-909d-5f57461d7a67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:33:00.251403 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf7795e-566d-487c-909d-5f57461d7a67 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:33:00.271881 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1229/2478] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 30 01:33:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:33:00.272495 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225e8840-9a61-4ace-922f-20329bc2bf8e None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:33:00.282684 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225e8840-9a61-4ace-922f-20329bc2bf8e None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:33:00.287664 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8878ac-44a5-48e3-9b1c-50a64285a9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:33:00.288276 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8878ac-44a5-48e3-9b1c-50a64285a9b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:33:00.288554 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8878ac-44a5-48e3-9b1c-50a64285a9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:33:00.288821 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8878ac-44a5-48e3-9b1c-50a64285a9b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:33:00.289469 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8878ac-44a5-48e3-9b1c-50a64285a9b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:33:00.291631 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8878ac-44a5-48e3-9b1c-50a64285a9b2 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:33:00.327730 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1250/2479] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:33:00 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:33:00.331993 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf7795e-566d-487c-909d-5f57461d7a67 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:33:00.346315 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf7795e-566d-487c-909d-5f57461d7a67 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:33:00.429790 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d9d88-26d5-4b00-8454-bd396877a0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:33:00.430401 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d9d88-26d5-4b00-8454-bd396877a0d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:33:00.430676 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d9d88-26d5-4b00-8454-bd396877a0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:33:00.430944 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d9d88-26d5-4b00-8454-bd396877a0d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:33:00.431701 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2d9d88-26d5-4b00-8454-bd396877a0d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:33:00.433619 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2d9d88-26d5-4b00-8454-bd396877a0d6 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:33:00.455866 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1230/2480] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:33:00 2022] POST /identity/v3/users => generated 287 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:33:00.460712 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8878ac-44a5-48e3-9b1c-50a64285a9b2 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:33:00.467982 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:33:00.472346 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8878ac-44a5-48e3-9b1c-50a64285a9b2 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:33:00.479129 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c08e2df-9594-4991-a915-9f22303b6801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:33:00.479893 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08e2df-9594-4991-a915-9f22303b6801 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:33:00.480228 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08e2df-9594-4991-a915-9f22303b6801 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:33:00.480587 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08e2df-9594-4991-a915-9f22303b6801 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:33:00.481431 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c08e2df-9594-4991-a915-9f22303b6801 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:33:00.483464 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c08e2df-9594-4991-a915-9f22303b6801 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:33:00.494204 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1251/2481] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:33:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:33:00.498156 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d9d88-26d5-4b00-8454-bd396877a0d6 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:33:00.509939 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d9d88-26d5-4b00-8454-bd396877a0d6 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:33:00.516808 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ffc42f-0e68-4591-b9a6-92e6e0d8c54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:33:00.517437 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ffc42f-0e68-4591-b9a6-92e6e0d8c54f admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:33:00.517717 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ffc42f-0e68-4591-b9a6-92e6e0d8c54f admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:33:00.518016 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ffc42f-0e68-4591-b9a6-92e6e0d8c54f admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:33:00.518713 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ffc42f-0e68-4591-b9a6-92e6e0d8c54f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:33:00.520425 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ffc42f-0e68-4591-b9a6-92e6e0d8c54f admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:33:00.532340 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1231/2482] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:33:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:33:00.537017 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c08e2df-9594-4991-a915-9f22303b6801 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:33:00.551232 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c08e2df-9594-4991-a915-9f22303b6801 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:33:00.556451 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd75fe-07cb-43d5-b480-25af7e26e870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:33:00.557092 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd75fe-07cb-43d5-b480-25af7e26e870 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:33:00.557393 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd75fe-07cb-43d5-b480-25af7e26e870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:33:00.557681 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd75fe-07cb-43d5-b480-25af7e26e870 admin admin] PATH_INFO: `/v3/projects/04243d703d584e399a343db5f361d63f/users/40ad922e5a71424e8e2851d359980b96/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:33:00.572620 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcd75fe-07cb-43d5-b480-25af7e26e870 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04243d703d584e399a343db5f361d63f, user_id=40ad922e5a71424e8e2851d359980b96, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:33:00.575270 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcd75fe-07cb-43d5-b480-25af7e26e870 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:33:00.588957 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1252/2483] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:33:00 2022] PUT /identity/v3/projects/04243d703d584e399a343db5f361d63f/users/40ad922e5a71424e8e2851d359980b96/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:33:00.667169 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d68413-80ed-4c33-b034-19122643605c None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:33:00.667478 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d68413-80ed-4c33-b034-19122643605c None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:33:00.667759 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d68413-80ed-4c33-b034-19122643605c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:33:00.696050 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-12d68413-80ed-4c33-b034-19122643605c None None] MFA Rules not processed for user `40ad922e5a71424e8e2851d359980b96`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:33:00.697265 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-12d68413-80ed-4c33-b034-19122643605c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:33:00.706398 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:33:00.762598 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1232/2484] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:33:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:33:00.773739 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd75fe-07cb-43d5-b480-25af7e26e870 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:33:00.775469 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-1fcd75fe-07cb-43d5-b480-25af7e26e870 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:33:00.831347 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd75fe-07cb-43d5-b480-25af7e26e870 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:33:00.835942 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b649a613-2bf0-4b10-8d83-6634458170fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:33:00.836623 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b649a613-2bf0-4b10-8d83-6634458170fd service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:33:00.836902 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b649a613-2bf0-4b10-8d83-6634458170fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:33:00.837172 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b649a613-2bf0-4b10-8d83-6634458170fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:33:00.845292 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b649a613-2bf0-4b10-8d83-6634458170fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:33:00.846725 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b649a613-2bf0-4b10-8d83-6634458170fd service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:33:00.856179 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1253/2485] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:33:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:33:07.972896 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd43fe0-2cb3-4444-a3dc-9474959f5729 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:33:07.973440 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd43fe0-2cb3-4444-a3dc-9474959f5729 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:33:07.973620 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd43fe0-2cb3-4444-a3dc-9474959f5729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:33:07.993184 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-5bd43fe0-2cb3-4444-a3dc-9474959f5729 None None] MFA Rules not processed for user `a991f1a0f804497c91d21d69e33113ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:33:07.994393 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-5bd43fe0-2cb3-4444-a3dc-9474959f5729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:33:08.052105 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1233/2486] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:33:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:33:09.790393 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b649a613-2bf0-4b10-8d83-6634458170fd service cinder] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:33:09.792796 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-b649a613-2bf0-4b10-8d83-6634458170fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:33:09.891732 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b649a613-2bf0-4b10-8d83-6634458170fd service cinder] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:33:09.897499 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c09ec5-f7c8-421f-9d65-62f5477055c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:33:09.898392 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c09ec5-f7c8-421f-9d65-62f5477055c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:33:09.898512 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c09ec5-f7c8-421f-9d65-62f5477055c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:33:09.898738 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c09ec5-f7c8-421f-9d65-62f5477055c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:33:09.904189 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-99c09ec5-f7c8-421f-9d65-62f5477055c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:33:09.990737 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c09ec5-f7c8-421f-9d65-62f5477055c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:33:09.992245 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c09ec5-f7c8-421f-9d65-62f5477055c0 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:33:10.002284 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1254/2487] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:33:09 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:33:11.781049 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd43fe0-2cb3-4444-a3dc-9474959f5729 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:33:11.874626 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd43fe0-2cb3-4444-a3dc-9474959f5729 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:33:11.879304 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c878b3-d33f-4942-a086-16be39c40727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:33:11.880565 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c878b3-d33f-4942-a086-16be39c40727 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:33:11.880839 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c878b3-d33f-4942-a086-16be39c40727 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:33:11.881107 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c878b3-d33f-4942-a086-16be39c40727 admin admin] PATH_INFO: `/v3/users/40ad922e5a71424e8e2851d359980b96` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:33:11.882261 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c878b3-d33f-4942-a086-16be39c40727 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40ad922e5a71424e8e2851d359980b96)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:33:11.884221 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c878b3-d33f-4942-a086-16be39c40727 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:33:11.951790 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-b6c878b3-d33f-4942-a086-16be39c40727 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40ad922e5a71424e8e2851d359980b96'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:33:11.964981 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-b6c878b3-d33f-4942-a086-16be39c40727 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40ad922e5a71424e8e2851d359980b96'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:33:11.965724 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-b6c878b3-d33f-4942-a086-16be39c40727 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40ad922e5a71424e8e2851d359980b96'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:33:11.966418 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-b6c878b3-d33f-4942-a086-16be39c40727 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40ad922e5a71424e8e2851d359980b96'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:33:11.972753 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:33:11.985087 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-b6c878b3-d33f-4942-a086-16be39c40727 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40ad922e5a71424e8e2851d359980b96'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:33:12.003820 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1234/2488] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:33:11 2022] DELETE /identity/v3/users/40ad922e5a71424e8e2851d359980b96 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:33:12.012506 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627af914-c480-4b7f-ba1e-ec36b9b32181 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:33:12.013380 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627af914-c480-4b7f-ba1e-ec36b9b32181 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:33:12.013687 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627af914-c480-4b7f-ba1e-ec36b9b32181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:33:12.038760 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-627af914-c480-4b7f-ba1e-ec36b9b32181 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:33:12.040003 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-627af914-c480-4b7f-ba1e-ec36b9b32181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:33:12.064811 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:33:12.130795 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1255/2489] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:33:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:33:12.141541 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c878b3-d33f-4942-a086-16be39c40727 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:33:12.143122 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-b6c878b3-d33f-4942-a086-16be39c40727 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:33:12.264684 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c878b3-d33f-4942-a086-16be39c40727 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:33:12.268756 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5762d65-c976-4141-a06c-97e07ff90437 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:33:12.269611 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5762d65-c976-4141-a06c-97e07ff90437 service neutron] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:33:12.269966 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5762d65-c976-4141-a06c-97e07ff90437 service neutron] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:33:12.270264 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5762d65-c976-4141-a06c-97e07ff90437 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:33:12.280505 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5762d65-c976-4141-a06c-97e07ff90437 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:33:12.282043 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5762d65-c976-4141-a06c-97e07ff90437 service neutron] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:33:12.293062 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1235/2490] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:33:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:33:12.972517 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627af914-c480-4b7f-ba1e-ec36b9b32181 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:33:12.974021 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-627af914-c480-4b7f-ba1e-ec36b9b32181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:33:12.986116 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627af914-c480-4b7f-ba1e-ec36b9b32181 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:33:13.009723 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ae40b-ab5c-42b8-9d62-7992ad055d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:33:13.010471 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ae40b-ab5c-42b8-9d62-7992ad055d19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:33:13.010876 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ae40b-ab5c-42b8-9d62-7992ad055d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:33:13.011088 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ae40b-ab5c-42b8-9d62-7992ad055d19 admin admin] PATH_INFO: `/v3/projects/04243d703d584e399a343db5f361d63f` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:33:13.013886 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41ae40b-ab5c-42b8-9d62-7992ad055d19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04243d703d584e399a343db5f361d63f)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:33:13.016369 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41ae40b-ab5c-42b8-9d62-7992ad055d19 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:33:13.077710 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-c41ae40b-ab5c-42b8-9d62-7992ad055d19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04243d703d584e399a343db5f361d63f', 'request_id': 'req-c41ae40b-ab5c-42b8-9d62-7992ad055d19'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:33:13.090271 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-c41ae40b-ab5c-42b8-9d62-7992ad055d19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04243d703d584e399a343db5f361d63f', 'request_id': 'req-c41ae40b-ab5c-42b8-9d62-7992ad055d19'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:33:13.102546 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-c41ae40b-ab5c-42b8-9d62-7992ad055d19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04243d703d584e399a343db5f361d63f', 'request_id': 'req-c41ae40b-ab5c-42b8-9d62-7992ad055d19'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:33:13.125175 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-c41ae40b-ab5c-42b8-9d62-7992ad055d19 admin admin] The token cache is being invalidate because project 04243d703d584e399a343db5f361d63f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:33:13.125397 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-c41ae40b-ab5c-42b8-9d62-7992ad055d19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:33:13.126035 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-c41ae40b-ab5c-42b8-9d62-7992ad055d19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:33:13.128000 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1256/2491] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:33:12 2022] DELETE /identity/v3/projects/04243d703d584e399a343db5f361d63f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:33:22.131363 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c6123-23fd-44d0-8c65-87c1878014b4 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:33:22.131977 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c6123-23fd-44d0-8c65-87c1878014b4 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:33:22.131977 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c6123-23fd-44d0-8c65-87c1878014b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:33:22.151192 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-ac3c6123-23fd-44d0-8c65-87c1878014b4 None None] MFA Rules not processed for user `b9ee91e130434c8c9c7ce081dade1395`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:33:22.152426 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-ac3c6123-23fd-44d0-8c65-87c1878014b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:33:22.205982 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1236/2492] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:33:22 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:33:23.117382 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=44,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:33:32.199357 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:DELETE=2,keystone:SELECT=60 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:33:33.726712 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d71df7-dc7d-4aa8-bab6-88a6f5723158 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:33:33.727272 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d71df7-dc7d-4aa8-bab6-88a6f5723158 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:33:33.727272 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d71df7-dc7d-4aa8-bab6-88a6f5723158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:33:33.747352 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-d9d71df7-dc7d-4aa8-bab6-88a6f5723158 None None] MFA Rules not processed for user `0648872a9f8648ca803418bc3a3b04b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:33:33.748602 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-d9d71df7-dc7d-4aa8-bab6-88a6f5723158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:33:33.810719 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1257/2493] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:33:33 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:33:43.798638 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=25 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:34:22.720650 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c368ba-698b-4cff-a644-d96d2893ee78 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:34:22.721166 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c368ba-698b-4cff-a644-d96d2893ee78 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:34:22.721166 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c368ba-698b-4cff-a644-d96d2893ee78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:34:22.739764 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-41c368ba-698b-4cff-a644-d96d2893ee78 None None] MFA Rules not processed for user `a991f1a0f804497c91d21d69e33113ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:34:22.740952 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-41c368ba-698b-4cff-a644-d96d2893ee78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:34:22.795898 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1237/2494] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:34:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:34:26.750708 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d71df7-dc7d-4aa8-bab6-88a6f5723158 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:34:26.752517 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-d9d71df7-dc7d-4aa8-bab6-88a6f5723158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:34:26.815224 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d71df7-dc7d-4aa8-bab6-88a6f5723158 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:34:26.819026 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d49b0a8-7835-4ac0-aecf-3ca189eaa460 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:34:26.819669 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49b0a8-7835-4ac0-aecf-3ca189eaa460 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:34:26.819955 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49b0a8-7835-4ac0-aecf-3ca189eaa460 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:34:26.820227 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49b0a8-7835-4ac0-aecf-3ca189eaa460 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:34:26.822041 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-9d49b0a8-7835-4ac0-aecf-3ca189eaa460 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:34:26.908833 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d49b0a8-7835-4ac0-aecf-3ca189eaa460 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:34:26.910474 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d49b0a8-7835-4ac0-aecf-3ca189eaa460 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:34:26.922072 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1258/2495] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:34:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:34:27.040239 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c368ba-698b-4cff-a644-d96d2893ee78 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:34:27.044308 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-41c368ba-698b-4cff-a644-d96d2893ee78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:34:27.062256 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c368ba-698b-4cff-a644-d96d2893ee78 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:34:27.066124 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2340f29-d2dc-4ab8-841b-a1ec539199c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:34:27.066896 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2340f29-d2dc-4ab8-841b-a1ec539199c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:34:27.067365 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2340f29-d2dc-4ab8-841b-a1ec539199c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:34:27.067831 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2340f29-d2dc-4ab8-841b-a1ec539199c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:34:27.069765 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-c2340f29-d2dc-4ab8-841b-a1ec539199c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:34:27.153652 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2340f29-d2dc-4ab8-841b-a1ec539199c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:34:27.155110 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2340f29-d2dc-4ab8-841b-a1ec539199c2 service neutron] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:34:27.165854 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1238/2496] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:34:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:34:29.394369 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d49b0a8-7835-4ac0-aecf-3ca189eaa460 service neutron] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:34:29.406182 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d49b0a8-7835-4ac0-aecf-3ca189eaa460 service neutron] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:34:29.412732 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc213b0-f877-475a-92ea-b2c5efbdb7bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:34:29.413654 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc213b0-f877-475a-92ea-b2c5efbdb7bb service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:34:29.413934 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc213b0-f877-475a-92ea-b2c5efbdb7bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:34:29.414219 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc213b0-f877-475a-92ea-b2c5efbdb7bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:34:29.417553 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-5fc213b0-f877-475a-92ea-b2c5efbdb7bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:34:29.460601 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc213b0-f877-475a-92ea-b2c5efbdb7bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:34:29.463407 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc213b0-f877-475a-92ea-b2c5efbdb7bb service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:34:29.482127 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1259/2497] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:34:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:34:31.414230 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2340f29-d2dc-4ab8-841b-a1ec539199c2 service neutron] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:34:31.415802 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-c2340f29-d2dc-4ab8-841b-a1ec539199c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:34:31.428339 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2340f29-d2dc-4ab8-841b-a1ec539199c2 service neutron] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:34:31.434684 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f164f8e-4531-4791-a762-2e5e9b10b6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:34:31.439459 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f164f8e-4531-4791-a762-2e5e9b10b6fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:34:31.440011 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f164f8e-4531-4791-a762-2e5e9b10b6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:34:31.440481 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f164f8e-4531-4791-a762-2e5e9b10b6fa admin admin] PATH_INFO: `/v3/users/b9ee91e130434c8c9c7ce081dade1395` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:34:31.442761 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f164f8e-4531-4791-a762-2e5e9b10b6fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9ee91e130434c8c9c7ce081dade1395)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:34:31.445066 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f164f8e-4531-4791-a762-2e5e9b10b6fa admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:34:31.506632 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-4f164f8e-4531-4791-a762-2e5e9b10b6fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9ee91e130434c8c9c7ce081dade1395'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:34:31.514630 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-4f164f8e-4531-4791-a762-2e5e9b10b6fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9ee91e130434c8c9c7ce081dade1395'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:34:31.515256 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-4f164f8e-4531-4791-a762-2e5e9b10b6fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9ee91e130434c8c9c7ce081dade1395'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:34:31.515876 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-4f164f8e-4531-4791-a762-2e5e9b10b6fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9ee91e130434c8c9c7ce081dade1395'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:34:31.528747 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-4f164f8e-4531-4791-a762-2e5e9b10b6fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9ee91e130434c8c9c7ce081dade1395'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:34:31.540719 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1239/2498] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:34:31 2022] DELETE /identity/v3/users/b9ee91e130434c8c9c7ce081dade1395 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:34:31.712445 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc213b0-f877-475a-92ea-b2c5efbdb7bb service neutron] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:34:31.725047 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc213b0-f877-475a-92ea-b2c5efbdb7bb service neutron] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:34:31.790312 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a25f76-3d18-42d1-94be-466254a859bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:34:31.790951 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a25f76-3d18-42d1-94be-466254a859bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:34:31.791233 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a25f76-3d18-42d1-94be-466254a859bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:34:31.791535 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a25f76-3d18-42d1-94be-466254a859bd admin admin] PATH_INFO: `/v3/projects/7e0e671b3fe3461da0aa1badfd844f78` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:34:31.792716 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a25f76-3d18-42d1-94be-466254a859bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e0e671b3fe3461da0aa1badfd844f78)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:34:31.794660 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a25f76-3d18-42d1-94be-466254a859bd admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:34:31.829405 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:34:31.842785 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-56a25f76-3d18-42d1-94be-466254a859bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e0e671b3fe3461da0aa1badfd844f78', 'request_id': 'req-56a25f76-3d18-42d1-94be-466254a859bd'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:34:31.848943 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-56a25f76-3d18-42d1-94be-466254a859bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e0e671b3fe3461da0aa1badfd844f78', 'request_id': 'req-56a25f76-3d18-42d1-94be-466254a859bd'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:34:31.856614 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-56a25f76-3d18-42d1-94be-466254a859bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e0e671b3fe3461da0aa1badfd844f78', 'request_id': 'req-56a25f76-3d18-42d1-94be-466254a859bd'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:34:31.867368 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-56a25f76-3d18-42d1-94be-466254a859bd admin admin] The token cache is being invalidate because project 7e0e671b3fe3461da0aa1badfd844f78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:34:31.868199 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-56a25f76-3d18-42d1-94be-466254a859bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:34:31.868881 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-56a25f76-3d18-42d1-94be-466254a859bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:34:31.870367 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1260/2499] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:34:31 2022] DELETE /identity/v3/projects/7e0e671b3fe3461da0aa1badfd844f78 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:34:31.875273 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aacf5d8-121c-4034-b6ae-00940b17fa6b None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:34:31.875596 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aacf5d8-121c-4034-b6ae-00940b17fa6b None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:34:31.875873 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aacf5d8-121c-4034-b6ae-00940b17fa6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:34:31.896032 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-7aacf5d8-121c-4034-b6ae-00940b17fa6b None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:34:31.897155 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-7aacf5d8-121c-4034-b6ae-00940b17fa6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:34:31.902402 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:34:31.964569 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1240/2500] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:34:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:34:31.972766 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe9289-ef4f-4941-8727-f18710b16ae4 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:34:31.973056 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe9289-ef4f-4941-8727-f18710b16ae4 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:34:31.973330 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe9289-ef4f-4941-8727-f18710b16ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:34:31.995563 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-e2fe9289-ef4f-4941-8727-f18710b16ae4 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:34:31.996794 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-e2fe9289-ef4f-4941-8727-f18710b16ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:34:32.006265 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1261/2501] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:34:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:34:32.012008 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aacf5d8-121c-4034-b6ae-00940b17fa6b None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:34:32.022101 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aacf5d8-121c-4034-b6ae-00940b17fa6b None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:34:32.027248 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e548ae-707b-4115-b2ba-287212610207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:34:32.028007 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e548ae-707b-4115-b2ba-287212610207 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:34:32.028389 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e548ae-707b-4115-b2ba-287212610207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:34:32.028887 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e548ae-707b-4115-b2ba-287212610207 admin admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:34:32.029514 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e548ae-707b-4115-b2ba-287212610207 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:34:32.029974 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e548ae-707b-4115-b2ba-287212610207 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:34:32.031691 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e548ae-707b-4115-b2ba-287212610207 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:34:32.048687 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1241/2502] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 30 01:34:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:34:32.050082 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe9289-ef4f-4941-8727-f18710b16ae4 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:34:32.061592 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe9289-ef4f-4941-8727-f18710b16ae4 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:34:32.067015 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce4b81f-bb4a-49ab-a499-b6d1cf7abdfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:34:32.067739 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce4b81f-bb4a-49ab-a499-b6d1cf7abdfd admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:34:32.068125 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce4b81f-bb4a-49ab-a499-b6d1cf7abdfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:34:32.068502 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce4b81f-bb4a-49ab-a499-b6d1cf7abdfd admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:34:32.069251 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce4b81f-bb4a-49ab-a499-b6d1cf7abdfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:34:32.071305 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce4b81f-bb4a-49ab-a499-b6d1cf7abdfd admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:34:32.102984 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1262/2503] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:34:32 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:34:32.107121 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e548ae-707b-4115-b2ba-287212610207 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:34:32.118682 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e548ae-707b-4115-b2ba-287212610207 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:34:32.185927 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8de7cb3-fcaf-4887-9259-f7aa51dad2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:34:32.186650 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de7cb3-fcaf-4887-9259-f7aa51dad2cf admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:34:32.186927 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de7cb3-fcaf-4887-9259-f7aa51dad2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:34:32.187197 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de7cb3-fcaf-4887-9259-f7aa51dad2cf admin admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:34:32.187910 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8de7cb3-fcaf-4887-9259-f7aa51dad2cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:34:32.189846 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8de7cb3-fcaf-4887-9259-f7aa51dad2cf admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:34:32.211565 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1242/2504] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:34:32 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:34:32.216188 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce4b81f-bb4a-49ab-a499-b6d1cf7abdfd admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:34:32.227705 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce4b81f-bb4a-49ab-a499-b6d1cf7abdfd admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:34:32.233025 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682025e-eb32-4df5-86c1-22e99e8e9bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:34:32.233787 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682025e-eb32-4df5-86c1-22e99e8e9bb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:34:32.234078 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682025e-eb32-4df5-86c1-22e99e8e9bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:34:32.234453 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682025e-eb32-4df5-86c1-22e99e8e9bb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:34:32.235109 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0682025e-eb32-4df5-86c1-22e99e8e9bb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:34:32.236777 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0682025e-eb32-4df5-86c1-22e99e8e9bb0 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:34:32.251412 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1263/2505] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:34:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:34:32.252631 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8de7cb3-fcaf-4887-9259-f7aa51dad2cf admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:34:32.263690 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8de7cb3-fcaf-4887-9259-f7aa51dad2cf admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:34:32.272610 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7e2971-3476-4659-9bff-7d83f30b30d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:34:32.273225 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e2971-3476-4659-9bff-7d83f30b30d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:34:32.273525 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e2971-3476-4659-9bff-7d83f30b30d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:34:32.273821 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e2971-3476-4659-9bff-7d83f30b30d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:34:32.274977 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7e2971-3476-4659-9bff-7d83f30b30d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:34:32.276602 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7e2971-3476-4659-9bff-7d83f30b30d4 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:34:32.288766 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1243/2506] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:34:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:34:32.293279 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682025e-eb32-4df5-86c1-22e99e8e9bb0 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:34:32.303252 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682025e-eb32-4df5-86c1-22e99e8e9bb0 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:34:32.308031 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537631a1-fa88-407f-abd8-0b78654a76e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:34:32.308710 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537631a1-fa88-407f-abd8-0b78654a76e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:34:32.308989 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537631a1-fa88-407f-abd8-0b78654a76e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:34:32.309262 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537631a1-fa88-407f-abd8-0b78654a76e2 admin admin] PATH_INFO: `/v3/projects/899ee0b769b54dc9bda9bc474a3907f3/users/6077403c858243858f4a9dab97a7eac6/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:34:32.326019 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537631a1-fa88-407f-abd8-0b78654a76e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=899ee0b769b54dc9bda9bc474a3907f3, user_id=6077403c858243858f4a9dab97a7eac6, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:34:32.328824 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537631a1-fa88-407f-abd8-0b78654a76e2 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:34:32.343911 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1264/2507] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:34:32 2022] PUT /identity/v3/projects/899ee0b769b54dc9bda9bc474a3907f3/users/6077403c858243858f4a9dab97a7eac6/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:34:32.348734 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0848b15b-9231-4742-83ef-fd6fdb15cf51 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:34:32.349022 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0848b15b-9231-4742-83ef-fd6fdb15cf51 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:34:32.349300 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0848b15b-9231-4742-83ef-fd6fdb15cf51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:34:32.368439 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-0848b15b-9231-4742-83ef-fd6fdb15cf51 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:34:32.369657 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-0848b15b-9231-4742-83ef-fd6fdb15cf51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:34:32.430906 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1244/2508] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:34:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:34:32.440926 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537631a1-fa88-407f-abd8-0b78654a76e2 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:34:32.442619 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-537631a1-fa88-407f-abd8-0b78654a76e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:34:32.499051 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537631a1-fa88-407f-abd8-0b78654a76e2 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:34:32.502807 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5035b3c7-69a0-408b-8cfc-448438ff6db0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:34:32.503406 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5035b3c7-69a0-408b-8cfc-448438ff6db0 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:34:32.503778 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5035b3c7-69a0-408b-8cfc-448438ff6db0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:34:32.504046 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5035b3c7-69a0-408b-8cfc-448438ff6db0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:34:32.514224 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5035b3c7-69a0-408b-8cfc-448438ff6db0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:34:32.515700 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5035b3c7-69a0-408b-8cfc-448438ff6db0 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:34:32.525610 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1265/2509] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:34:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:34:37.664097 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dbb370-3673-4e80-a3b8-247ba6432d79 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:34:37.665043 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dbb370-3673-4e80-a3b8-247ba6432d79 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:34:37.665043 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dbb370-3673-4e80-a3b8-247ba6432d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:34:37.706009 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-f6dbb370-3673-4e80-a3b8-247ba6432d79 None None] MFA Rules not processed for user `6077403c858243858f4a9dab97a7eac6`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:34:37.709012 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-f6dbb370-3673-4e80-a3b8-247ba6432d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:34:37.715013 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:34:37.804167 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1245/2510] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:34:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:34:37.815148 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5035b3c7-69a0-408b-8cfc-448438ff6db0 service neutron] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:34:37.817568 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-5035b3c7-69a0-408b-8cfc-448438ff6db0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:34:37.894090 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:34:37.918703 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5035b3c7-69a0-408b-8cfc-448438ff6db0 service neutron] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:34:37.924997 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e016e18-a9a2-4379-b475-b148c2d8514e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8889145228a24fb6bd539a11925e62f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:34:37.925740 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e016e18-a9a2-4379-b475-b148c2d8514e service nova] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:34:37.926889 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e016e18-a9a2-4379-b475-b148c2d8514e service nova] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:34:37.926889 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e016e18-a9a2-4379-b475-b148c2d8514e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:34:37.946386 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e016e18-a9a2-4379-b475-b148c2d8514e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:34:37.954147 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e016e18-a9a2-4379-b475-b148c2d8514e service nova] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:34:37.970538 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1266/2511] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:34:37 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:34:38.615159 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dbb370-3673-4e80-a3b8-247ba6432d79 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:34:38.616740 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-f6dbb370-3673-4e80-a3b8-247ba6432d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:34:38.633796 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dbb370-3673-4e80-a3b8-247ba6432d79 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:34:38.641914 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede5b0a2-9956-4dd1-8ce7-ff19f75296b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8889145228a24fb6bd539a11925e62f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:34:38.642536 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede5b0a2-9956-4dd1-8ce7-ff19f75296b9 service nova] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:34:38.642833 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede5b0a2-9956-4dd1-8ce7-ff19f75296b9 service nova] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:34:38.643089 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede5b0a2-9956-4dd1-8ce7-ff19f75296b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:34:38.644893 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-ede5b0a2-9956-4dd1-8ce7-ff19f75296b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:34:38.721283 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede5b0a2-9956-4dd1-8ce7-ff19f75296b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:34:38.722918 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede5b0a2-9956-4dd1-8ce7-ff19f75296b9 service nova] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:34:38.733461 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1246/2512] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:34:38 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:34:39.460901 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b56ba-8239-4427-b163-837ac91ac035 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:34:39.461918 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b56ba-8239-4427-b163-837ac91ac035 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:34:39.462017 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b56ba-8239-4427-b163-837ac91ac035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:34:39.483113 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-f92b56ba-8239-4427-b163-837ac91ac035 None None] MFA Rules not processed for user `6077403c858243858f4a9dab97a7eac6`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:34:39.484434 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-f92b56ba-8239-4427-b163-837ac91ac035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:34:39.494960 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1267/2513] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:34:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:34:48.729067 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=52 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:34:49.476130 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=11 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:34:49.690645 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8ea41-b443-47ab-98b1-317a4e0d830a None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:34:49.690928 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8ea41-b443-47ab-98b1-317a4e0d830a None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:34:49.691199 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8ea41-b443-47ab-98b1-317a4e0d830a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:34:49.710325 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-0ad8ea41-b443-47ab-98b1-317a4e0d830a None None] MFA Rules not processed for user `edc11f8a9c5843939ec230e63ca7fa3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:34:49.712057 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-0ad8ea41-b443-47ab-98b1-317a4e0d830a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:34:49.765304 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1247/2514] 10.222.0.60 () {58 vars in 967 bytes} [Tue Aug 30 01:34:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:34:49.805425 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b56ba-8239-4427-b163-837ac91ac035 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:34:49.806805 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-f92b56ba-8239-4427-b163-837ac91ac035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:34:49.873884 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b56ba-8239-4427-b163-837ac91ac035 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:34:49.878877 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7de2c1-de6c-4161-9540-bbb37b6ca49e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7de1f31ef84d529bf2c53ce0f7e38b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:34:49.879513 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7de2c1-de6c-4161-9540-bbb37b6ca49e service swift] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:34:49.879798 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7de2c1-de6c-4161-9540-bbb37b6ca49e service swift] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:34:49.880073 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7de2c1-de6c-4161-9540-bbb37b6ca49e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:34:49.888256 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7de2c1-de6c-4161-9540-bbb37b6ca49e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:34:49.889843 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7de2c1-de6c-4161-9540-bbb37b6ca49e service swift] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:34:49.897988 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1268/2515] 10.222.0.60 () {60 vars in 1384 bytes} [Tue Aug 30 01:34:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 01:34:55.598751 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec59b46-11fc-43c0-9a68-875c17e5a6db None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:34:55.599300 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec59b46-11fc-43c0-9a68-875c17e5a6db None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:34:55.599396 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec59b46-11fc-43c0-9a68-875c17e5a6db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:34:55.621381 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-0ec59b46-11fc-43c0-9a68-875c17e5a6db None None] MFA Rules not processed for user `edc11f8a9c5843939ec230e63ca7fa3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:34:55.622614 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-0ec59b46-11fc-43c0-9a68-875c17e5a6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:34:55.631488 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1248/2516] 10.222.0.60 () {58 vars in 1009 bytes} [Tue Aug 30 01:34:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:34:55.645172 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7de2c1-de6c-4161-9540-bbb37b6ca49e service swift] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:34:55.657655 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7de2c1-de6c-4161-9540-bbb37b6ca49e service swift] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:34:55.663262 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9caebd-3654-4039-ad3f-3b9aa78d60cf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7de1f31ef84d529bf2c53ce0f7e38b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:34:55.664632 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9caebd-3654-4039-ad3f-3b9aa78d60cf service swift] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:34:55.664975 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9caebd-3654-4039-ad3f-3b9aa78d60cf service swift] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:34:55.665322 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9caebd-3654-4039-ad3f-3b9aa78d60cf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:34:55.681332 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9caebd-3654-4039-ad3f-3b9aa78d60cf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:34:55.684682 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9caebd-3654-4039-ad3f-3b9aa78d60cf service swift] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:34:55.695966 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1269/2517] 10.222.0.60 () {60 vars in 1384 bytes} [Tue Aug 30 01:34:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 01:34:58.545361 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec59b46-11fc-43c0-9a68-875c17e5a6db None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:34:58.547786 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-0ec59b46-11fc-43c0-9a68-875c17e5a6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:34:58.571369 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec59b46-11fc-43c0-9a68-875c17e5a6db None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:34:58.581017 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff3cea0-0a67-4179-9772-645bccaf32cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:34:58.581619 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3cea0-0a67-4179-9772-645bccaf32cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:34:58.581903 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3cea0-0a67-4179-9772-645bccaf32cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:34:58.582181 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3cea0-0a67-4179-9772-645bccaf32cb admin admin] PATH_INFO: `/v3/users/65516bd166104306a65071d951a65474` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:34:58.583349 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff3cea0-0a67-4179-9772-645bccaf32cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=65516bd166104306a65071d951a65474)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:34:58.585826 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff3cea0-0a67-4179-9772-645bccaf32cb admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:34:58.660885 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-dff3cea0-0a67-4179-9772-645bccaf32cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65516bd166104306a65071d951a65474'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:34:58.681556 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-dff3cea0-0a67-4179-9772-645bccaf32cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65516bd166104306a65071d951a65474'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:34:58.682600 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-dff3cea0-0a67-4179-9772-645bccaf32cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65516bd166104306a65071d951a65474'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:34:58.686349 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-dff3cea0-0a67-4179-9772-645bccaf32cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65516bd166104306a65071d951a65474'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:34:58.714359 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-dff3cea0-0a67-4179-9772-645bccaf32cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65516bd166104306a65071d951a65474'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:34:58.735879 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1249/2518] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:34:58 2022] DELETE /identity/v3/users/65516bd166104306a65071d951a65474 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:34:58.989889 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9caebd-3654-4039-ad3f-3b9aa78d60cf service swift] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:34:59.012714 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9caebd-3654-4039-ad3f-3b9aa78d60cf service swift] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:34:59.111919 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea27cba-1236-415c-a135-0d2530335a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:34:59.113983 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea27cba-1236-415c-a135-0d2530335a41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:34:59.114473 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea27cba-1236-415c-a135-0d2530335a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:34:59.114825 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea27cba-1236-415c-a135-0d2530335a41 admin admin] PATH_INFO: `/v3/projects/04fcedb090aa47a892fbacf37c9b25e4` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:34:59.116382 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea27cba-1236-415c-a135-0d2530335a41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04fcedb090aa47a892fbacf37c9b25e4)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:34:59.118935 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea27cba-1236-415c-a135-0d2530335a41 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:34:59.198716 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-0ea27cba-1236-415c-a135-0d2530335a41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04fcedb090aa47a892fbacf37c9b25e4', 'request_id': 'req-0ea27cba-1236-415c-a135-0d2530335a41'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:34:59.208743 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-0ea27cba-1236-415c-a135-0d2530335a41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04fcedb090aa47a892fbacf37c9b25e4', 'request_id': 'req-0ea27cba-1236-415c-a135-0d2530335a41'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:34:59.218653 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-0ea27cba-1236-415c-a135-0d2530335a41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04fcedb090aa47a892fbacf37c9b25e4', 'request_id': 'req-0ea27cba-1236-415c-a135-0d2530335a41'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:34:59.230991 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-0ea27cba-1236-415c-a135-0d2530335a41 admin admin] The token cache is being invalidate because project 04fcedb090aa47a892fbacf37c9b25e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:34:59.231310 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-0ea27cba-1236-415c-a135-0d2530335a41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:34:59.231999 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-0ea27cba-1236-415c-a135-0d2530335a41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:34:59.235636 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1270/2519] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:34:58 2022] DELETE /identity/v3/projects/04fcedb090aa47a892fbacf37c9b25e4 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:34:59.237790 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff3cea0-0a67-4179-9772-645bccaf32cb admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:34:59.243332 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-dff3cea0-0a67-4179-9772-645bccaf32cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:34:59.275617 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff3cea0-0a67-4179-9772-645bccaf32cb admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:34:59.363734 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b6751-fb15-4ab8-894e-9005a69abc56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:34:59.364763 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b6751-fb15-4ab8-894e-9005a69abc56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:34:59.365048 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b6751-fb15-4ab8-894e-9005a69abc56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:34:59.365329 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b6751-fb15-4ab8-894e-9005a69abc56 admin admin] PATH_INFO: `/v3/users/ddfb8d9f533042f8a8f88f33d55a741d` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:34:59.366661 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71b6751-fb15-4ab8-894e-9005a69abc56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddfb8d9f533042f8a8f88f33d55a741d)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:34:59.368641 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71b6751-fb15-4ab8-894e-9005a69abc56 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:34:59.386580 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:34:59.443402 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-a71b6751-fb15-4ab8-894e-9005a69abc56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddfb8d9f533042f8a8f88f33d55a741d'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:34:59.460277 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-a71b6751-fb15-4ab8-894e-9005a69abc56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddfb8d9f533042f8a8f88f33d55a741d'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:34:59.461012 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-a71b6751-fb15-4ab8-894e-9005a69abc56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddfb8d9f533042f8a8f88f33d55a741d'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:34:59.461636 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-a71b6751-fb15-4ab8-894e-9005a69abc56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddfb8d9f533042f8a8f88f33d55a741d'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:34:59.476721 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-a71b6751-fb15-4ab8-894e-9005a69abc56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddfb8d9f533042f8a8f88f33d55a741d'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:34:59.492935 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1250/2520] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:34:59 2022] DELETE /identity/v3/users/ddfb8d9f533042f8a8f88f33d55a741d => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:34:59.720386 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea27cba-1236-415c-a135-0d2530335a41 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:34:59.722416 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-0ea27cba-1236-415c-a135-0d2530335a41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:34:59.742842 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea27cba-1236-415c-a135-0d2530335a41 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:34:59.747062 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:34:59.826476 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36fd87c-8034-4bfb-80ef-158dbf4f55c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:34:59.827220 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36fd87c-8034-4bfb-80ef-158dbf4f55c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:34:59.827624 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36fd87c-8034-4bfb-80ef-158dbf4f55c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:34:59.827950 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36fd87c-8034-4bfb-80ef-158dbf4f55c6 admin admin] PATH_INFO: `/v3/projects/a137c5a6f09c403888e92e93d638a257` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:34:59.829172 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36fd87c-8034-4bfb-80ef-158dbf4f55c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a137c5a6f09c403888e92e93d638a257)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:34:59.831271 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36fd87c-8034-4bfb-80ef-158dbf4f55c6 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:34:59.888195 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e36fd87c-8034-4bfb-80ef-158dbf4f55c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a137c5a6f09c403888e92e93d638a257', 'request_id': 'req-e36fd87c-8034-4bfb-80ef-158dbf4f55c6'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:34:59.894851 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e36fd87c-8034-4bfb-80ef-158dbf4f55c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a137c5a6f09c403888e92e93d638a257', 'request_id': 'req-e36fd87c-8034-4bfb-80ef-158dbf4f55c6'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:34:59.904941 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e36fd87c-8034-4bfb-80ef-158dbf4f55c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a137c5a6f09c403888e92e93d638a257', 'request_id': 'req-e36fd87c-8034-4bfb-80ef-158dbf4f55c6'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:34:59.921646 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e36fd87c-8034-4bfb-80ef-158dbf4f55c6 admin admin] The token cache is being invalidate because project a137c5a6f09c403888e92e93d638a257 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:34:59.922044 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e36fd87c-8034-4bfb-80ef-158dbf4f55c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:34:59.922868 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e36fd87c-8034-4bfb-80ef-158dbf4f55c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:34:59.939457 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1271/2521] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:34:59 2022] DELETE /identity/v3/projects/a137c5a6f09c403888e92e93d638a257 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:35:06.013452 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b6751-fb15-4ab8-894e-9005a69abc56 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:35:06.014922 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-a71b6751-fb15-4ab8-894e-9005a69abc56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:35:06.075314 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b6751-fb15-4ab8-894e-9005a69abc56 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:35:06.130482 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025c8050-c25c-478b-88a0-737de8807362 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:35:06.131360 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c8050-c25c-478b-88a0-737de8807362 service neutron] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:06.131808 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c8050-c25c-478b-88a0-737de8807362 service neutron] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:06.132716 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c8050-c25c-478b-88a0-737de8807362 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:06.135100 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-025c8050-c25c-478b-88a0-737de8807362 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:35:06.146224 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025c8050-c25c-478b-88a0-737de8807362 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:35:06.148329 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025c8050-c25c-478b-88a0-737de8807362 service neutron] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:35:06.157045 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1251/2522] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:35:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:35:09.893369 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e41b0-921c-4beb-bad9-53e96080790a None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:09.894079 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e41b0-921c-4beb-bad9-53e96080790a None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:09.894079 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e41b0-921c-4beb-bad9-53e96080790a None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:09.895808 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1272/2523] 10.222.0.60 () {54 vars in 921 bytes} [Tue Aug 30 01:35:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:35:09.902665 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33fd7e6-5054-483e-9e6b-19f110c0e272 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:09.903165 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33fd7e6-5054-483e-9e6b-19f110c0e272 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:09.903266 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33fd7e6-5054-483e-9e6b-19f110c0e272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:09.917966 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=48,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:35:09.926014 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-d33fd7e6-5054-483e-9e6b-19f110c0e272 None None] MFA Rules not processed for user `8889145228a24fb6bd539a11925e62f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:35:09.928680 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-d33fd7e6-5054-483e-9e6b-19f110c0e272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:35:09.980163 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:35:10.007266 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1252/2524] 10.222.0.60 () {58 vars in 1018 bytes} [Tue Aug 30 01:35:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:35:10.019061 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e41b0-921c-4beb-bad9-53e96080790a None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:35:10.020921 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-857e41b0-921c-4beb-bad9-53e96080790a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:35:10.092613 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e41b0-921c-4beb-bad9-53e96080790a None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:35:10.096156 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30c90e0-89a5-4087-a3b7-0eecb879471f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2de6decc90df4df58217d5eed9c5e190', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:35:10.096762 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c90e0-89a5-4087-a3b7-0eecb879471f service glance] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:10.097041 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c90e0-89a5-4087-a3b7-0eecb879471f service glance] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:10.097307 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c90e0-89a5-4087-a3b7-0eecb879471f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:10.108317 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30c90e0-89a5-4087-a3b7-0eecb879471f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:35:10.109822 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30c90e0-89a5-4087-a3b7-0eecb879471f service glance] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:35:10.120801 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1273/2525] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:35:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:35:10.197567 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd169c5-8817-4272-8f34-ac31e2ee7ea4 None None] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:10.198034 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd169c5-8817-4272-8f34-ac31e2ee7ea4 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:10.198314 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd169c5-8817-4272-8f34-ac31e2ee7ea4 None None] PATH_INFO: `/` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:10.199725 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1253/2526] 10.222.0.60 () {54 vars in 921 bytes} [Tue Aug 30 01:35:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:35:10.204409 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d83e929-b238-4553-9090-b2799e557837 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:10.204699 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d83e929-b238-4553-9090-b2799e557837 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:10.204976 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d83e929-b238-4553-9090-b2799e557837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:10.227348 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-6d83e929-b238-4553-9090-b2799e557837 None None] MFA Rules not processed for user `61e48e00a0c34949a4fffae8c372304e`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:35:10.228604 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-6d83e929-b238-4553-9090-b2799e557837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:35:10.238697 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1274/2527] 10.222.0.60 () {58 vars in 1018 bytes} [Tue Aug 30 01:35:10 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:35:10.250603 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd169c5-8817-4272-8f34-ac31e2ee7ea4 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:35:10.252311 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-5bd169c5-8817-4272-8f34-ac31e2ee7ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:35:10.266713 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd169c5-8817-4272-8f34-ac31e2ee7ea4 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:35:10.270186 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900cba5f-7b65-4b59-bb19-67aee54b1d1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:35:10.270787 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900cba5f-7b65-4b59-bb19-67aee54b1d1e service neutron] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:10.271062 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900cba5f-7b65-4b59-bb19-67aee54b1d1e service neutron] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:10.271329 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900cba5f-7b65-4b59-bb19-67aee54b1d1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:10.279242 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900cba5f-7b65-4b59-bb19-67aee54b1d1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:35:10.280687 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900cba5f-7b65-4b59-bb19-67aee54b1d1e service neutron] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:35:10.289017 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1254/2528] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:35:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:35:10.376775 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c715ce7-4e5b-4df4-add8-ba8a2dda8975 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:10.377212 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c715ce7-4e5b-4df4-add8-ba8a2dda8975 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:10.377741 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c715ce7-4e5b-4df4-add8-ba8a2dda8975 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:10.379338 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1275/2529] 10.222.0.60 () {54 vars in 921 bytes} [Tue Aug 30 01:35:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 01:35:10.385266 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65a01d-772e-402f-9f27-62bce4f11856 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:10.385557 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65a01d-772e-402f-9f27-62bce4f11856 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:10.385997 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65a01d-772e-402f-9f27-62bce4f11856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:10.408626 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-ad65a01d-772e-402f-9f27-62bce4f11856 None None] MFA Rules not processed for user `8889145228a24fb6bd539a11925e62f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:35:10.409839 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-ad65a01d-772e-402f-9f27-62bce4f11856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:35:10.419015 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1255/2530] 10.222.0.60 () {58 vars in 1018 bytes} [Tue Aug 30 01:35:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:35:10.430014 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c715ce7-4e5b-4df4-add8-ba8a2dda8975 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:35:10.431740 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-2c715ce7-4e5b-4df4-add8-ba8a2dda8975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:35:10.445933 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c715ce7-4e5b-4df4-add8-ba8a2dda8975 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:35:10.449733 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e080cf-23f0-452c-acde-41783e684250 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:35:10.450322 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e080cf-23f0-452c-acde-41783e684250 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:10.450599 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e080cf-23f0-452c-acde-41783e684250 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:10.450895 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e080cf-23f0-452c-acde-41783e684250 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:10.463113 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e080cf-23f0-452c-acde-41783e684250 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:35:10.464577 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e080cf-23f0-452c-acde-41783e684250 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:35:10.475368 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1276/2531] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:35:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:35:10.540988 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad65a01d-772e-402f-9f27-62bce4f11856 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:35:10.542397 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-ad65a01d-772e-402f-9f27-62bce4f11856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:35:10.613554 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad65a01d-772e-402f-9f27-62bce4f11856 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:35:10.618856 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9898a57-682e-4330-9ddb-9cc957fddb05 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8dbb4742c3944b9ad389e9628b5a047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:35:10.619493 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9898a57-682e-4330-9ddb-9cc957fddb05 service placement] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:10.619776 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9898a57-682e-4330-9ddb-9cc957fddb05 service placement] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:10.620049 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9898a57-682e-4330-9ddb-9cc957fddb05 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:10.621814 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-f9898a57-682e-4330-9ddb-9cc957fddb05 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:35:10.634246 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9898a57-682e-4330-9ddb-9cc957fddb05 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:35:10.635965 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9898a57-682e-4330-9ddb-9cc957fddb05 service placement] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:35:10.646021 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1256/2532] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:35:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:35:12.604431 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8f3ba-f280-444a-b415-1fa5624ffbd9 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:12.604969 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8f3ba-f280-444a-b415-1fa5624ffbd9 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:12.605345 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8f3ba-f280-444a-b415-1fa5624ffbd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:12.627631 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-47b8f3ba-f280-444a-b415-1fa5624ffbd9 None None] MFA Rules not processed for user `edc11f8a9c5843939ec230e63ca7fa3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:35:12.628837 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-47b8f3ba-f280-444a-b415-1fa5624ffbd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:35:12.683376 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1277/2533] 10.222.0.60 () {58 vars in 1009 bytes} [Tue Aug 30 01:35:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:35:12.696862 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9898a57-682e-4330-9ddb-9cc957fddb05 service placement] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:35:12.698253 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-f9898a57-682e-4330-9ddb-9cc957fddb05 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:35:12.767326 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9898a57-682e-4330-9ddb-9cc957fddb05 service placement] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:35:12.772275 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b07e864-9559-415d-b0de-5d0249b437ce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7de1f31ef84d529bf2c53ce0f7e38b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:35:12.772883 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07e864-9559-415d-b0de-5d0249b437ce service swift] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:12.773192 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07e864-9559-415d-b0de-5d0249b437ce service swift] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:12.773460 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07e864-9559-415d-b0de-5d0249b437ce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:12.781924 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b07e864-9559-415d-b0de-5d0249b437ce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:35:12.783578 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b07e864-9559-415d-b0de-5d0249b437ce service swift] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:35:12.792769 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1257/2534] 10.222.0.60 () {60 vars in 1384 bytes} [Tue Aug 30 01:35:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 01:35:13.464479 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b8f3ba-f280-444a-b415-1fa5624ffbd9 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:35:13.466374 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-47b8f3ba-f280-444a-b415-1fa5624ffbd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:35:13.483551 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b8f3ba-f280-444a-b415-1fa5624ffbd9 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:35:13.489680 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697e8601-0828-4628-b37c-84f2d9b75cc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8889145228a24fb6bd539a11925e62f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:35:13.490286 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e8601-0828-4628-b37c-84f2d9b75cc6 service nova] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:13.490703 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e8601-0828-4628-b37c-84f2d9b75cc6 service nova] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:13.490979 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e8601-0828-4628-b37c-84f2d9b75cc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:13.492841 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-697e8601-0828-4628-b37c-84f2d9b75cc6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:35:13.572843 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697e8601-0828-4628-b37c-84f2d9b75cc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:35:13.574540 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697e8601-0828-4628-b37c-84f2d9b75cc6 service nova] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:35:13.609481 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1278/2535] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:35:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:35:22.788692 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=82 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:35:23.580164 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=88 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:35:27.070176 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b07e864-9559-415d-b0de-5d0249b437ce service swift] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:35:27.072265 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-4b07e864-9559-415d-b0de-5d0249b437ce service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:35:27.091587 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b07e864-9559-415d-b0de-5d0249b437ce service swift] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:35:27.097391 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c810d3-93a4-45d7-9f53-1465b08515c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8889145228a24fb6bd539a11925e62f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:35:27.098205 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c810d3-93a4-45d7-9f53-1465b08515c0 service nova] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:27.098327 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c810d3-93a4-45d7-9f53-1465b08515c0 service nova] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:27.098603 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c810d3-93a4-45d7-9f53-1465b08515c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:27.100763 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-96c810d3-93a4-45d7-9f53-1465b08515c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:35:27.115259 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c810d3-93a4-45d7-9f53-1465b08515c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:35:27.117046 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c810d3-93a4-45d7-9f53-1465b08515c0 service nova] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:35:27.129645 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1258/2536] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:35:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:35:27.232427 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697e8601-0828-4628-b37c-84f2d9b75cc6 service nova] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:35:27.242661 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697e8601-0828-4628-b37c-84f2d9b75cc6 service nova] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:35:27.247181 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4151e624-083a-40a4-9801-d5b4f4f8c0b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:35:27.247849 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151e624-083a-40a4-9801-d5b4f4f8c0b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:27.248132 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151e624-083a-40a4-9801-d5b4f4f8c0b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:27.248407 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151e624-083a-40a4-9801-d5b4f4f8c0b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:27.250264 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-4151e624-083a-40a4-9801-d5b4f4f8c0b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:35:27.266598 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4151e624-083a-40a4-9801-d5b4f4f8c0b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:35:27.268708 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4151e624-083a-40a4-9801-d5b4f4f8c0b0 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:35:27.280231 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1279/2537] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:35:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:35:29.601579 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c810d3-93a4-45d7-9f53-1465b08515c0 service nova] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:35:29.615748 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c810d3-93a4-45d7-9f53-1465b08515c0 service nova] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:35:29.623335 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8384d-7156-49ef-af91-b9784c5c8785 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8889145228a24fb6bd539a11925e62f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:35:29.624519 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8384d-7156-49ef-af91-b9784c5c8785 service nova] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:29.624792 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8384d-7156-49ef-af91-b9784c5c8785 service nova] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:29.625252 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8384d-7156-49ef-af91-b9784c5c8785 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:29.627983 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-63d8384d-7156-49ef-af91-b9784c5c8785 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:35:29.645380 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8384d-7156-49ef-af91-b9784c5c8785 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:35:29.647111 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8384d-7156-49ef-af91-b9784c5c8785 service nova] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:35:29.678344 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1259/2538] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:35:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:35:30.060620 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f632a6b-05bb-4336-857d-728a7e057470 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:30.061480 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f632a6b-05bb-4336-857d-728a7e057470 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:30.061759 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f632a6b-05bb-4336-857d-728a7e057470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:30.086550 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-7f632a6b-05bb-4336-857d-728a7e057470 None None] MFA Rules not processed for user `edc11f8a9c5843939ec230e63ca7fa3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:35:30.088466 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-7f632a6b-05bb-4336-857d-728a7e057470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:35:30.097072 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1280/2539] 10.222.0.60 () {58 vars in 967 bytes} [Tue Aug 30 01:35:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:35:30.109843 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8384d-7156-49ef-af91-b9784c5c8785 service nova] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:35:30.121578 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8384d-7156-49ef-af91-b9784c5c8785 service nova] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:35:30.126833 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e891e1dc-4bbb-47fb-84ba-cf30c6d033e3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7de1f31ef84d529bf2c53ce0f7e38b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:35:30.127465 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e891e1dc-4bbb-47fb-84ba-cf30c6d033e3 service swift] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:30.127743 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e891e1dc-4bbb-47fb-84ba-cf30c6d033e3 service swift] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:30.128015 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e891e1dc-4bbb-47fb-84ba-cf30c6d033e3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:30.136519 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e891e1dc-4bbb-47fb-84ba-cf30c6d033e3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:35:30.138202 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e891e1dc-4bbb-47fb-84ba-cf30c6d033e3 service swift] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:35:30.148673 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1260/2540] 10.222.0.60 () {60 vars in 1384 bytes} [Tue Aug 30 01:35:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 01:35:35.980529 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f632a6b-05bb-4336-857d-728a7e057470 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:35:35.992496 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f632a6b-05bb-4336-857d-728a7e057470 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:35:35.996592 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fb275b-b95b-413d-8e9f-ce3f3361d92f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:35:35.997291 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb275b-b95b-413d-8e9f-ce3f3361d92f service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:35.997638 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb275b-b95b-413d-8e9f-ce3f3361d92f service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:35.997977 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb275b-b95b-413d-8e9f-ce3f3361d92f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:35.999911 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-46fb275b-b95b-413d-8e9f-ce3f3361d92f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:35:36.066758 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fb275b-b95b-413d-8e9f-ce3f3361d92f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:35:36.068237 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fb275b-b95b-413d-8e9f-ce3f3361d92f service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:35:36.078773 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1281/2541] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:35:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:35:39.577913 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e891e1dc-4bbb-47fb-84ba-cf30c6d033e3 service swift] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:35:39.579860 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-e891e1dc-4bbb-47fb-84ba-cf30c6d033e3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:35:39.604425 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e891e1dc-4bbb-47fb-84ba-cf30c6d033e3 service swift] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:35:39.609044 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62150f56-c802-4202-b02c-116bafe5612c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:35:39.609704 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62150f56-c802-4202-b02c-116bafe5612c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:39.610078 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62150f56-c802-4202-b02c-116bafe5612c admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:39.610352 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62150f56-c802-4202-b02c-116bafe5612c admin admin] PATH_INFO: `/v3/users/a991f1a0f804497c91d21d69e33113ed` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:39.611518 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62150f56-c802-4202-b02c-116bafe5612c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a991f1a0f804497c91d21d69e33113ed)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:35:39.613418 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62150f56-c802-4202-b02c-116bafe5612c admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:35:39.673755 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-62150f56-c802-4202-b02c-116bafe5612c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a991f1a0f804497c91d21d69e33113ed'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:35:39.682968 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-62150f56-c802-4202-b02c-116bafe5612c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a991f1a0f804497c91d21d69e33113ed'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:35:39.683744 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-62150f56-c802-4202-b02c-116bafe5612c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a991f1a0f804497c91d21d69e33113ed'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:35:39.684364 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-62150f56-c802-4202-b02c-116bafe5612c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a991f1a0f804497c91d21d69e33113ed'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:35:39.699401 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-62150f56-c802-4202-b02c-116bafe5612c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a991f1a0f804497c91d21d69e33113ed'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:35:39.713170 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1261/2542] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:35:39 2022] DELETE /identity/v3/users/a991f1a0f804497c91d21d69e33113ed => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:35:39.998657 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fb275b-b95b-413d-8e9f-ce3f3361d92f service neutron] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:35:40.011390 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fb275b-b95b-413d-8e9f-ce3f3361d92f service neutron] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:35:40.085214 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5724e8ce-51c5-4495-87ea-f9e2ae036439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:35:40.085984 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5724e8ce-51c5-4495-87ea-f9e2ae036439 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:40.086270 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5724e8ce-51c5-4495-87ea-f9e2ae036439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:40.086570 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5724e8ce-51c5-4495-87ea-f9e2ae036439 admin admin] PATH_INFO: `/v3/projects/06927fb76c3e4d9994140b11a6f69241` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:40.088377 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5724e8ce-51c5-4495-87ea-f9e2ae036439 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06927fb76c3e4d9994140b11a6f69241)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:35:40.090715 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5724e8ce-51c5-4495-87ea-f9e2ae036439 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:35:40.164221 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-5724e8ce-51c5-4495-87ea-f9e2ae036439 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06927fb76c3e4d9994140b11a6f69241', 'request_id': 'req-5724e8ce-51c5-4495-87ea-f9e2ae036439'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:35:40.173214 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-5724e8ce-51c5-4495-87ea-f9e2ae036439 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06927fb76c3e4d9994140b11a6f69241', 'request_id': 'req-5724e8ce-51c5-4495-87ea-f9e2ae036439'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:35:40.189930 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-5724e8ce-51c5-4495-87ea-f9e2ae036439 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06927fb76c3e4d9994140b11a6f69241', 'request_id': 'req-5724e8ce-51c5-4495-87ea-f9e2ae036439'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:35:40.203771 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-5724e8ce-51c5-4495-87ea-f9e2ae036439 admin admin] The token cache is being invalidate because project 06927fb76c3e4d9994140b11a6f69241 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:35:40.204291 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-5724e8ce-51c5-4495-87ea-f9e2ae036439 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:35:40.204967 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-5724e8ce-51c5-4495-87ea-f9e2ae036439 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:35:40.206498 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1282/2543] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:35:39 2022] DELETE /identity/v3/projects/06927fb76c3e4d9994140b11a6f69241 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:35:40.214259 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa43636-3cca-4d9a-9baf-56e6d77153bc None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:40.214259 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa43636-3cca-4d9a-9baf-56e6d77153bc None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:40.214681 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa43636-3cca-4d9a-9baf-56e6d77153bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:40.239239 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-2aa43636-3cca-4d9a-9baf-56e6d77153bc None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:35:40.240488 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-2aa43636-3cca-4d9a-9baf-56e6d77153bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:35:40.313337 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1262/2544] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:35:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:35:40.321684 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8d566-6885-48cd-8b5b-a7df3413ccd3 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:40.322625 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8d566-6885-48cd-8b5b-a7df3413ccd3 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:40.322769 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8d566-6885-48cd-8b5b-a7df3413ccd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:40.333666 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:35:40.349754 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-92a8d566-6885-48cd-8b5b-a7df3413ccd3 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:35:40.351346 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-92a8d566-6885-48cd-8b5b-a7df3413ccd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:35:40.360352 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1283/2545] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:35:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:35:40.366305 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa43636-3cca-4d9a-9baf-56e6d77153bc None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:35:40.376571 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa43636-3cca-4d9a-9baf-56e6d77153bc None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:35:40.381269 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb91423-7491-413a-8f9a-d4d590c61976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:35:40.381875 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb91423-7491-413a-8f9a-d4d590c61976 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:40.382155 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb91423-7491-413a-8f9a-d4d590c61976 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:40.382430 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb91423-7491-413a-8f9a-d4d590c61976 admin admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:40.383084 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb91423-7491-413a-8f9a-d4d590c61976 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:35:40.383391 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb91423-7491-413a-8f9a-d4d590c61976 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:35:40.385559 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb91423-7491-413a-8f9a-d4d590c61976 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:35:40.402165 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1263/2546] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 30 01:35:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:35:40.403296 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8d566-6885-48cd-8b5b-a7df3413ccd3 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:35:40.412932 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8d566-6885-48cd-8b5b-a7df3413ccd3 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:35:40.420412 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e653944-688d-4031-b33e-5eae5f635011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:35:40.421022 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e653944-688d-4031-b33e-5eae5f635011 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:40.421296 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e653944-688d-4031-b33e-5eae5f635011 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:40.421561 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e653944-688d-4031-b33e-5eae5f635011 admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:40.422276 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e653944-688d-4031-b33e-5eae5f635011 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:35:40.424118 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e653944-688d-4031-b33e-5eae5f635011 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:35:40.465480 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1284/2547] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:35:40 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:35:40.467378 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb91423-7491-413a-8f9a-d4d590c61976 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:35:40.479721 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb91423-7491-413a-8f9a-d4d590c61976 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:35:40.502274 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:35:40.550987 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204fd6cf-1ff9-4095-91a1-813624225b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:35:40.551544 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fd6cf-1ff9-4095-91a1-813624225b96 admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:40.551809 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fd6cf-1ff9-4095-91a1-813624225b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:40.552157 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fd6cf-1ff9-4095-91a1-813624225b96 admin admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:40.552853 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204fd6cf-1ff9-4095-91a1-813624225b96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:35:40.554930 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204fd6cf-1ff9-4095-91a1-813624225b96 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:35:40.580561 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1264/2548] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:35:40 2022] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:35:40.586303 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e653944-688d-4031-b33e-5eae5f635011 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:35:40.597344 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e653944-688d-4031-b33e-5eae5f635011 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:35:40.606613 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdad559-be02-4fcf-865d-bf73add5a0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:35:40.607278 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdad559-be02-4fcf-865d-bf73add5a0cf admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:40.607625 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdad559-be02-4fcf-865d-bf73add5a0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:40.608107 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdad559-be02-4fcf-865d-bf73add5a0cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:40.608766 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdad559-be02-4fcf-865d-bf73add5a0cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:35:40.611154 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdad559-be02-4fcf-865d-bf73add5a0cf admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:35:40.626323 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1285/2549] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:35:40 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:35:40.632070 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204fd6cf-1ff9-4095-91a1-813624225b96 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:35:40.643400 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204fd6cf-1ff9-4095-91a1-813624225b96 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:35:40.647878 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0be1f7-46a9-46f9-9251-94b0fe1b4110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:35:40.648225 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0be1f7-46a9-46f9-9251-94b0fe1b4110 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:40.648503 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0be1f7-46a9-46f9-9251-94b0fe1b4110 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:40.648775 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0be1f7-46a9-46f9-9251-94b0fe1b4110 admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:40.649420 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0be1f7-46a9-46f9-9251-94b0fe1b4110 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:35:40.651060 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0be1f7-46a9-46f9-9251-94b0fe1b4110 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:35:40.662691 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1265/2550] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:35:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:35:40.667823 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdad559-be02-4fcf-865d-bf73add5a0cf admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:35:40.678469 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdad559-be02-4fcf-865d-bf73add5a0cf admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:35:40.683331 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79265bf2-eb8c-4678-9a89-2989591303f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:35:40.684015 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79265bf2-eb8c-4678-9a89-2989591303f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:40.684298 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79265bf2-eb8c-4678-9a89-2989591303f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:40.684573 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79265bf2-eb8c-4678-9a89-2989591303f2 admin admin] PATH_INFO: `/v3/projects/f238dd8b602242e389facc2b3e0bd076/users/56e5ab06a7c04e9ba2b1a6916d06796d/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:40.701824 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79265bf2-eb8c-4678-9a89-2989591303f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f238dd8b602242e389facc2b3e0bd076, user_id=56e5ab06a7c04e9ba2b1a6916d06796d, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:35:40.704583 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79265bf2-eb8c-4678-9a89-2989591303f2 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:35:40.718043 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1286/2551] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:35:40 2022] PUT /identity/v3/projects/f238dd8b602242e389facc2b3e0bd076/users/56e5ab06a7c04e9ba2b1a6916d06796d/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:35:40.728602 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c1c99-d670-439b-a14d-6f8c52389f04 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:40.729019 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c1c99-d670-439b-a14d-6f8c52389f04 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:40.729491 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c1c99-d670-439b-a14d-6f8c52389f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:40.758766 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-6e5c1c99-d670-439b-a14d-6f8c52389f04 None None] MFA Rules not processed for user `56e5ab06a7c04e9ba2b1a6916d06796d`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:35:40.760637 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-6e5c1c99-d670-439b-a14d-6f8c52389f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:35:40.832056 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1266/2552] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:35:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:35:40.843573 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79265bf2-eb8c-4678-9a89-2989591303f2 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:35:40.845420 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-79265bf2-eb8c-4678-9a89-2989591303f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:35:40.921066 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79265bf2-eb8c-4678-9a89-2989591303f2 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:35:40.926702 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e87f0dc-bde6-4781-a940-bfc861c77547 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8889145228a24fb6bd539a11925e62f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:35:40.927330 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87f0dc-bde6-4781-a940-bfc861c77547 service nova] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:40.927636 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87f0dc-bde6-4781-a940-bfc861c77547 service nova] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:40.927913 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87f0dc-bde6-4781-a940-bfc861c77547 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:40.936498 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e87f0dc-bde6-4781-a940-bfc861c77547 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:35:40.938086 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e87f0dc-bde6-4781-a940-bfc861c77547 service nova] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:35:40.947638 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1287/2553] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:35:40 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:35:46.233707 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c1c99-d670-439b-a14d-6f8c52389f04 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:35:46.303317 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c1c99-d670-439b-a14d-6f8c52389f04 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:35:46.308097 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac07d7cf-b283-46b8-ae09-9ed0ffafae95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:35:46.308733 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac07d7cf-b283-46b8-ae09-9ed0ffafae95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:46.309007 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac07d7cf-b283-46b8-ae09-9ed0ffafae95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:46.309276 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac07d7cf-b283-46b8-ae09-9ed0ffafae95 admin admin] PATH_INFO: `/v3/users/56e5ab06a7c04e9ba2b1a6916d06796d` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:46.310796 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac07d7cf-b283-46b8-ae09-9ed0ffafae95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56e5ab06a7c04e9ba2b1a6916d06796d)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:35:46.312959 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac07d7cf-b283-46b8-ae09-9ed0ffafae95 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:35:46.349219 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:35:46.367552 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-ac07d7cf-b283-46b8-ae09-9ed0ffafae95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56e5ab06a7c04e9ba2b1a6916d06796d'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:35:46.375646 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-ac07d7cf-b283-46b8-ae09-9ed0ffafae95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56e5ab06a7c04e9ba2b1a6916d06796d'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:35:46.376293 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-ac07d7cf-b283-46b8-ae09-9ed0ffafae95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56e5ab06a7c04e9ba2b1a6916d06796d'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:35:46.376892 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-ac07d7cf-b283-46b8-ae09-9ed0ffafae95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56e5ab06a7c04e9ba2b1a6916d06796d'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:35:46.389261 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-ac07d7cf-b283-46b8-ae09-9ed0ffafae95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56e5ab06a7c04e9ba2b1a6916d06796d'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:35:46.401788 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1267/2554] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:35:46 2022] DELETE /identity/v3/users/56e5ab06a7c04e9ba2b1a6916d06796d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:35:46.406237 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e0de5-635b-42fc-bed6-4a1e16c78072 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:46.406712 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e0de5-635b-42fc-bed6-4a1e16c78072 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:46.406829 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e0de5-635b-42fc-bed6-4a1e16c78072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:46.425610 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-046e0de5-635b-42fc-bed6-4a1e16c78072 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:35:46.426820 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-046e0de5-635b-42fc-bed6-4a1e16c78072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:35:46.484218 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1288/2555] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:35:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:35:46.494020 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac07d7cf-b283-46b8-ae09-9ed0ffafae95 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:35:46.495496 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-ac07d7cf-b283-46b8-ae09-9ed0ffafae95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:35:46.553982 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac07d7cf-b283-46b8-ae09-9ed0ffafae95 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:35:46.558125 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b056fa2f-7614-4cdd-ac64-a7fc58ec695f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:35:46.558739 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b056fa2f-7614-4cdd-ac64-a7fc58ec695f service neutron] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:46.559019 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b056fa2f-7614-4cdd-ac64-a7fc58ec695f service neutron] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:46.559290 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b056fa2f-7614-4cdd-ac64-a7fc58ec695f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:46.568816 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b056fa2f-7614-4cdd-ac64-a7fc58ec695f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:35:46.570241 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b056fa2f-7614-4cdd-ac64-a7fc58ec695f service neutron] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:35:46.580432 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1268/2556] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:35:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:35:46.860728 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e0de5-635b-42fc-bed6-4a1e16c78072 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:35:46.862291 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-046e0de5-635b-42fc-bed6-4a1e16c78072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:35:46.874830 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e0de5-635b-42fc-bed6-4a1e16c78072 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:35:46.879517 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f37ce3-80e1-47ea-8ae7-09f1960751ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:35:46.881028 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f37ce3-80e1-47ea-8ae7-09f1960751ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:46.881623 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f37ce3-80e1-47ea-8ae7-09f1960751ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:46.881731 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f37ce3-80e1-47ea-8ae7-09f1960751ba admin admin] PATH_INFO: `/v3/projects/f238dd8b602242e389facc2b3e0bd076` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:46.883231 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f37ce3-80e1-47ea-8ae7-09f1960751ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=f238dd8b602242e389facc2b3e0bd076)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:35:46.885093 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f37ce3-80e1-47ea-8ae7-09f1960751ba admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:35:46.910916 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:35:46.935755 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-f2f37ce3-80e1-47ea-8ae7-09f1960751ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f238dd8b602242e389facc2b3e0bd076', 'request_id': 'req-f2f37ce3-80e1-47ea-8ae7-09f1960751ba'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:35:46.941773 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-f2f37ce3-80e1-47ea-8ae7-09f1960751ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f238dd8b602242e389facc2b3e0bd076', 'request_id': 'req-f2f37ce3-80e1-47ea-8ae7-09f1960751ba'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:35:46.949471 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-f2f37ce3-80e1-47ea-8ae7-09f1960751ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f238dd8b602242e389facc2b3e0bd076', 'request_id': 'req-f2f37ce3-80e1-47ea-8ae7-09f1960751ba'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:35:46.961124 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-f2f37ce3-80e1-47ea-8ae7-09f1960751ba admin admin] The token cache is being invalidate because project f238dd8b602242e389facc2b3e0bd076 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:35:46.961410 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-f2f37ce3-80e1-47ea-8ae7-09f1960751ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:35:46.962046 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-f2f37ce3-80e1-47ea-8ae7-09f1960751ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:35:46.964193 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1289/2557] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:35:46 2022] DELETE /identity/v3/projects/f238dd8b602242e389facc2b3e0bd076 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:35:46.969009 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf034083-ba10-4939-b2d2-887d890b6b5a None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:46.969430 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf034083-ba10-4939-b2d2-887d890b6b5a None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:46.969856 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf034083-ba10-4939-b2d2-887d890b6b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:46.990651 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-bf034083-ba10-4939-b2d2-887d890b6b5a None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:35:46.991900 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-bf034083-ba10-4939-b2d2-887d890b6b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:35:47.050864 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1269/2558] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:35:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:35:47.058544 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb24d34-d046-4444-9535-faa9bb349e16 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:47.060628 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb24d34-d046-4444-9535-faa9bb349e16 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:47.062086 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb24d34-d046-4444-9535-faa9bb349e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:47.082186 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-9cb24d34-d046-4444-9535-faa9bb349e16 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:35:47.083383 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-9cb24d34-d046-4444-9535-faa9bb349e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:35:47.092024 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1290/2559] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:35:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:35:47.096287 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf034083-ba10-4939-b2d2-887d890b6b5a None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:35:47.105688 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf034083-ba10-4939-b2d2-887d890b6b5a None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:35:47.110559 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338e094-2202-4a22-bf8b-9d756d9f875e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:35:47.111174 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338e094-2202-4a22-bf8b-9d756d9f875e admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:47.111484 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338e094-2202-4a22-bf8b-9d756d9f875e admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:47.111763 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338e094-2202-4a22-bf8b-9d756d9f875e admin admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:47.112420 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5338e094-2202-4a22-bf8b-9d756d9f875e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:35:47.112719 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5338e094-2202-4a22-bf8b-9d756d9f875e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:35:47.114331 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5338e094-2202-4a22-bf8b-9d756d9f875e admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:35:47.126481 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1270/2560] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 30 01:35:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:35:47.130247 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb24d34-d046-4444-9535-faa9bb349e16 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:35:47.139993 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb24d34-d046-4444-9535-faa9bb349e16 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:35:47.144662 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1c2fe-3db5-49cd-b7c4-a8cdaf4f5db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:35:47.145259 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1c2fe-3db5-49cd-b7c4-a8cdaf4f5db0 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:47.145538 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1c2fe-3db5-49cd-b7c4-a8cdaf4f5db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:47.145806 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1c2fe-3db5-49cd-b7c4-a8cdaf4f5db0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:47.146454 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f1c2fe-3db5-49cd-b7c4-a8cdaf4f5db0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:35:47.148520 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f1c2fe-3db5-49cd-b7c4-a8cdaf4f5db0 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:35:47.177934 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1291/2561] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:35:47 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:35:47.182365 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338e094-2202-4a22-bf8b-9d756d9f875e admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:35:47.192261 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338e094-2202-4a22-bf8b-9d756d9f875e admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:35:47.226005 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:35:47.250246 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64298eb8-ca99-4dd9-aff5-118fc37fe258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:35:47.250852 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64298eb8-ca99-4dd9-aff5-118fc37fe258 admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:47.251117 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64298eb8-ca99-4dd9-aff5-118fc37fe258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:47.251388 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64298eb8-ca99-4dd9-aff5-118fc37fe258 admin admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:47.252074 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64298eb8-ca99-4dd9-aff5-118fc37fe258 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:35:47.253994 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64298eb8-ca99-4dd9-aff5-118fc37fe258 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:35:47.277403 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1271/2562] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:35:47 2022] POST /identity/v3/users => generated 283 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:35:47.281691 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1c2fe-3db5-49cd-b7c4-a8cdaf4f5db0 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:35:47.291927 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1c2fe-3db5-49cd-b7c4-a8cdaf4f5db0 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:35:47.296550 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aedf246-7713-4cc9-9088-a9cc24c3ce88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:35:47.297146 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedf246-7713-4cc9-9088-a9cc24c3ce88 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:47.297433 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedf246-7713-4cc9-9088-a9cc24c3ce88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:47.297704 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedf246-7713-4cc9-9088-a9cc24c3ce88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:47.298349 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aedf246-7713-4cc9-9088-a9cc24c3ce88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:35:47.299996 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aedf246-7713-4cc9-9088-a9cc24c3ce88 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:35:47.310430 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1292/2563] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:35:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:35:47.314428 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64298eb8-ca99-4dd9-aff5-118fc37fe258 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:35:47.325094 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64298eb8-ca99-4dd9-aff5-118fc37fe258 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:35:47.329768 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f5b3ff-8345-4af7-af2a-8d5b3f5b5ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:35:47.330392 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5b3ff-8345-4af7-af2a-8d5b3f5b5ce8 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:47.330669 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5b3ff-8345-4af7-af2a-8d5b3f5b5ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:47.330939 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5b3ff-8345-4af7-af2a-8d5b3f5b5ce8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:47.331616 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f5b3ff-8345-4af7-af2a-8d5b3f5b5ce8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:35:47.333229 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f5b3ff-8345-4af7-af2a-8d5b3f5b5ce8 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:35:47.343229 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1272/2564] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:35:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:35:47.347335 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aedf246-7713-4cc9-9088-a9cc24c3ce88 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:35:47.357250 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aedf246-7713-4cc9-9088-a9cc24c3ce88 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:35:47.361902 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c1b22e-db4f-4a58-b596-40bcc6f48feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:35:47.362552 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c1b22e-db4f-4a58-b596-40bcc6f48feb admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:47.362837 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c1b22e-db4f-4a58-b596-40bcc6f48feb admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:47.363112 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c1b22e-db4f-4a58-b596-40bcc6f48feb admin admin] PATH_INFO: `/v3/projects/fb90a88599d84b19a75df037a5ca8b4b/users/05f7922ae1974330b26da5efca465ba8/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:47.378462 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c1b22e-db4f-4a58-b596-40bcc6f48feb admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb90a88599d84b19a75df037a5ca8b4b, user_id=05f7922ae1974330b26da5efca465ba8, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:35:47.381313 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c1b22e-db4f-4a58-b596-40bcc6f48feb admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:35:47.395589 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1293/2565] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:35:47 2022] PUT /identity/v3/projects/fb90a88599d84b19a75df037a5ca8b4b/users/05f7922ae1974330b26da5efca465ba8/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:35:47.407067 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fff555-6342-4e85-b5f6-0fc07df67109 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:47.407463 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fff555-6342-4e85-b5f6-0fc07df67109 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:47.407814 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fff555-6342-4e85-b5f6-0fc07df67109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:47.436077 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-66fff555-6342-4e85-b5f6-0fc07df67109 None None] MFA Rules not processed for user `05f7922ae1974330b26da5efca465ba8`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:35:47.437404 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-66fff555-6342-4e85-b5f6-0fc07df67109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:35:47.503182 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1273/2566] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:35:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:35:47.507730 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c1b22e-db4f-4a58-b596-40bcc6f48feb admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:35:47.570912 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c1b22e-db4f-4a58-b596-40bcc6f48feb admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:35:47.576278 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65c06cc-7ca0-4717-9a6f-03cfb1135004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:35:47.576875 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c06cc-7ca0-4717-9a6f-03cfb1135004 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:47.577160 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c06cc-7ca0-4717-9a6f-03cfb1135004 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:47.577432 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c06cc-7ca0-4717-9a6f-03cfb1135004 admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:47.578060 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65c06cc-7ca0-4717-9a6f-03cfb1135004 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:35:47.580019 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65c06cc-7ca0-4717-9a6f-03cfb1135004 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:35:47.607846 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1294/2567] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:35:47 2022] POST /identity/v3/projects => generated 363 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:35:47.612032 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fff555-6342-4e85-b5f6-0fc07df67109 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:35:47.623120 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fff555-6342-4e85-b5f6-0fc07df67109 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:35:47.678601 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e504dad1-75f3-4215-bfb5-bdf812d02025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:35:47.679128 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504dad1-75f3-4215-bfb5-bdf812d02025 admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:47.679407 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504dad1-75f3-4215-bfb5-bdf812d02025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:47.679707 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504dad1-75f3-4215-bfb5-bdf812d02025 admin admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:47.680323 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e504dad1-75f3-4215-bfb5-bdf812d02025 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:35:47.682261 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e504dad1-75f3-4215-bfb5-bdf812d02025 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:35:47.704021 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1274/2568] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:35:47 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:35:47.708226 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65c06cc-7ca0-4717-9a6f-03cfb1135004 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:35:47.719267 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65c06cc-7ca0-4717-9a6f-03cfb1135004 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:35:47.723886 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84cf0e1-99af-41c2-bc8f-8861c6a4bcd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:35:47.724497 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84cf0e1-99af-41c2-bc8f-8861c6a4bcd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:47.724759 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84cf0e1-99af-41c2-bc8f-8861c6a4bcd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:47.725031 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84cf0e1-99af-41c2-bc8f-8861c6a4bcd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:47.725671 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84cf0e1-99af-41c2-bc8f-8861c6a4bcd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:35:47.727331 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84cf0e1-99af-41c2-bc8f-8861c6a4bcd5 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:35:47.737799 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1295/2569] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:35:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:35:47.741895 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e504dad1-75f3-4215-bfb5-bdf812d02025 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:35:47.752021 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e504dad1-75f3-4215-bfb5-bdf812d02025 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:35:47.756618 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9e1647-7082-4518-b226-70e0ea171f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:35:47.757259 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e1647-7082-4518-b226-70e0ea171f64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:47.757535 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e1647-7082-4518-b226-70e0ea171f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:47.757806 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e1647-7082-4518-b226-70e0ea171f64 admin admin] PATH_INFO: `/v3/projects/98ccca347f17412c9ac888059de47fae/users/95ce10f5bd334d3180bf0b29a9749a0b/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:47.772680 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9e1647-7082-4518-b226-70e0ea171f64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98ccca347f17412c9ac888059de47fae, user_id=95ce10f5bd334d3180bf0b29a9749a0b, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:35:47.776067 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9e1647-7082-4518-b226-70e0ea171f64 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:35:47.788322 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1275/2570] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:35:47 2022] PUT /identity/v3/projects/98ccca347f17412c9ac888059de47fae/users/95ce10f5bd334d3180bf0b29a9749a0b/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:35:47.792329 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84cf0e1-99af-41c2-bc8f-8861c6a4bcd5 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:35:47.802120 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84cf0e1-99af-41c2-bc8f-8861c6a4bcd5 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:35:47.818349 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:35:47.859946 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3701079-a3bd-4e4e-9859-2e6207022a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:35:47.860542 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3701079-a3bd-4e4e-9859-2e6207022a51 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:47.860841 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3701079-a3bd-4e4e-9859-2e6207022a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:47.861109 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3701079-a3bd-4e4e-9859-2e6207022a51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:47.861742 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3701079-a3bd-4e4e-9859-2e6207022a51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:35:47.863332 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3701079-a3bd-4e4e-9859-2e6207022a51 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:35:47.872927 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1296/2571] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:35:47 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:35:47.877336 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9e1647-7082-4518-b226-70e0ea171f64 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:35:47.888149 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9e1647-7082-4518-b226-70e0ea171f64 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:35:47.892770 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3fa3d8-955e-4d3d-8efe-df9e691325c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:35:47.893413 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3fa3d8-955e-4d3d-8efe-df9e691325c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:47.893692 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3fa3d8-955e-4d3d-8efe-df9e691325c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:47.893963 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3fa3d8-955e-4d3d-8efe-df9e691325c0 admin admin] PATH_INFO: `/v3/projects/98ccca347f17412c9ac888059de47fae/users/95ce10f5bd334d3180bf0b29a9749a0b/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:47.895912 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3fa3d8-955e-4d3d-8efe-df9e691325c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98ccca347f17412c9ac888059de47fae, user_id=95ce10f5bd334d3180bf0b29a9749a0b, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:35:47.898554 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3fa3d8-955e-4d3d-8efe-df9e691325c0 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:35:47.905580 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:35:47.911891 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1276/2572] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:35:47 2022] PUT /identity/v3/projects/98ccca347f17412c9ac888059de47fae/users/95ce10f5bd334d3180bf0b29a9749a0b/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:35:47.921844 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f22312-2220-4cad-a7ce-1eaf969cd781 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:47.922130 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f22312-2220-4cad-a7ce-1eaf969cd781 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:47.922402 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f22312-2220-4cad-a7ce-1eaf969cd781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:47.950366 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-33f22312-2220-4cad-a7ce-1eaf969cd781 None None] MFA Rules not processed for user `95ce10f5bd334d3180bf0b29a9749a0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:35:47.951547 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-33f22312-2220-4cad-a7ce-1eaf969cd781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:35:48.020514 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1297/2573] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:35:47 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:35:48.032324 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3fa3d8-955e-4d3d-8efe-df9e691325c0 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:35:48.034068 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-ca3fa3d8-955e-4d3d-8efe-df9e691325c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:35:48.092045 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3fa3d8-955e-4d3d-8efe-df9e691325c0 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:35:48.095686 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd97858-1bf6-4365-920d-dc2f7b50b7e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:35:48.096282 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd97858-1bf6-4365-920d-dc2f7b50b7e7 service cinder] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:48.096554 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd97858-1bf6-4365-920d-dc2f7b50b7e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:48.096819 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd97858-1bf6-4365-920d-dc2f7b50b7e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:48.105671 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd97858-1bf6-4365-920d-dc2f7b50b7e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:35:48.107219 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd97858-1bf6-4365-920d-dc2f7b50b7e7 service cinder] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:35:48.116433 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1277/2574] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:35:48 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:35:48.194288 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f22312-2220-4cad-a7ce-1eaf969cd781 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:35:48.204776 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f22312-2220-4cad-a7ce-1eaf969cd781 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:35:48.208434 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faca6eaa-5b27-4830-a6a2-25bb33166592 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:35:48.209096 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca6eaa-5b27-4830-a6a2-25bb33166592 service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:48.209381 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca6eaa-5b27-4830-a6a2-25bb33166592 service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:48.209936 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca6eaa-5b27-4830-a6a2-25bb33166592 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:48.265525 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faca6eaa-5b27-4830-a6a2-25bb33166592 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:35:48.267005 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faca6eaa-5b27-4830-a6a2-25bb33166592 service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:35:48.275805 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1298/2575] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:35:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:35:55.316362 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd97858-1bf6-4365-920d-dc2f7b50b7e7 service cinder] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:35:55.383913 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd97858-1bf6-4365-920d-dc2f7b50b7e7 service cinder] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:35:55.389290 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce3662-5f10-4197-a18c-08102a8f5729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:35:55.390000 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce3662-5f10-4197-a18c-08102a8f5729 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:55.390222 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce3662-5f10-4197-a18c-08102a8f5729 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:55.390499 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce3662-5f10-4197-a18c-08102a8f5729 admin admin] PATH_INFO: `/v3/users/05f7922ae1974330b26da5efca465ba8` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:55.391676 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ce3662-5f10-4197-a18c-08102a8f5729 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05f7922ae1974330b26da5efca465ba8)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:35:55.393600 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ce3662-5f10-4197-a18c-08102a8f5729 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:35:55.440943 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-45ce3662-5f10-4197-a18c-08102a8f5729 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05f7922ae1974330b26da5efca465ba8'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:35:55.448759 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-45ce3662-5f10-4197-a18c-08102a8f5729 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05f7922ae1974330b26da5efca465ba8'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:35:55.449431 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-45ce3662-5f10-4197-a18c-08102a8f5729 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05f7922ae1974330b26da5efca465ba8'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:35:55.450058 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-45ce3662-5f10-4197-a18c-08102a8f5729 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05f7922ae1974330b26da5efca465ba8'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:35:55.463003 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-45ce3662-5f10-4197-a18c-08102a8f5729 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05f7922ae1974330b26da5efca465ba8'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:35:55.475329 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1278/2576] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:35:55 2022] DELETE /identity/v3/users/05f7922ae1974330b26da5efca465ba8 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:35:55.480354 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c0b1e-ed6f-40e9-ac05-9fb21b386892 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:55.480911 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c0b1e-ed6f-40e9-ac05-9fb21b386892 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:55.480911 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c0b1e-ed6f-40e9-ac05-9fb21b386892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:55.501989 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-154c0b1e-ed6f-40e9-ac05-9fb21b386892 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:35:55.503399 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-154c0b1e-ed6f-40e9-ac05-9fb21b386892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:35:55.539767 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:35:55.569611 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1299/2577] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:35:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:35:55.582426 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce3662-5f10-4197-a18c-08102a8f5729 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:35:55.584135 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-45ce3662-5f10-4197-a18c-08102a8f5729 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:35:55.612149 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:35:55.651420 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce3662-5f10-4197-a18c-08102a8f5729 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:35:55.655047 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dd96ea-529c-4dd9-a34f-8d9996b4a923 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:35:55.655801 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd96ea-529c-4dd9-a34f-8d9996b4a923 service neutron] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:55.656136 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd96ea-529c-4dd9-a34f-8d9996b4a923 service neutron] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:55.656403 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd96ea-529c-4dd9-a34f-8d9996b4a923 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:55.666045 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dd96ea-529c-4dd9-a34f-8d9996b4a923 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:35:55.669864 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dd96ea-529c-4dd9-a34f-8d9996b4a923 service neutron] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:35:55.677533 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1279/2578] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:35:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:35:56.123785 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c0b1e-ed6f-40e9-ac05-9fb21b386892 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:35:56.123785 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-154c0b1e-ed6f-40e9-ac05-9fb21b386892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:35:56.140271 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c0b1e-ed6f-40e9-ac05-9fb21b386892 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:35:56.145920 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa4f05-a656-44d3-8e4b-75d9f31bd216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:35:56.146576 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa4f05-a656-44d3-8e4b-75d9f31bd216 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:56.146857 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa4f05-a656-44d3-8e4b-75d9f31bd216 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:56.147139 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa4f05-a656-44d3-8e4b-75d9f31bd216 admin admin] PATH_INFO: `/v3/projects/fb90a88599d84b19a75df037a5ca8b4b` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:56.148725 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fa4f05-a656-44d3-8e4b-75d9f31bd216 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb90a88599d84b19a75df037a5ca8b4b)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:35:56.151804 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fa4f05-a656-44d3-8e4b-75d9f31bd216 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:35:56.225200 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-d6fa4f05-a656-44d3-8e4b-75d9f31bd216 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb90a88599d84b19a75df037a5ca8b4b', 'request_id': 'req-d6fa4f05-a656-44d3-8e4b-75d9f31bd216'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:35:56.233312 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-d6fa4f05-a656-44d3-8e4b-75d9f31bd216 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb90a88599d84b19a75df037a5ca8b4b', 'request_id': 'req-d6fa4f05-a656-44d3-8e4b-75d9f31bd216'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:35:56.247383 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-d6fa4f05-a656-44d3-8e4b-75d9f31bd216 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb90a88599d84b19a75df037a5ca8b4b', 'request_id': 'req-d6fa4f05-a656-44d3-8e4b-75d9f31bd216'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:35:56.262543 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-d6fa4f05-a656-44d3-8e4b-75d9f31bd216 admin admin] The token cache is being invalidate because project fb90a88599d84b19a75df037a5ca8b4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:35:56.262836 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-d6fa4f05-a656-44d3-8e4b-75d9f31bd216 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:35:56.263666 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-d6fa4f05-a656-44d3-8e4b-75d9f31bd216 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:35:56.265176 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1300/2579] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:35:56 2022] DELETE /identity/v3/projects/fb90a88599d84b19a75df037a5ca8b4b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:35:56.269447 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dd96ea-529c-4dd9-a34f-8d9996b4a923 service neutron] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:35:56.280405 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dd96ea-529c-4dd9-a34f-8d9996b4a923 service neutron] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:35:56.342116 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa7a322-c3c6-4332-b32e-6864bfc2226b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:35:56.342775 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7a322-c3c6-4332-b32e-6864bfc2226b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:56.342919 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7a322-c3c6-4332-b32e-6864bfc2226b admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:56.343186 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7a322-c3c6-4332-b32e-6864bfc2226b admin admin] PATH_INFO: `/v3/users/95ce10f5bd334d3180bf0b29a9749a0b` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:56.344340 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa7a322-c3c6-4332-b32e-6864bfc2226b admin admin] RBAC: Authorizing `identity:delete_user(user_id=95ce10f5bd334d3180bf0b29a9749a0b)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:35:56.346266 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa7a322-c3c6-4332-b32e-6864bfc2226b admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:35:56.397040 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-cfa7a322-c3c6-4332-b32e-6864bfc2226b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95ce10f5bd334d3180bf0b29a9749a0b'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:35:56.406384 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-cfa7a322-c3c6-4332-b32e-6864bfc2226b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95ce10f5bd334d3180bf0b29a9749a0b'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:35:56.406961 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-cfa7a322-c3c6-4332-b32e-6864bfc2226b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95ce10f5bd334d3180bf0b29a9749a0b'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:35:56.407658 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-cfa7a322-c3c6-4332-b32e-6864bfc2226b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95ce10f5bd334d3180bf0b29a9749a0b'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:35:56.420925 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-cfa7a322-c3c6-4332-b32e-6864bfc2226b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95ce10f5bd334d3180bf0b29a9749a0b'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:35:56.436124 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1280/2580] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:35:56 2022] DELETE /identity/v3/users/95ce10f5bd334d3180bf0b29a9749a0b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:35:56.715127 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa4f05-a656-44d3-8e4b-75d9f31bd216 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:35:56.716854 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-d6fa4f05-a656-44d3-8e4b-75d9f31bd216 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:35:56.735211 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa4f05-a656-44d3-8e4b-75d9f31bd216 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:35:56.800679 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266b4060-97ec-46a3-877c-f2867120c4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:35:56.801319 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b4060-97ec-46a3-877c-f2867120c4fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:56.801598 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b4060-97ec-46a3-877c-f2867120c4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:56.801874 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b4060-97ec-46a3-877c-f2867120c4fd admin admin] PATH_INFO: `/v3/projects/98ccca347f17412c9ac888059de47fae` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:56.803055 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266b4060-97ec-46a3-877c-f2867120c4fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=98ccca347f17412c9ac888059de47fae)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:35:56.804973 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266b4060-97ec-46a3-877c-f2867120c4fd admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:35:56.854993 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-266b4060-97ec-46a3-877c-f2867120c4fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98ccca347f17412c9ac888059de47fae', 'request_id': 'req-266b4060-97ec-46a3-877c-f2867120c4fd'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:35:56.862466 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-266b4060-97ec-46a3-877c-f2867120c4fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98ccca347f17412c9ac888059de47fae', 'request_id': 'req-266b4060-97ec-46a3-877c-f2867120c4fd'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:35:56.873509 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-266b4060-97ec-46a3-877c-f2867120c4fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98ccca347f17412c9ac888059de47fae', 'request_id': 'req-266b4060-97ec-46a3-877c-f2867120c4fd'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:35:56.877903 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:35:56.886998 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-266b4060-97ec-46a3-877c-f2867120c4fd admin admin] The token cache is being invalidate because project 98ccca347f17412c9ac888059de47fae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:35:56.887308 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-266b4060-97ec-46a3-877c-f2867120c4fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:35:56.888609 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-266b4060-97ec-46a3-877c-f2867120c4fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:35:56.891472 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1301/2581] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:35:56 2022] DELETE /identity/v3/projects/98ccca347f17412c9ac888059de47fae => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:35:56.896500 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f7977-3959-4c94-b0ae-77b3dd0b6f80 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:56.896794 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f7977-3959-4c94-b0ae-77b3dd0b6f80 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:56.897074 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f7977-3959-4c94-b0ae-77b3dd0b6f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:56.917840 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-494f7977-3959-4c94-b0ae-77b3dd0b6f80 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:35:56.918975 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-494f7977-3959-4c94-b0ae-77b3dd0b6f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:35:56.960585 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:35:56.985320 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1281/2582] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:35:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:35:56.994856 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a4b0a-000a-4ef6-bcf2-0385d59b0a59 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:56.995140 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a4b0a-000a-4ef6-bcf2-0385d59b0a59 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:56.995414 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a4b0a-000a-4ef6-bcf2-0385d59b0a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:57.016314 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-6c3a4b0a-000a-4ef6-bcf2-0385d59b0a59 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:35:57.017614 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-6c3a4b0a-000a-4ef6-bcf2-0385d59b0a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:35:57.027409 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1302/2583] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:35:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:35:57.031677 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f7977-3959-4c94-b0ae-77b3dd0b6f80 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:35:57.041389 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f7977-3959-4c94-b0ae-77b3dd0b6f80 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:35:57.046119 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a79c0-961e-4cde-a074-eb899d578d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:35:57.046715 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a79c0-961e-4cde-a074-eb899d578d8a admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:57.046992 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a79c0-961e-4cde-a074-eb899d578d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:57.047262 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a79c0-961e-4cde-a074-eb899d578d8a admin admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:57.048035 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7a79c0-961e-4cde-a074-eb899d578d8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:35:57.048333 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7a79c0-961e-4cde-a074-eb899d578d8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:35:57.049934 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7a79c0-961e-4cde-a074-eb899d578d8a admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:35:57.062396 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1282/2584] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 30 01:35:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:35:57.066984 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3a4b0a-000a-4ef6-bcf2-0385d59b0a59 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:35:57.077044 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3a4b0a-000a-4ef6-bcf2-0385d59b0a59 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:35:57.081794 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f668b5-e5d7-493b-b966-e4b849641a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:35:57.082389 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f668b5-e5d7-493b-b966-e4b849641a01 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:57.082664 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f668b5-e5d7-493b-b966-e4b849641a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:57.082932 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f668b5-e5d7-493b-b966-e4b849641a01 admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:57.083611 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f668b5-e5d7-493b-b966-e4b849641a01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:35:57.085773 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f668b5-e5d7-493b-b966-e4b849641a01 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:35:57.114742 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1303/2585] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:35:57 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:35:57.119527 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a79c0-961e-4cde-a074-eb899d578d8a admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:35:57.129442 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a79c0-961e-4cde-a074-eb899d578d8a admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:35:57.186157 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9916da66-7af9-4199-95c0-11342ae473ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:35:57.186692 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916da66-7af9-4199-95c0-11342ae473ce admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:57.186983 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916da66-7af9-4199-95c0-11342ae473ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:57.187249 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916da66-7af9-4199-95c0-11342ae473ce admin admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:57.187902 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9916da66-7af9-4199-95c0-11342ae473ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:35:57.189812 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9916da66-7af9-4199-95c0-11342ae473ce admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:35:57.211699 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1283/2586] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:35:57 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:35:57.216005 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f668b5-e5d7-493b-b966-e4b849641a01 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:35:57.226111 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f668b5-e5d7-493b-b966-e4b849641a01 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:35:57.230646 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f6207-7e8b-4f7a-8c31-204c62e87ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:35:57.231239 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f6207-7e8b-4f7a-8c31-204c62e87ff2 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:57.231578 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f6207-7e8b-4f7a-8c31-204c62e87ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:57.231860 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f6207-7e8b-4f7a-8c31-204c62e87ff2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:57.232497 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20f6207-7e8b-4f7a-8c31-204c62e87ff2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:35:57.234100 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20f6207-7e8b-4f7a-8c31-204c62e87ff2 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:35:57.244273 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1304/2587] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:35:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:35:57.248085 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9916da66-7af9-4199-95c0-11342ae473ce admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:35:57.258076 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9916da66-7af9-4199-95c0-11342ae473ce admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:35:57.263243 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a8b77-3e9f-4c3d-8ab0-0d239061778e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:35:57.263878 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a8b77-3e9f-4c3d-8ab0-0d239061778e admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:57.264161 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a8b77-3e9f-4c3d-8ab0-0d239061778e admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:57.264435 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a8b77-3e9f-4c3d-8ab0-0d239061778e admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:57.265077 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35a8b77-3e9f-4c3d-8ab0-0d239061778e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:35:57.266684 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35a8b77-3e9f-4c3d-8ab0-0d239061778e admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:35:57.277141 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1284/2588] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:35:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:35:57.281227 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f6207-7e8b-4f7a-8c31-204c62e87ff2 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:35:57.291141 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f6207-7e8b-4f7a-8c31-204c62e87ff2 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:35:57.295731 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f96959f-d9cf-453e-810e-eb1f5554eaf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:35:57.296380 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96959f-d9cf-453e-810e-eb1f5554eaf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:57.296660 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96959f-d9cf-453e-810e-eb1f5554eaf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:57.296934 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96959f-d9cf-453e-810e-eb1f5554eaf1 admin admin] PATH_INFO: `/v3/projects/91567fdd86f04027b399ae7cf2d30553/users/0de1e854d9714481b7f773d25c4153f2/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:57.312022 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f96959f-d9cf-453e-810e-eb1f5554eaf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91567fdd86f04027b399ae7cf2d30553, user_id=0de1e854d9714481b7f773d25c4153f2, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:35:57.314704 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f96959f-d9cf-453e-810e-eb1f5554eaf1 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:35:57.328746 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1305/2589] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:35:57 2022] PUT /identity/v3/projects/91567fdd86f04027b399ae7cf2d30553/users/0de1e854d9714481b7f773d25c4153f2/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:35:57.339214 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b9c36-0346-4e7d-84af-c3ce58e61e3c None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:57.339536 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b9c36-0346-4e7d-84af-c3ce58e61e3c None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:57.339817 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b9c36-0346-4e7d-84af-c3ce58e61e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:57.366463 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-795b9c36-0346-4e7d-84af-c3ce58e61e3c None None] MFA Rules not processed for user `0de1e854d9714481b7f773d25c4153f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:35:57.367763 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-795b9c36-0346-4e7d-84af-c3ce58e61e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:35:57.437105 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1285/2590] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:35:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:35:57.441545 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f96959f-d9cf-453e-810e-eb1f5554eaf1 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:35:57.504565 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f96959f-d9cf-453e-810e-eb1f5554eaf1 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:35:57.509209 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f534ad01-7dac-4b7e-b3a6-324a9ffc5e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:35:57.509854 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f534ad01-7dac-4b7e-b3a6-324a9ffc5e5b admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:57.510140 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f534ad01-7dac-4b7e-b3a6-324a9ffc5e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:57.510418 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f534ad01-7dac-4b7e-b3a6-324a9ffc5e5b admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:57.511075 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f534ad01-7dac-4b7e-b3a6-324a9ffc5e5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:35:57.513034 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f534ad01-7dac-4b7e-b3a6-324a9ffc5e5b admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:35:57.539102 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1306/2591] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:35:57 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:35:57.543743 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795b9c36-0346-4e7d-84af-c3ce58e61e3c None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:35:57.554272 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795b9c36-0346-4e7d-84af-c3ce58e61e3c None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:35:57.587843 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:35:57.613061 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd91844-64b4-468b-93d5-d015950b77d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:35:57.613676 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd91844-64b4-468b-93d5-d015950b77d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:57.613957 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd91844-64b4-468b-93d5-d015950b77d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:57.614234 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd91844-64b4-468b-93d5-d015950b77d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:57.614871 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd91844-64b4-468b-93d5-d015950b77d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:35:57.616838 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd91844-64b4-468b-93d5-d015950b77d9 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:35:57.638729 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1286/2592] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:35:57 2022] POST /identity/v3/users => generated 295 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:35:57.642756 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f534ad01-7dac-4b7e-b3a6-324a9ffc5e5b admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:35:57.653149 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f534ad01-7dac-4b7e-b3a6-324a9ffc5e5b admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:35:57.657925 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a920b9e-47e9-4a25-b773-fd45074ae7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:35:57.658522 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a920b9e-47e9-4a25-b773-fd45074ae7c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:57.658807 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a920b9e-47e9-4a25-b773-fd45074ae7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:57.659079 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a920b9e-47e9-4a25-b773-fd45074ae7c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:57.659756 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a920b9e-47e9-4a25-b773-fd45074ae7c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:35:57.661399 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a920b9e-47e9-4a25-b773-fd45074ae7c9 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:35:57.672462 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1307/2593] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:35:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:35:57.676467 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd91844-64b4-468b-93d5-d015950b77d9 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:35:57.687251 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd91844-64b4-468b-93d5-d015950b77d9 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:35:57.691823 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e825e86-bcfd-427b-8cc1-e5ae0ca04502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:35:57.692463 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e825e86-bcfd-427b-8cc1-e5ae0ca04502 admin admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:57.692743 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e825e86-bcfd-427b-8cc1-e5ae0ca04502 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:57.693018 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e825e86-bcfd-427b-8cc1-e5ae0ca04502 admin admin] PATH_INFO: `/v3/projects/f5fcd2682a5f4337884859ad3d4f2390/users/7597f451e9ab4a73aa28d2dd081be54a/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:57.707473 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e825e86-bcfd-427b-8cc1-e5ae0ca04502 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5fcd2682a5f4337884859ad3d4f2390, user_id=7597f451e9ab4a73aa28d2dd081be54a, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:35:57.710380 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e825e86-bcfd-427b-8cc1-e5ae0ca04502 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:35:57.723996 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1287/2594] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:35:57 2022] PUT /identity/v3/projects/f5fcd2682a5f4337884859ad3d4f2390/users/7597f451e9ab4a73aa28d2dd081be54a/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:35:57.728404 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a920b9e-47e9-4a25-b773-fd45074ae7c9 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:35:57.738398 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a920b9e-47e9-4a25-b773-fd45074ae7c9 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:35:57.796186 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce49469c-a002-4f5b-803b-34423022b409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:35:57.796773 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49469c-a002-4f5b-803b-34423022b409 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:57.797047 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49469c-a002-4f5b-803b-34423022b409 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:57.797316 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49469c-a002-4f5b-803b-34423022b409 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:57.797949 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce49469c-a002-4f5b-803b-34423022b409 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:35:57.799580 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce49469c-a002-4f5b-803b-34423022b409 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:35:57.804638 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:35:57.811392 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1308/2595] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:35:57 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:35:57.814832 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e825e86-bcfd-427b-8cc1-e5ae0ca04502 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:35:57.825065 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e825e86-bcfd-427b-8cc1-e5ae0ca04502 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:35:57.829624 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684dfc34-8bd6-4134-ad3b-5a5ee7662982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:35:57.830268 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684dfc34-8bd6-4134-ad3b-5a5ee7662982 admin admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:57.830550 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684dfc34-8bd6-4134-ad3b-5a5ee7662982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:57.830825 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684dfc34-8bd6-4134-ad3b-5a5ee7662982 admin admin] PATH_INFO: `/v3/projects/f5fcd2682a5f4337884859ad3d4f2390/users/7597f451e9ab4a73aa28d2dd081be54a/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:57.832779 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684dfc34-8bd6-4134-ad3b-5a5ee7662982 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5fcd2682a5f4337884859ad3d4f2390, user_id=7597f451e9ab4a73aa28d2dd081be54a, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:35:57.835732 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684dfc34-8bd6-4134-ad3b-5a5ee7662982 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:35:57.846759 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1288/2596] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:35:57 2022] PUT /identity/v3/projects/f5fcd2682a5f4337884859ad3d4f2390/users/7597f451e9ab4a73aa28d2dd081be54a/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:35:57.857552 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a81350-732f-42fd-86eb-39f377975490 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:57.857929 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a81350-732f-42fd-86eb-39f377975490 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:57.858212 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a81350-732f-42fd-86eb-39f377975490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:57.885275 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-36a81350-732f-42fd-86eb-39f377975490 None None] MFA Rules not processed for user `7597f451e9ab4a73aa28d2dd081be54a`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:35:57.886487 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-36a81350-732f-42fd-86eb-39f377975490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:35:57.953889 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1309/2597] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:35:57 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:35:57.967421 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684dfc34-8bd6-4134-ad3b-5a5ee7662982 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:35:57.969117 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-684dfc34-8bd6-4134-ad3b-5a5ee7662982 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:35:58.026166 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684dfc34-8bd6-4134-ad3b-5a5ee7662982 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:35:58.029812 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dbcab1-a7e4-44fe-b7bb-67e9451b42bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:35:58.030407 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dbcab1-a7e4-44fe-b7bb-67e9451b42bf service cinder] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:58.030675 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dbcab1-a7e4-44fe-b7bb-67e9451b42bf service cinder] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:58.030940 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dbcab1-a7e4-44fe-b7bb-67e9451b42bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:58.084944 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dbcab1-a7e4-44fe-b7bb-67e9451b42bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:35:58.086358 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dbcab1-a7e4-44fe-b7bb-67e9451b42bf service cinder] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:35:58.095701 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1289/2598] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:35:57 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:35:59.448568 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a81350-732f-42fd-86eb-39f377975490 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:35:59.450014 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-36a81350-732f-42fd-86eb-39f377975490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:35:59.462650 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a81350-732f-42fd-86eb-39f377975490 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:35:59.466537 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44772242-0b64-4b20-8b98-749de1d89854 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:35:59.466820 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44772242-0b64-4b20-8b98-749de1d89854 service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:35:59.467094 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44772242-0b64-4b20-8b98-749de1d89854 service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:35:59.467362 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44772242-0b64-4b20-8b98-749de1d89854 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:35:59.476085 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44772242-0b64-4b20-8b98-749de1d89854 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:35:59.477491 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44772242-0b64-4b20-8b98-749de1d89854 service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:35:59.487997 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1310/2599] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:35:59 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:36:03.277285 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dbcab1-a7e4-44fe-b7bb-67e9451b42bf service cinder] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:03.323570 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:36:03.342524 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dbcab1-a7e4-44fe-b7bb-67e9451b42bf service cinder] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:03.347070 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6379abae-6ee3-4e45-9907-bec75ba347f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:03.347726 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6379abae-6ee3-4e45-9907-bec75ba347f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:03.348011 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6379abae-6ee3-4e45-9907-bec75ba347f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:03.348282 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6379abae-6ee3-4e45-9907-bec75ba347f0 admin admin] PATH_INFO: `/v3/users/0de1e854d9714481b7f773d25c4153f2` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:03.349411 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6379abae-6ee3-4e45-9907-bec75ba347f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0de1e854d9714481b7f773d25c4153f2)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:03.351340 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6379abae-6ee3-4e45-9907-bec75ba347f0 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:03.397863 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-6379abae-6ee3-4e45-9907-bec75ba347f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0de1e854d9714481b7f773d25c4153f2'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:03.405796 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-6379abae-6ee3-4e45-9907-bec75ba347f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0de1e854d9714481b7f773d25c4153f2'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:03.406436 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-6379abae-6ee3-4e45-9907-bec75ba347f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0de1e854d9714481b7f773d25c4153f2'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:03.407115 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-6379abae-6ee3-4e45-9907-bec75ba347f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0de1e854d9714481b7f773d25c4153f2'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:03.419544 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-6379abae-6ee3-4e45-9907-bec75ba347f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0de1e854d9714481b7f773d25c4153f2'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:03.431607 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1290/2600] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:36:03 2022] DELETE /identity/v3/users/0de1e854d9714481b7f773d25c4153f2 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:36:03.436194 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a978c120-0b5d-47a2-bf12-d13086fc128a None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:03.436671 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a978c120-0b5d-47a2-bf12-d13086fc128a None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:03.436804 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a978c120-0b5d-47a2-bf12-d13086fc128a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:03.456035 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-a978c120-0b5d-47a2-bf12-d13086fc128a None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:36:03.457238 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-a978c120-0b5d-47a2-bf12-d13086fc128a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:03.515565 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1311/2601] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:36:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:36:03.526081 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6379abae-6ee3-4e45-9907-bec75ba347f0 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:03.527613 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-6379abae-6ee3-4e45-9907-bec75ba347f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:03.583381 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6379abae-6ee3-4e45-9907-bec75ba347f0 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:03.587878 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59e9963-77ef-4519-8d76-a61df4b50156 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:03.588494 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e9963-77ef-4519-8d76-a61df4b50156 service neutron] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:03.588768 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e9963-77ef-4519-8d76-a61df4b50156 service neutron] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:03.589036 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e9963-77ef-4519-8d76-a61df4b50156 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:03.598461 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59e9963-77ef-4519-8d76-a61df4b50156 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:03.599937 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59e9963-77ef-4519-8d76-a61df4b50156 service neutron] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:03.610260 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1291/2602] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:36:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:36:03.878546 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a978c120-0b5d-47a2-bf12-d13086fc128a None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:03.880001 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-a978c120-0b5d-47a2-bf12-d13086fc128a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:03.892299 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a978c120-0b5d-47a2-bf12-d13086fc128a None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:03.897172 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6ef5d-5b78-4944-b638-4771f4e2032f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:03.898415 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6ef5d-5b78-4944-b638-4771f4e2032f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:03.898703 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6ef5d-5b78-4944-b638-4771f4e2032f admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:03.898977 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6ef5d-5b78-4944-b638-4771f4e2032f admin admin] PATH_INFO: `/v3/projects/91567fdd86f04027b399ae7cf2d30553` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:03.900633 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc6ef5d-5b78-4944-b638-4771f4e2032f admin admin] RBAC: Authorizing `identity:delete_project(project_id=91567fdd86f04027b399ae7cf2d30553)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:03.902567 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc6ef5d-5b78-4944-b638-4771f4e2032f admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:03.948844 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-cfc6ef5d-5b78-4944-b638-4771f4e2032f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91567fdd86f04027b399ae7cf2d30553', 'request_id': 'req-cfc6ef5d-5b78-4944-b638-4771f4e2032f'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:03.955006 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-cfc6ef5d-5b78-4944-b638-4771f4e2032f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91567fdd86f04027b399ae7cf2d30553', 'request_id': 'req-cfc6ef5d-5b78-4944-b638-4771f4e2032f'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:03.963391 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-cfc6ef5d-5b78-4944-b638-4771f4e2032f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91567fdd86f04027b399ae7cf2d30553', 'request_id': 'req-cfc6ef5d-5b78-4944-b638-4771f4e2032f'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:03.968138 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:36:03.975688 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-cfc6ef5d-5b78-4944-b638-4771f4e2032f admin admin] The token cache is being invalidate because project 91567fdd86f04027b399ae7cf2d30553 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:36:03.976168 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-cfc6ef5d-5b78-4944-b638-4771f4e2032f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:03.977167 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-cfc6ef5d-5b78-4944-b638-4771f4e2032f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:03.979319 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1312/2603] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:36:03 2022] DELETE /identity/v3/projects/91567fdd86f04027b399ae7cf2d30553 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:36:03.983535 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59e9963-77ef-4519-8d76-a61df4b50156 service neutron] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:03.993165 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59e9963-77ef-4519-8d76-a61df4b50156 service neutron] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:04.050197 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4bf357-2eb7-44f5-bb9b-df1ad156b707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:04.050823 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4bf357-2eb7-44f5-bb9b-df1ad156b707 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:04.051101 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4bf357-2eb7-44f5-bb9b-df1ad156b707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:04.051372 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4bf357-2eb7-44f5-bb9b-df1ad156b707 admin admin] PATH_INFO: `/v3/users/7597f451e9ab4a73aa28d2dd081be54a` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:04.052538 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4bf357-2eb7-44f5-bb9b-df1ad156b707 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7597f451e9ab4a73aa28d2dd081be54a)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:04.054449 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4bf357-2eb7-44f5-bb9b-df1ad156b707 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:04.059873 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:36:04.101169 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-4e4bf357-2eb7-44f5-bb9b-df1ad156b707 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7597f451e9ab4a73aa28d2dd081be54a'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:04.108097 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-4e4bf357-2eb7-44f5-bb9b-df1ad156b707 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7597f451e9ab4a73aa28d2dd081be54a'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:04.108711 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-4e4bf357-2eb7-44f5-bb9b-df1ad156b707 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7597f451e9ab4a73aa28d2dd081be54a'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:04.109312 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-4e4bf357-2eb7-44f5-bb9b-df1ad156b707 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7597f451e9ab4a73aa28d2dd081be54a'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:04.121046 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-4e4bf357-2eb7-44f5-bb9b-df1ad156b707 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7597f451e9ab4a73aa28d2dd081be54a'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:04.133393 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1292/2604] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:36:03 2022] DELETE /identity/v3/users/7597f451e9ab4a73aa28d2dd081be54a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:36:04.407206 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6ef5d-5b78-4944-b638-4771f4e2032f admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:04.409061 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-cfc6ef5d-5b78-4944-b638-4771f4e2032f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:04.423783 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6ef5d-5b78-4944-b638-4771f4e2032f admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:04.481182 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e099281a-6255-43c3-ab1c-5059bc470142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:04.481844 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e099281a-6255-43c3-ab1c-5059bc470142 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:04.481977 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e099281a-6255-43c3-ab1c-5059bc470142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:04.482402 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e099281a-6255-43c3-ab1c-5059bc470142 admin admin] PATH_INFO: `/v3/projects/f5fcd2682a5f4337884859ad3d4f2390` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:04.484374 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e099281a-6255-43c3-ab1c-5059bc470142 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5fcd2682a5f4337884859ad3d4f2390)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:04.486527 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e099281a-6255-43c3-ab1c-5059bc470142 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:04.534678 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e099281a-6255-43c3-ab1c-5059bc470142 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5fcd2682a5f4337884859ad3d4f2390', 'request_id': 'req-e099281a-6255-43c3-ab1c-5059bc470142'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:04.540851 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e099281a-6255-43c3-ab1c-5059bc470142 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5fcd2682a5f4337884859ad3d4f2390', 'request_id': 'req-e099281a-6255-43c3-ab1c-5059bc470142'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:04.548246 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e099281a-6255-43c3-ab1c-5059bc470142 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5fcd2682a5f4337884859ad3d4f2390', 'request_id': 'req-e099281a-6255-43c3-ab1c-5059bc470142'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:04.559216 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e099281a-6255-43c3-ab1c-5059bc470142 admin admin] The token cache is being invalidate because project f5fcd2682a5f4337884859ad3d4f2390 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:36:04.559560 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e099281a-6255-43c3-ab1c-5059bc470142 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:04.560166 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e099281a-6255-43c3-ab1c-5059bc470142 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:04.561670 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1313/2605] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:36:04 2022] DELETE /identity/v3/projects/f5fcd2682a5f4337884859ad3d4f2390 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:36:04.566556 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b916f-490f-4bc1-aa1e-d0d024883a0f None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:04.567033 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b916f-490f-4bc1-aa1e-d0d024883a0f None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:04.567173 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b916f-490f-4bc1-aa1e-d0d024883a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:04.589127 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-142b916f-490f-4bc1-aa1e-d0d024883a0f None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:36:04.590346 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-142b916f-490f-4bc1-aa1e-d0d024883a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:04.649850 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1293/2606] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:36:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:36:04.658927 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24befcd-b57d-4331-aef8-0c142d53edc1 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:04.659216 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24befcd-b57d-4331-aef8-0c142d53edc1 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:04.659531 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24befcd-b57d-4331-aef8-0c142d53edc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:04.679281 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-b24befcd-b57d-4331-aef8-0c142d53edc1 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:36:04.680518 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-b24befcd-b57d-4331-aef8-0c142d53edc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:04.688964 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1314/2607] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:36:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:36:04.693158 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b916f-490f-4bc1-aa1e-d0d024883a0f None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:04.703341 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b916f-490f-4bc1-aa1e-d0d024883a0f None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:04.707894 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c30182c-498d-48a0-afa1-0558fde448e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:04.708489 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30182c-498d-48a0-afa1-0558fde448e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:04.708770 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30182c-498d-48a0-afa1-0558fde448e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:04.709044 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30182c-498d-48a0-afa1-0558fde448e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:04.709955 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c30182c-498d-48a0-afa1-0558fde448e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:36:04.710257 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c30182c-498d-48a0-afa1-0558fde448e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:04.711888 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c30182c-498d-48a0-afa1-0558fde448e5 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:04.723302 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1294/2608] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 30 01:36:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:36:04.727552 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24befcd-b57d-4331-aef8-0c142d53edc1 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:04.736781 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24befcd-b57d-4331-aef8-0c142d53edc1 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:04.741272 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b8d56-4896-40a3-9fdf-8ebac4b0139f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:04.741855 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b8d56-4896-40a3-9fdf-8ebac4b0139f admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:04.742132 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b8d56-4896-40a3-9fdf-8ebac4b0139f admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:04.742404 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b8d56-4896-40a3-9fdf-8ebac4b0139f admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:04.743029 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484b8d56-4896-40a3-9fdf-8ebac4b0139f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:04.745500 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484b8d56-4896-40a3-9fdf-8ebac4b0139f admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:04.774715 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1315/2609] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:36:04 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:36:04.778909 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c30182c-498d-48a0-afa1-0558fde448e5 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:04.789300 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c30182c-498d-48a0-afa1-0558fde448e5 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:04.846610 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd83e8dd-2381-435e-a32d-c3f2545d9ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:04.847739 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83e8dd-2381-435e-a32d-c3f2545d9ac9 admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:04.847739 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83e8dd-2381-435e-a32d-c3f2545d9ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:04.847739 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83e8dd-2381-435e-a32d-c3f2545d9ac9 admin admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:04.848410 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd83e8dd-2381-435e-a32d-c3f2545d9ac9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:04.850325 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd83e8dd-2381-435e-a32d-c3f2545d9ac9 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:04.874994 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1295/2610] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:36:04 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:36:04.876381 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b8d56-4896-40a3-9fdf-8ebac4b0139f admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:04.890022 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b8d56-4896-40a3-9fdf-8ebac4b0139f admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:04.894787 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3248c61-5fc6-4d20-ae90-ecd2eab8a620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:04.895378 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3248c61-5fc6-4d20-ae90-ecd2eab8a620 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:04.895695 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3248c61-5fc6-4d20-ae90-ecd2eab8a620 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:04.895969 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3248c61-5fc6-4d20-ae90-ecd2eab8a620 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:04.896617 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3248c61-5fc6-4d20-ae90-ecd2eab8a620 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:04.898249 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3248c61-5fc6-4d20-ae90-ecd2eab8a620 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:04.908550 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1316/2611] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:36:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:36:04.912629 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd83e8dd-2381-435e-a32d-c3f2545d9ac9 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:04.918230 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:36:04.924841 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd83e8dd-2381-435e-a32d-c3f2545d9ac9 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:04.931605 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf76cee-0772-4805-9a20-14ae5486218e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:04.932201 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf76cee-0772-4805-9a20-14ae5486218e admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:04.932475 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf76cee-0772-4805-9a20-14ae5486218e admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:04.932742 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf76cee-0772-4805-9a20-14ae5486218e admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:04.933380 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf76cee-0772-4805-9a20-14ae5486218e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:04.934995 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf76cee-0772-4805-9a20-14ae5486218e admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:04.945788 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1296/2612] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:36:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:36:04.950510 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3248c61-5fc6-4d20-ae90-ecd2eab8a620 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:04.962134 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3248c61-5fc6-4d20-ae90-ecd2eab8a620 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:04.966741 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c960808-ce8e-4303-8c6b-923a6a3832fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:04.967387 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c960808-ce8e-4303-8c6b-923a6a3832fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:04.967698 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c960808-ce8e-4303-8c6b-923a6a3832fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:04.967974 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c960808-ce8e-4303-8c6b-923a6a3832fc admin admin] PATH_INFO: `/v3/projects/cc8628a708cf4dbbb20d794fa13030b0/users/e369726f98a54b39bd52f827ecb863bb/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:04.982773 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c960808-ce8e-4303-8c6b-923a6a3832fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc8628a708cf4dbbb20d794fa13030b0, user_id=e369726f98a54b39bd52f827ecb863bb, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:04.985462 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c960808-ce8e-4303-8c6b-923a6a3832fc admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:04.998647 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1317/2613] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:36:04 2022] PUT /identity/v3/projects/cc8628a708cf4dbbb20d794fa13030b0/users/e369726f98a54b39bd52f827ecb863bb/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:36:05.009058 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df001c0-b4af-45e2-9710-c0b0ee4171e3 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:05.009343 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df001c0-b4af-45e2-9710-c0b0ee4171e3 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:05.010237 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df001c0-b4af-45e2-9710-c0b0ee4171e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:05.038023 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-8df001c0-b4af-45e2-9710-c0b0ee4171e3 None None] MFA Rules not processed for user `e369726f98a54b39bd52f827ecb863bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:36:05.039235 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-8df001c0-b4af-45e2-9710-c0b0ee4171e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:05.106430 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1297/2614] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:36:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:36:05.111027 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c960808-ce8e-4303-8c6b-923a6a3832fc admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:05.137975 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:36:05.177440 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c960808-ce8e-4303-8c6b-923a6a3832fc admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:05.182189 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b8974-097b-492b-98a1-30cf0a68cc0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:05.182793 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b8974-097b-492b-98a1-30cf0a68cc0e admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:05.183085 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b8974-097b-492b-98a1-30cf0a68cc0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:05.183348 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b8974-097b-492b-98a1-30cf0a68cc0e admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:05.184005 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7b8974-097b-492b-98a1-30cf0a68cc0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:05.185957 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7b8974-097b-492b-98a1-30cf0a68cc0e admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:05.214691 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1318/2615] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:36:05 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:36:05.218747 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df001c0-b4af-45e2-9710-c0b0ee4171e3 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:05.229476 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df001c0-b4af-45e2-9710-c0b0ee4171e3 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:05.293540 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfd1256-67d5-4b29-8bef-12771f316bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:05.294154 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd1256-67d5-4b29-8bef-12771f316bc6 admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:05.294429 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd1256-67d5-4b29-8bef-12771f316bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:05.294697 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd1256-67d5-4b29-8bef-12771f316bc6 admin admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:05.295335 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfd1256-67d5-4b29-8bef-12771f316bc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:05.297296 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfd1256-67d5-4b29-8bef-12771f316bc6 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:05.319945 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1298/2616] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:36:05 2022] POST /identity/v3/users => generated 298 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:36:05.324633 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b8974-097b-492b-98a1-30cf0a68cc0e admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:05.336045 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b8974-097b-492b-98a1-30cf0a68cc0e admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:05.344816 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b148ec-a3a7-420a-91a8-7bab915f7b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:05.345438 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b148ec-a3a7-420a-91a8-7bab915f7b1e admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:05.345720 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b148ec-a3a7-420a-91a8-7bab915f7b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:05.345994 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b148ec-a3a7-420a-91a8-7bab915f7b1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:05.346648 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b148ec-a3a7-420a-91a8-7bab915f7b1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:05.348953 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b148ec-a3a7-420a-91a8-7bab915f7b1e admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:05.361487 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1319/2617] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:36:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:36:05.365940 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfd1256-67d5-4b29-8bef-12771f316bc6 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:05.376780 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfd1256-67d5-4b29-8bef-12771f316bc6 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:05.381505 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6549e7de-d213-48e2-8183-f4f57581dc7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:05.382166 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549e7de-d213-48e2-8183-f4f57581dc7a admin admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:05.382449 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549e7de-d213-48e2-8183-f4f57581dc7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:05.382723 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549e7de-d213-48e2-8183-f4f57581dc7a admin admin] PATH_INFO: `/v3/projects/80133da5f71844ad96e8817b42164688/users/100ca9eb00be4d83aafe8c4c385b9a00/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:05.398401 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6549e7de-d213-48e2-8183-f4f57581dc7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=80133da5f71844ad96e8817b42164688, user_id=100ca9eb00be4d83aafe8c4c385b9a00, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:05.401684 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6549e7de-d213-48e2-8183-f4f57581dc7a admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:05.416401 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1299/2618] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:36:05 2022] PUT /identity/v3/projects/80133da5f71844ad96e8817b42164688/users/100ca9eb00be4d83aafe8c4c385b9a00/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:36:05.420948 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b148ec-a3a7-420a-91a8-7bab915f7b1e admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:05.431552 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b148ec-a3a7-420a-91a8-7bab915f7b1e admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:05.487676 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddcaf22-b04a-46d0-85c0-32deefad3e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:05.488290 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddcaf22-b04a-46d0-85c0-32deefad3e5a admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:05.488544 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddcaf22-b04a-46d0-85c0-32deefad3e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:05.488814 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddcaf22-b04a-46d0-85c0-32deefad3e5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:05.489452 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddcaf22-b04a-46d0-85c0-32deefad3e5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:05.491087 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddcaf22-b04a-46d0-85c0-32deefad3e5a admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:05.501148 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1320/2619] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:36:05 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:36:05.505430 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6549e7de-d213-48e2-8183-f4f57581dc7a admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:05.516092 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6549e7de-d213-48e2-8183-f4f57581dc7a admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:05.520714 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dda00b-cfe6-43c2-ad6f-ceca1f1586c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:05.521423 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dda00b-cfe6-43c2-ad6f-ceca1f1586c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:05.521832 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dda00b-cfe6-43c2-ad6f-ceca1f1586c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:05.522136 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dda00b-cfe6-43c2-ad6f-ceca1f1586c4 admin admin] PATH_INFO: `/v3/projects/80133da5f71844ad96e8817b42164688/users/100ca9eb00be4d83aafe8c4c385b9a00/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:05.524128 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dda00b-cfe6-43c2-ad6f-ceca1f1586c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80133da5f71844ad96e8817b42164688, user_id=100ca9eb00be4d83aafe8c4c385b9a00, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:05.527314 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dda00b-cfe6-43c2-ad6f-ceca1f1586c4 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:05.538001 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1300/2620] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:36:05 2022] PUT /identity/v3/projects/80133da5f71844ad96e8817b42164688/users/100ca9eb00be4d83aafe8c4c385b9a00/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:36:05.549745 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b15fbb-8120-42d2-a3e6-45fdc4412140 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:05.550037 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b15fbb-8120-42d2-a3e6-45fdc4412140 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:05.550316 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b15fbb-8120-42d2-a3e6-45fdc4412140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:05.580174 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-a9b15fbb-8120-42d2-a3e6-45fdc4412140 None None] MFA Rules not processed for user `100ca9eb00be4d83aafe8c4c385b9a00`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:36:05.581387 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-a9b15fbb-8120-42d2-a3e6-45fdc4412140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:05.664453 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1321/2621] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:36:05 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:36:05.675192 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dda00b-cfe6-43c2-ad6f-ceca1f1586c4 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:05.677016 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-76dda00b-cfe6-43c2-ad6f-ceca1f1586c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:05.713836 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:36:05.738735 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dda00b-cfe6-43c2-ad6f-ceca1f1586c4 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:05.742357 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc10a43-0741-471c-818d-2e9f6fd6c1a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:05.742963 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc10a43-0741-471c-818d-2e9f6fd6c1a6 service cinder] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:05.743299 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc10a43-0741-471c-818d-2e9f6fd6c1a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:05.743607 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc10a43-0741-471c-818d-2e9f6fd6c1a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:05.800669 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc10a43-0741-471c-818d-2e9f6fd6c1a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:05.802025 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc10a43-0741-471c-818d-2e9f6fd6c1a6 service cinder] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:05.810859 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1301/2622] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:36:05 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:36:10.070547 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b15fbb-8120-42d2-a3e6-45fdc4412140 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:10.072002 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-a9b15fbb-8120-42d2-a3e6-45fdc4412140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:10.083981 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b15fbb-8120-42d2-a3e6-45fdc4412140 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:10.088366 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5711811b-1d47-4068-8fb7-a451682f89be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:10.088955 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5711811b-1d47-4068-8fb7-a451682f89be service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:10.089234 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5711811b-1d47-4068-8fb7-a451682f89be service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:10.089507 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5711811b-1d47-4068-8fb7-a451682f89be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:10.098385 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5711811b-1d47-4068-8fb7-a451682f89be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:10.099854 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5711811b-1d47-4068-8fb7-a451682f89be service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:10.109773 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1322/2623] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:36:10 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:36:13.309176 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc10a43-0741-471c-818d-2e9f6fd6c1a6 service cinder] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:13.310709 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-9cc10a43-0741-471c-818d-2e9f6fd6c1a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:13.370200 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc10a43-0741-471c-818d-2e9f6fd6c1a6 service cinder] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:13.374764 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70453696-0194-41b0-8f00-ed1a9d76ee4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:13.375405 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70453696-0194-41b0-8f00-ed1a9d76ee4e service neutron] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:13.375712 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70453696-0194-41b0-8f00-ed1a9d76ee4e service neutron] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:13.375987 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70453696-0194-41b0-8f00-ed1a9d76ee4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:13.377736 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-70453696-0194-41b0-8f00-ed1a9d76ee4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:13.441716 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70453696-0194-41b0-8f00-ed1a9d76ee4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:13.443148 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70453696-0194-41b0-8f00-ed1a9d76ee4e service neutron] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:13.453396 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1302/2624] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:36:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:36:15.048080 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5711811b-1d47-4068-8fb7-a451682f89be service cinder] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:15.054176 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:36:15.059683 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5711811b-1d47-4068-8fb7-a451682f89be service cinder] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:15.067452 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ea7e0-709b-461c-b4df-af2ce0b3602b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:15.069175 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ea7e0-709b-461c-b4df-af2ce0b3602b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:15.069925 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ea7e0-709b-461c-b4df-af2ce0b3602b admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:15.070514 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ea7e0-709b-461c-b4df-af2ce0b3602b admin admin] PATH_INFO: `/v3/users/e369726f98a54b39bd52f827ecb863bb` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:15.072393 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92ea7e0-709b-461c-b4df-af2ce0b3602b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e369726f98a54b39bd52f827ecb863bb)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:15.074393 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92ea7e0-709b-461c-b4df-af2ce0b3602b admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:15.143076 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-b92ea7e0-709b-461c-b4df-af2ce0b3602b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e369726f98a54b39bd52f827ecb863bb'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:15.153264 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-b92ea7e0-709b-461c-b4df-af2ce0b3602b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e369726f98a54b39bd52f827ecb863bb'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:15.154069 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-b92ea7e0-709b-461c-b4df-af2ce0b3602b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e369726f98a54b39bd52f827ecb863bb'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:15.170323 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-b92ea7e0-709b-461c-b4df-af2ce0b3602b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e369726f98a54b39bd52f827ecb863bb'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:15.171201 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-b92ea7e0-709b-461c-b4df-af2ce0b3602b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e369726f98a54b39bd52f827ecb863bb'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:15.199217 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1323/2625] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:36:15 2022] DELETE /identity/v3/users/e369726f98a54b39bd52f827ecb863bb => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:36:15.203566 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516176b-c914-4c97-9cc4-fa1b0895091a None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:15.204073 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516176b-c914-4c97-9cc4-fa1b0895091a None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:15.204174 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516176b-c914-4c97-9cc4-fa1b0895091a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:15.227239 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-6516176b-c914-4c97-9cc4-fa1b0895091a None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:36:15.228503 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-6516176b-c914-4c97-9cc4-fa1b0895091a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:15.270177 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:36:15.306138 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1303/2626] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:36:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:36:15.313343 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ea7e0-709b-461c-b4df-af2ce0b3602b admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:15.315121 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-b92ea7e0-709b-461c-b4df-af2ce0b3602b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:15.402279 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ea7e0-709b-461c-b4df-af2ce0b3602b admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:15.409075 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a84259-dc66-4d35-bc0d-a6d323346d28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:15.410387 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a84259-dc66-4d35-bc0d-a6d323346d28 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:15.410897 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a84259-dc66-4d35-bc0d-a6d323346d28 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:15.411609 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a84259-dc66-4d35-bc0d-a6d323346d28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:15.425386 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a84259-dc66-4d35-bc0d-a6d323346d28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:15.427030 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a84259-dc66-4d35-bc0d-a6d323346d28 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:15.442251 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1324/2627] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:36:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:36:15.740986 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516176b-c914-4c97-9cc4-fa1b0895091a None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:15.743210 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-6516176b-c914-4c97-9cc4-fa1b0895091a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:15.757308 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516176b-c914-4c97-9cc4-fa1b0895091a None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:15.762710 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da042924-8e72-4842-97dc-12de03b87707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:15.763344 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da042924-8e72-4842-97dc-12de03b87707 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:15.763673 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da042924-8e72-4842-97dc-12de03b87707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:15.764073 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da042924-8e72-4842-97dc-12de03b87707 admin admin] PATH_INFO: `/v3/projects/cc8628a708cf4dbbb20d794fa13030b0` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:15.765217 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da042924-8e72-4842-97dc-12de03b87707 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc8628a708cf4dbbb20d794fa13030b0)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:15.767204 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da042924-8e72-4842-97dc-12de03b87707 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:15.819250 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-da042924-8e72-4842-97dc-12de03b87707 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc8628a708cf4dbbb20d794fa13030b0', 'request_id': 'req-da042924-8e72-4842-97dc-12de03b87707'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:15.826561 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-da042924-8e72-4842-97dc-12de03b87707 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc8628a708cf4dbbb20d794fa13030b0', 'request_id': 'req-da042924-8e72-4842-97dc-12de03b87707'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:15.834517 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-da042924-8e72-4842-97dc-12de03b87707 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc8628a708cf4dbbb20d794fa13030b0', 'request_id': 'req-da042924-8e72-4842-97dc-12de03b87707'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:15.846151 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-da042924-8e72-4842-97dc-12de03b87707 admin admin] The token cache is being invalidate because project cc8628a708cf4dbbb20d794fa13030b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81447) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:36:15.846447 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-da042924-8e72-4842-97dc-12de03b87707 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:15.847691 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-da042924-8e72-4842-97dc-12de03b87707 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:15.849271 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1304/2628] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:36:15 2022] DELETE /identity/v3/projects/cc8628a708cf4dbbb20d794fa13030b0 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:36:15.853538 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a84259-dc66-4d35-bc0d-a6d323346d28 service neutron] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:15.864067 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a84259-dc66-4d35-bc0d-a6d323346d28 service neutron] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:15.934018 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e2e0c7-52b2-4c1e-84b9-6050d4d30c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:15.934662 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e2e0c7-52b2-4c1e-84b9-6050d4d30c78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:15.934939 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e2e0c7-52b2-4c1e-84b9-6050d4d30c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:15.935212 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e2e0c7-52b2-4c1e-84b9-6050d4d30c78 admin admin] PATH_INFO: `/v3/users/100ca9eb00be4d83aafe8c4c385b9a00` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:15.936541 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e2e0c7-52b2-4c1e-84b9-6050d4d30c78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=100ca9eb00be4d83aafe8c4c385b9a00)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:15.938533 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e2e0c7-52b2-4c1e-84b9-6050d4d30c78 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:15.964142 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:36:15.996330 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-42e2e0c7-52b2-4c1e-84b9-6050d4d30c78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '100ca9eb00be4d83aafe8c4c385b9a00'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:16.005942 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-42e2e0c7-52b2-4c1e-84b9-6050d4d30c78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '100ca9eb00be4d83aafe8c4c385b9a00'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:16.006623 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-42e2e0c7-52b2-4c1e-84b9-6050d4d30c78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '100ca9eb00be4d83aafe8c4c385b9a00'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:16.026048 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-42e2e0c7-52b2-4c1e-84b9-6050d4d30c78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '100ca9eb00be4d83aafe8c4c385b9a00'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:16.026788 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-42e2e0c7-52b2-4c1e-84b9-6050d4d30c78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '100ca9eb00be4d83aafe8c4c385b9a00'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:16.043232 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1325/2629] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:36:15 2022] DELETE /identity/v3/users/100ca9eb00be4d83aafe8c4c385b9a00 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:36:16.417401 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da042924-8e72-4842-97dc-12de03b87707 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:16.418953 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-da042924-8e72-4842-97dc-12de03b87707 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:16.439286 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da042924-8e72-4842-97dc-12de03b87707 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:16.505730 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d359f12-b441-45f8-b9a4-a6254b970ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:16.506443 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d359f12-b441-45f8-b9a4-a6254b970ef5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:16.506647 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d359f12-b441-45f8-b9a4-a6254b970ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:16.506922 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d359f12-b441-45f8-b9a4-a6254b970ef5 admin admin] PATH_INFO: `/v3/projects/80133da5f71844ad96e8817b42164688` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:16.508051 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d359f12-b441-45f8-b9a4-a6254b970ef5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80133da5f71844ad96e8817b42164688)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:16.510006 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d359f12-b441-45f8-b9a4-a6254b970ef5 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:16.562552 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-9d359f12-b441-45f8-b9a4-a6254b970ef5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80133da5f71844ad96e8817b42164688', 'request_id': 'req-9d359f12-b441-45f8-b9a4-a6254b970ef5'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:16.584665 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-9d359f12-b441-45f8-b9a4-a6254b970ef5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80133da5f71844ad96e8817b42164688', 'request_id': 'req-9d359f12-b441-45f8-b9a4-a6254b970ef5'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:16.597952 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-9d359f12-b441-45f8-b9a4-a6254b970ef5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80133da5f71844ad96e8817b42164688', 'request_id': 'req-9d359f12-b441-45f8-b9a4-a6254b970ef5'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:16.601871 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:36:16.623768 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-9d359f12-b441-45f8-b9a4-a6254b970ef5 admin admin] The token cache is being invalidate because project 80133da5f71844ad96e8817b42164688 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81447) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:36:16.624156 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-9d359f12-b441-45f8-b9a4-a6254b970ef5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:16.625049 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-9d359f12-b441-45f8-b9a4-a6254b970ef5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:16.627004 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1305/2630] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:36:16 2022] DELETE /identity/v3/projects/80133da5f71844ad96e8817b42164688 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:36:16.638314 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7fadc-3fe9-4a93-ba45-ca7a4a5a550e None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:16.640686 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7fadc-3fe9-4a93-ba45-ca7a4a5a550e None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:16.641217 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7fadc-3fe9-4a93-ba45-ca7a4a5a550e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:16.669609 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-31f7fadc-3fe9-4a93-ba45-ca7a4a5a550e None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:36:16.671172 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-31f7fadc-3fe9-4a93-ba45-ca7a4a5a550e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:16.737521 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1326/2631] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:36:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:36:16.738055 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d359f12-b441-45f8-b9a4-a6254b970ef5 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:16.739605 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-9d359f12-b441-45f8-b9a4-a6254b970ef5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:16.748182 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6fa3c-2f1d-463b-8f10-dc51f49e8fdd None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:16.748533 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6fa3c-2f1d-463b-8f10-dc51f49e8fdd None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:16.748876 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6fa3c-2f1d-463b-8f10-dc51f49e8fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:16.768685 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-cbb6fa3c-2f1d-463b-8f10-dc51f49e8fdd None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:36:16.770049 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-cbb6fa3c-2f1d-463b-8f10-dc51f49e8fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:16.780295 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1327/2632] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:36:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:36:16.785321 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb6fa3c-2f1d-463b-8f10-dc51f49e8fdd None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:16.798232 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb6fa3c-2f1d-463b-8f10-dc51f49e8fdd None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:16.809400 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca41a2a1-360b-4873-963b-ef1abac6edc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:16.810018 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41a2a1-360b-4873-963b-ef1abac6edc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:16.810326 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41a2a1-360b-4873-963b-ef1abac6edc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:16.810613 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41a2a1-360b-4873-963b-ef1abac6edc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:16.811478 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca41a2a1-360b-4873-963b-ef1abac6edc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:36:16.811636 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca41a2a1-360b-4873-963b-ef1abac6edc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:16.813219 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca41a2a1-360b-4873-963b-ef1abac6edc0 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:16.826872 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1328/2633] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 30 01:36:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:36:16.830277 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca41a2a1-360b-4873-963b-ef1abac6edc0 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:16.831849 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-ca41a2a1-360b-4873-963b-ef1abac6edc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:16.831991 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d359f12-b441-45f8-b9a4-a6254b970ef5 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:16.837857 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4361677-58fe-4a81-aee5-010f2f0d7b3e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8dbb4742c3944b9ad389e9628b5a047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:16.838519 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4361677-58fe-4a81-aee5-010f2f0d7b3e service placement] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:16.838796 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4361677-58fe-4a81-aee5-010f2f0d7b3e service placement] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:16.839090 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4361677-58fe-4a81-aee5-010f2f0d7b3e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:16.840897 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-a4361677-58fe-4a81-aee5-010f2f0d7b3e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:16.845396 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca41a2a1-360b-4873-963b-ef1abac6edc0 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:16.850111 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73171c5e-853e-4310-9af5-5dcaac24811a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:16.850720 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73171c5e-853e-4310-9af5-5dcaac24811a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:16.850997 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73171c5e-853e-4310-9af5-5dcaac24811a admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:16.851269 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73171c5e-853e-4310-9af5-5dcaac24811a admin admin] PATH_INFO: `/v3/users/0648872a9f8648ca803418bc3a3b04b2` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:16.853407 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4361677-58fe-4a81-aee5-010f2f0d7b3e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:16.853533 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73171c5e-853e-4310-9af5-5dcaac24811a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0648872a9f8648ca803418bc3a3b04b2)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:16.854998 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4361677-58fe-4a81-aee5-010f2f0d7b3e service placement] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:16.855331 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73171c5e-853e-4310-9af5-5dcaac24811a admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:16.866045 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1306/2634] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:36:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:36:16.866886 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4361677-58fe-4a81-aee5-010f2f0d7b3e service placement] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:16.878174 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4361677-58fe-4a81-aee5-010f2f0d7b3e service placement] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:16.883316 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150fc981-43ec-460b-b518-cfe464f4e8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:16.884369 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150fc981-43ec-460b-b518-cfe464f4e8c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:16.884745 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150fc981-43ec-460b-b518-cfe464f4e8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:16.885023 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150fc981-43ec-460b-b518-cfe464f4e8c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:16.885664 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150fc981-43ec-460b-b518-cfe464f4e8c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:16.887826 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150fc981-43ec-460b-b518-cfe464f4e8c3 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:16.907231 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-73171c5e-853e-4310-9af5-5dcaac24811a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0648872a9f8648ca803418bc3a3b04b2'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:16.916259 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-73171c5e-853e-4310-9af5-5dcaac24811a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0648872a9f8648ca803418bc3a3b04b2'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:16.916899 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-73171c5e-853e-4310-9af5-5dcaac24811a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0648872a9f8648ca803418bc3a3b04b2'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:16.922828 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1307/2635] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:36:16 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:36:16.923979 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150fc981-43ec-460b-b518-cfe464f4e8c3 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:16.934212 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-73171c5e-853e-4310-9af5-5dcaac24811a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0648872a9f8648ca803418bc3a3b04b2'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:16.934984 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-73171c5e-853e-4310-9af5-5dcaac24811a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0648872a9f8648ca803418bc3a3b04b2'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:16.937505 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:36:16.951233 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1329/2636] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:36:16 2022] DELETE /identity/v3/users/0648872a9f8648ca803418bc3a3b04b2 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:36:16.991594 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150fc981-43ec-460b-b518-cfe464f4e8c3 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:17.053528 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2e9bbc-ea17-4031-b68d-72d2211b04fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:17.054155 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e9bbc-ea17-4031-b68d-72d2211b04fb admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:17.054439 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e9bbc-ea17-4031-b68d-72d2211b04fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:17.054718 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e9bbc-ea17-4031-b68d-72d2211b04fb admin admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:17.055475 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2e9bbc-ea17-4031-b68d-72d2211b04fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:17.057544 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2e9bbc-ea17-4031-b68d-72d2211b04fb admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:17.069998 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:36:17.082488 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1308/2637] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:36:16 2022] POST /identity/v3/users => generated 289 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:36:17.087171 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73171c5e-853e-4310-9af5-5dcaac24811a admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:17.088672 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-73171c5e-853e-4310-9af5-5dcaac24811a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:17.101853 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73171c5e-853e-4310-9af5-5dcaac24811a admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:17.106529 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0f6c59-1f36-4a55-9a6e-636268dc0fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:17.107131 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f6c59-1f36-4a55-9a6e-636268dc0fdc admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:17.107415 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f6c59-1f36-4a55-9a6e-636268dc0fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:17.107738 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f6c59-1f36-4a55-9a6e-636268dc0fdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:17.108386 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0f6c59-1f36-4a55-9a6e-636268dc0fdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:17.110077 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0f6c59-1f36-4a55-9a6e-636268dc0fdc admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:17.122517 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1330/2638] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:36:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:36:17.126489 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2e9bbc-ea17-4031-b68d-72d2211b04fb admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:17.136388 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0f6c59-1f36-4a55-9a6e-636268dc0fdc admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:17.140361 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-cb0f6c59-1f36-4a55-9a6e-636268dc0fdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:17.140738 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2e9bbc-ea17-4031-b68d-72d2211b04fb admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:17.145690 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1165a9-8d3f-450b-9650-75b1c25ac684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:17.146300 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1165a9-8d3f-450b-9650-75b1c25ac684 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:17.146579 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1165a9-8d3f-450b-9650-75b1c25ac684 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:17.146853 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1165a9-8d3f-450b-9650-75b1c25ac684 admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:17.147537 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1165a9-8d3f-450b-9650-75b1c25ac684 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:17.149706 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1165a9-8d3f-450b-9650-75b1c25ac684 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:17.157090 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0f6c59-1f36-4a55-9a6e-636268dc0fdc admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:17.162682 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aae84ee-6c77-4241-a288-2262698fb51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:17.162905 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1309/2639] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:36:17 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:36:17.163422 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae84ee-6c77-4241-a288-2262698fb51c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:17.164315 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae84ee-6c77-4241-a288-2262698fb51c admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:17.164594 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae84ee-6c77-4241-a288-2262698fb51c admin admin] PATH_INFO: `/v3/projects/c5387643d3e0464a820529df26a29cfc` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:17.166310 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aae84ee-6c77-4241-a288-2262698fb51c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5387643d3e0464a820529df26a29cfc)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:17.166763 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1165a9-8d3f-450b-9650-75b1c25ac684 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:17.168576 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aae84ee-6c77-4241-a288-2262698fb51c admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:17.180328 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1165a9-8d3f-450b-9650-75b1c25ac684 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:17.185251 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88323f45-ac04-413f-93d0-d45228c20ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:17.186222 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88323f45-ac04-413f-93d0-d45228c20ed6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:17.186708 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88323f45-ac04-413f-93d0-d45228c20ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:17.187175 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88323f45-ac04-413f-93d0-d45228c20ed6 admin admin] PATH_INFO: `/v3/projects/f87ee4b2bfc643d29da2bbbabe0ae07a/users/04e773a8e0f846039f98f267e8968b28/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:17.206061 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88323f45-ac04-413f-93d0-d45228c20ed6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f87ee4b2bfc643d29da2bbbabe0ae07a, user_id=04e773a8e0f846039f98f267e8968b28, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:17.211264 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88323f45-ac04-413f-93d0-d45228c20ed6 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:17.229067 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1310/2640] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:36:17 2022] PUT /identity/v3/projects/f87ee4b2bfc643d29da2bbbabe0ae07a/users/04e773a8e0f846039f98f267e8968b28/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:36:17.239096 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-2aae84ee-6c77-4241-a288-2262698fb51c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5387643d3e0464a820529df26a29cfc', 'request_id': 'req-2aae84ee-6c77-4241-a288-2262698fb51c'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:17.239890 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-2aae84ee-6c77-4241-a288-2262698fb51c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5387643d3e0464a820529df26a29cfc', 'request_id': 'req-2aae84ee-6c77-4241-a288-2262698fb51c'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:17.240483 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e1100-9a83-47ef-b911-3311bf47dc19 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:17.240797 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e1100-9a83-47ef-b911-3311bf47dc19 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:17.241073 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e1100-9a83-47ef-b911-3311bf47dc19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:17.249013 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-2aae84ee-6c77-4241-a288-2262698fb51c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5387643d3e0464a820529df26a29cfc', 'request_id': 'req-2aae84ee-6c77-4241-a288-2262698fb51c'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:17.263410 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-2aae84ee-6c77-4241-a288-2262698fb51c admin admin] The token cache is being invalidate because project c5387643d3e0464a820529df26a29cfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:36:17.265266 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-2aae84ee-6c77-4241-a288-2262698fb51c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:17.266222 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-2aae84ee-6c77-4241-a288-2262698fb51c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:17.270054 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1331/2641] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:36:17 2022] DELETE /identity/v3/projects/c5387643d3e0464a820529df26a29cfc => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:36:17.277804 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed055c6f-c34a-4149-a961-016c407414bf None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:17.278418 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed055c6f-c34a-4149-a961-016c407414bf None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:17.278946 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed055c6f-c34a-4149-a961-016c407414bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:17.281290 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-c69e1100-9a83-47ef-b911-3311bf47dc19 None None] MFA Rules not processed for user `04e773a8e0f846039f98f267e8968b28`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:36:17.283729 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-c69e1100-9a83-47ef-b911-3311bf47dc19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:17.311994 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-ed055c6f-c34a-4149-a961-016c407414bf None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:36:17.313347 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-ed055c6f-c34a-4149-a961-016c407414bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:17.373530 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1311/2642] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:36:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:36:17.381036 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1332/2643] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:36:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:36:17.390066 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f444dc-070c-42ab-9736-43f618ca0425 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:17.390313 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed055c6f-c34a-4149-a961-016c407414bf None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:17.390431 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f444dc-070c-42ab-9736-43f618ca0425 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:17.390673 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f444dc-070c-42ab-9736-43f618ca0425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:17.391862 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-ed055c6f-c34a-4149-a961-016c407414bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:17.410576 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-b1f444dc-070c-42ab-9736-43f618ca0425 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:36:17.411710 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-b1f444dc-070c-42ab-9736-43f618ca0425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:17.421857 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1312/2644] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:36:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:36:17.425095 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f444dc-070c-42ab-9736-43f618ca0425 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:17.437405 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f444dc-070c-42ab-9736-43f618ca0425 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:17.442145 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7ab39a-ffba-4878-8794-14b7abc1239b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:17.442740 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ab39a-ffba-4878-8794-14b7abc1239b admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:17.443013 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ab39a-ffba-4878-8794-14b7abc1239b admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:17.443284 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ab39a-ffba-4878-8794-14b7abc1239b admin admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:17.443974 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7ab39a-ffba-4878-8794-14b7abc1239b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:36:17.444273 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7ab39a-ffba-4878-8794-14b7abc1239b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:17.445913 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7ab39a-ffba-4878-8794-14b7abc1239b admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:17.452960 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed055c6f-c34a-4149-a961-016c407414bf None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:17.457004 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a2257-b7a9-411a-b0e8-982300dc5ade service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2de6decc90df4df58217d5eed9c5e190', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:17.457610 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a2257-b7a9-411a-b0e8-982300dc5ade service glance] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:17.457884 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a2257-b7a9-411a-b0e8-982300dc5ade service glance] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:17.458151 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a2257-b7a9-411a-b0e8-982300dc5ade service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:17.459590 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1313/2645] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 30 01:36:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 01:36:17.464636 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7ab39a-ffba-4878-8794-14b7abc1239b admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:17.472691 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5a2257-b7a9-411a-b0e8-982300dc5ade service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:17.474272 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5a2257-b7a9-411a-b0e8-982300dc5ade service glance] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:17.474558 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7ab39a-ffba-4878-8794-14b7abc1239b admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:17.479082 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d7ff73-ce96-4c64-9655-c78809a46f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:17.479695 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d7ff73-ce96-4c64-9655-c78809a46f44 admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:17.479972 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d7ff73-ce96-4c64-9655-c78809a46f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:17.480269 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d7ff73-ce96-4c64-9655-c78809a46f44 admin admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:17.480900 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d7ff73-ce96-4c64-9655-c78809a46f44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:17.482792 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d7ff73-ce96-4c64-9655-c78809a46f44 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:17.485252 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1333/2646] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:36:17 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:36:17.516782 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1314/2647] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:36:17 2022] POST /identity/v3/projects => generated 365 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:36:17.520484 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a2257-b7a9-411a-b0e8-982300dc5ade service glance] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:17.531648 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a2257-b7a9-411a-b0e8-982300dc5ade service glance] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:17.535590 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:36:17.596423 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c813f0-ce25-41de-8422-5444d11e7df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:17.597235 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c813f0-ce25-41de-8422-5444d11e7df9 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:17.597526 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c813f0-ce25-41de-8422-5444d11e7df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:17.597828 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c813f0-ce25-41de-8422-5444d11e7df9 admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:17.598471 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c813f0-ce25-41de-8422-5444d11e7df9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:17.600564 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c813f0-ce25-41de-8422-5444d11e7df9 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:17.624146 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1334/2648] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:36:17 2022] POST /identity/v3/users => generated 283 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:36:17.628320 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d7ff73-ce96-4c64-9655-c78809a46f44 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:17.638808 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d7ff73-ce96-4c64-9655-c78809a46f44 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:17.643391 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced0fa33-50d1-4a55-86b0-df9961b88416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:17.644010 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0fa33-50d1-4a55-86b0-df9961b88416 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:17.644287 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0fa33-50d1-4a55-86b0-df9961b88416 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:17.644557 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0fa33-50d1-4a55-86b0-df9961b88416 admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:17.645195 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced0fa33-50d1-4a55-86b0-df9961b88416 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:17.646789 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced0fa33-50d1-4a55-86b0-df9961b88416 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:17.659474 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1315/2649] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:36:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:36:17.662817 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c813f0-ce25-41de-8422-5444d11e7df9 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:17.674192 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c813f0-ce25-41de-8422-5444d11e7df9 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:17.679270 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831340b-2a65-45ef-ac2d-5f6ec440f1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:17.679910 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831340b-2a65-45ef-ac2d-5f6ec440f1e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:17.680193 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831340b-2a65-45ef-ac2d-5f6ec440f1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:17.681007 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831340b-2a65-45ef-ac2d-5f6ec440f1e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:17.681653 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c831340b-2a65-45ef-ac2d-5f6ec440f1e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:17.683270 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c831340b-2a65-45ef-ac2d-5f6ec440f1e9 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:17.694319 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1335/2650] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:36:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:36:17.699812 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced0fa33-50d1-4a55-86b0-df9961b88416 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:17.710764 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced0fa33-50d1-4a55-86b0-df9961b88416 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:17.715598 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f669b6-8830-4779-9b1d-f7b756c2d365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:17.716251 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f669b6-8830-4779-9b1d-f7b756c2d365 admin admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:17.716533 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f669b6-8830-4779-9b1d-f7b756c2d365 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:17.716808 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f669b6-8830-4779-9b1d-f7b756c2d365 admin admin] PATH_INFO: `/v3/projects/f80dbbf9e43c443f99441e026dde6083/users/58a51d6746fa4f5dae4329f8dc9e5946/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:17.735703 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f669b6-8830-4779-9b1d-f7b756c2d365 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f80dbbf9e43c443f99441e026dde6083, user_id=58a51d6746fa4f5dae4329f8dc9e5946, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:17.738386 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f669b6-8830-4779-9b1d-f7b756c2d365 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:17.753605 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1316/2651] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:36:17 2022] PUT /identity/v3/projects/f80dbbf9e43c443f99441e026dde6083/users/58a51d6746fa4f5dae4329f8dc9e5946/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:36:17.764669 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30878f-b113-4980-a18a-96c782380457 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:17.764967 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30878f-b113-4980-a18a-96c782380457 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:17.765247 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30878f-b113-4980-a18a-96c782380457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:17.796733 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-fc30878f-b113-4980-a18a-96c782380457 None None] MFA Rules not processed for user `58a51d6746fa4f5dae4329f8dc9e5946`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:36:17.797991 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-fc30878f-b113-4980-a18a-96c782380457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:17.881852 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1336/2652] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:36:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:36:17.897616 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f669b6-8830-4779-9b1d-f7b756c2d365 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:17.899403 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-70f669b6-8830-4779-9b1d-f7b756c2d365 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:17.954166 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:36:17.980707 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f669b6-8830-4779-9b1d-f7b756c2d365 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:17.985338 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d23a6-910f-4af5-a7ab-9611a0da598b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:17.986023 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d23a6-910f-4af5-a7ab-9611a0da598b service cinder] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:17.986368 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d23a6-910f-4af5-a7ab-9611a0da598b service cinder] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:17.986709 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d23a6-910f-4af5-a7ab-9611a0da598b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:17.998388 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83d23a6-910f-4af5-a7ab-9611a0da598b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:17.999900 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83d23a6-910f-4af5-a7ab-9611a0da598b service cinder] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:18.009351 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1317/2653] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:36:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:36:26.535229 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc30878f-b113-4980-a18a-96c782380457 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:26.601658 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc30878f-b113-4980-a18a-96c782380457 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:26.606368 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43472f41-1590-452b-b372-00552a59f013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:26.607005 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43472f41-1590-452b-b372-00552a59f013 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:26.607288 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43472f41-1590-452b-b372-00552a59f013 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:26.607594 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43472f41-1590-452b-b372-00552a59f013 admin admin] PATH_INFO: `/v3/users/58a51d6746fa4f5dae4329f8dc9e5946` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:26.608789 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43472f41-1590-452b-b372-00552a59f013 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58a51d6746fa4f5dae4329f8dc9e5946)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:26.610746 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43472f41-1590-452b-b372-00552a59f013 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:26.631476 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:36:26.667537 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-43472f41-1590-452b-b372-00552a59f013 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58a51d6746fa4f5dae4329f8dc9e5946'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:26.675227 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-43472f41-1590-452b-b372-00552a59f013 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58a51d6746fa4f5dae4329f8dc9e5946'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:26.675864 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-43472f41-1590-452b-b372-00552a59f013 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58a51d6746fa4f5dae4329f8dc9e5946'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:26.689564 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-43472f41-1590-452b-b372-00552a59f013 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58a51d6746fa4f5dae4329f8dc9e5946'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:26.690286 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-43472f41-1590-452b-b372-00552a59f013 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58a51d6746fa4f5dae4329f8dc9e5946'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:26.703309 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1337/2654] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:36:26 2022] DELETE /identity/v3/users/58a51d6746fa4f5dae4329f8dc9e5946 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:36:26.707786 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24878fc2-870d-43e1-a37b-bf1168ea07be None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:26.708284 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24878fc2-870d-43e1-a37b-bf1168ea07be None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:26.708408 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24878fc2-870d-43e1-a37b-bf1168ea07be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:26.728914 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-24878fc2-870d-43e1-a37b-bf1168ea07be None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:36:26.730347 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-24878fc2-870d-43e1-a37b-bf1168ea07be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:26.796566 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1318/2655] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:36:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:36:26.807795 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43472f41-1590-452b-b372-00552a59f013 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:26.809212 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-43472f41-1590-452b-b372-00552a59f013 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:26.868173 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43472f41-1590-452b-b372-00552a59f013 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:26.871814 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b8cbf5-1b32-4e10-829f-52a23499988f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:26.872455 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b8cbf5-1b32-4e10-829f-52a23499988f service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:26.872707 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b8cbf5-1b32-4e10-829f-52a23499988f service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:26.872979 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b8cbf5-1b32-4e10-829f-52a23499988f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:26.882810 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b8cbf5-1b32-4e10-829f-52a23499988f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:26.884336 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b8cbf5-1b32-4e10-829f-52a23499988f service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:26.895588 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1338/2656] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:36:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:36:27.184122 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24878fc2-870d-43e1-a37b-bf1168ea07be None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:27.185594 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-24878fc2-870d-43e1-a37b-bf1168ea07be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:27.205588 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24878fc2-870d-43e1-a37b-bf1168ea07be None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:27.211729 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21389b3-26c0-4c0c-b6e9-8b170e645b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:27.212319 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21389b3-26c0-4c0c-b6e9-8b170e645b53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:27.212593 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21389b3-26c0-4c0c-b6e9-8b170e645b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:27.212900 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21389b3-26c0-4c0c-b6e9-8b170e645b53 admin admin] PATH_INFO: `/v3/projects/f80dbbf9e43c443f99441e026dde6083` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:27.213998 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21389b3-26c0-4c0c-b6e9-8b170e645b53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f80dbbf9e43c443f99441e026dde6083)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:27.216010 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21389b3-26c0-4c0c-b6e9-8b170e645b53 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:27.270375 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-b21389b3-26c0-4c0c-b6e9-8b170e645b53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f80dbbf9e43c443f99441e026dde6083', 'request_id': 'req-b21389b3-26c0-4c0c-b6e9-8b170e645b53'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:27.276779 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-b21389b3-26c0-4c0c-b6e9-8b170e645b53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f80dbbf9e43c443f99441e026dde6083', 'request_id': 'req-b21389b3-26c0-4c0c-b6e9-8b170e645b53'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:27.284734 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-b21389b3-26c0-4c0c-b6e9-8b170e645b53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f80dbbf9e43c443f99441e026dde6083', 'request_id': 'req-b21389b3-26c0-4c0c-b6e9-8b170e645b53'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:27.296332 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-b21389b3-26c0-4c0c-b6e9-8b170e645b53 admin admin] The token cache is being invalidate because project f80dbbf9e43c443f99441e026dde6083 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81447) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:36:27.296624 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-b21389b3-26c0-4c0c-b6e9-8b170e645b53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:27.297283 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-b21389b3-26c0-4c0c-b6e9-8b170e645b53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:27.298771 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1319/2657] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:36:27 2022] DELETE /identity/v3/projects/f80dbbf9e43c443f99441e026dde6083 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:36:27.304109 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59781142-a0ef-4063-97d2-9c208115b5bb None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:27.304609 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59781142-a0ef-4063-97d2-9c208115b5bb None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:27.305503 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59781142-a0ef-4063-97d2-9c208115b5bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:27.327594 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-59781142-a0ef-4063-97d2-9c208115b5bb None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:36:27.328910 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-59781142-a0ef-4063-97d2-9c208115b5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:27.395272 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1339/2658] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:36:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:36:27.404150 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f79a6a-daed-4d37-8590-d979f9a783c2 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:27.404527 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f79a6a-daed-4d37-8590-d979f9a783c2 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:27.404807 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f79a6a-daed-4d37-8590-d979f9a783c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:27.425717 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-35f79a6a-daed-4d37-8590-d979f9a783c2 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:36:27.427051 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-35f79a6a-daed-4d37-8590-d979f9a783c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:27.435057 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1320/2659] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:36:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:36:27.439482 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59781142-a0ef-4063-97d2-9c208115b5bb None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:27.450499 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59781142-a0ef-4063-97d2-9c208115b5bb None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:27.455461 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a249df1-6b2c-4c7e-8482-e33ee58fdeba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:27.456077 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a249df1-6b2c-4c7e-8482-e33ee58fdeba admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:27.461098 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a249df1-6b2c-4c7e-8482-e33ee58fdeba admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:27.462058 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a249df1-6b2c-4c7e-8482-e33ee58fdeba admin admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:27.462649 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a249df1-6b2c-4c7e-8482-e33ee58fdeba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:36:27.462962 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a249df1-6b2c-4c7e-8482-e33ee58fdeba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:27.464740 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a249df1-6b2c-4c7e-8482-e33ee58fdeba admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:27.479131 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1340/2660] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 30 01:36:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:36:27.483595 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f79a6a-daed-4d37-8590-d979f9a783c2 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:27.496846 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f79a6a-daed-4d37-8590-d979f9a783c2 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:27.499197 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8821b15e-ed2c-4c31-ae05-1f1914bd6e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:27.499881 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821b15e-ed2c-4c31-ae05-1f1914bd6e46 admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:27.500160 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821b15e-ed2c-4c31-ae05-1f1914bd6e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:27.500426 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821b15e-ed2c-4c31-ae05-1f1914bd6e46 admin admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:27.501072 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8821b15e-ed2c-4c31-ae05-1f1914bd6e46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:27.502983 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8821b15e-ed2c-4c31-ae05-1f1914bd6e46 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:27.532456 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1321/2661] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:36:27 2022] POST /identity/v3/projects => generated 361 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:36:27.536518 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a249df1-6b2c-4c7e-8482-e33ee58fdeba admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:27.546621 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a249df1-6b2c-4c7e-8482-e33ee58fdeba admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:27.567374 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:36:27.614007 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fae5ee-38b5-4c06-9af5-8a2ca321c0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:27.614618 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fae5ee-38b5-4c06-9af5-8a2ca321c0dc admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:27.614899 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fae5ee-38b5-4c06-9af5-8a2ca321c0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:27.615171 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fae5ee-38b5-4c06-9af5-8a2ca321c0dc admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:27.615860 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fae5ee-38b5-4c06-9af5-8a2ca321c0dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:27.617913 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fae5ee-38b5-4c06-9af5-8a2ca321c0dc admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:27.643041 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1341/2662] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:36:27 2022] POST /identity/v3/users => generated 281 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:36:27.644923 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8821b15e-ed2c-4c31-ae05-1f1914bd6e46 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:27.656254 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8821b15e-ed2c-4c31-ae05-1f1914bd6e46 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:27.661146 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954bcb5c-7f53-4e93-8882-cdf83260d7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:27.661782 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954bcb5c-7f53-4e93-8882-cdf83260d7c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:27.662059 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954bcb5c-7f53-4e93-8882-cdf83260d7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:27.662518 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954bcb5c-7f53-4e93-8882-cdf83260d7c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:27.663170 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954bcb5c-7f53-4e93-8882-cdf83260d7c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:27.664843 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954bcb5c-7f53-4e93-8882-cdf83260d7c4 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:27.675891 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1322/2663] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:36:27.680111 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fae5ee-38b5-4c06-9af5-8a2ca321c0dc admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:27.690204 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fae5ee-38b5-4c06-9af5-8a2ca321c0dc admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:27.694989 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb7adcc-7dff-472a-b53b-36bf2c556739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:27.696234 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7adcc-7dff-472a-b53b-36bf2c556739 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:27.696522 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7adcc-7dff-472a-b53b-36bf2c556739 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:27.696793 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7adcc-7dff-472a-b53b-36bf2c556739 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:27.697447 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb7adcc-7dff-472a-b53b-36bf2c556739 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:27.699085 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb7adcc-7dff-472a-b53b-36bf2c556739 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:27.714788 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1342/2664] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:36:27.719422 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954bcb5c-7f53-4e93-8882-cdf83260d7c4 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:27.730435 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954bcb5c-7f53-4e93-8882-cdf83260d7c4 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:27.735178 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d921c-ae27-4a2b-b4fa-a3333e0cdfa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:27.735854 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d921c-ae27-4a2b-b4fa-a3333e0cdfa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:27.736138 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d921c-ae27-4a2b-b4fa-a3333e0cdfa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:27.736411 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d921c-ae27-4a2b-b4fa-a3333e0cdfa4 admin admin] PATH_INFO: `/v3/projects/4bb1323699ea4e19b0ba9c0239b194d7/users/b852f901143f428186ada94dc6025c2e/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:27.752171 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3d921c-ae27-4a2b-b4fa-a3333e0cdfa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bb1323699ea4e19b0ba9c0239b194d7, user_id=b852f901143f428186ada94dc6025c2e, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:27.755005 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3d921c-ae27-4a2b-b4fa-a3333e0cdfa4 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:27.761836 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:36:27.776799 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1323/2665] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:36:27 2022] PUT /identity/v3/projects/4bb1323699ea4e19b0ba9c0239b194d7/users/b852f901143f428186ada94dc6025c2e/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:36:27.788484 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4016cb1-caf0-4a03-af87-52f17ce91857 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:27.788814 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4016cb1-caf0-4a03-af87-52f17ce91857 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:27.789221 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4016cb1-caf0-4a03-af87-52f17ce91857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:27.819937 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-f4016cb1-caf0-4a03-af87-52f17ce91857 None None] MFA Rules not processed for user `b852f901143f428186ada94dc6025c2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:36:27.821158 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-f4016cb1-caf0-4a03-af87-52f17ce91857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:27.888624 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1343/2666] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:36:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:36:27.893394 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d921c-ae27-4a2b-b4fa-a3333e0cdfa4 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:27.955715 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d921c-ae27-4a2b-b4fa-a3333e0cdfa4 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:27.961137 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821afc67-ff0d-4840-9e4b-d635de6254e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:27.962401 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821afc67-ff0d-4840-9e4b-d635de6254e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:27.962682 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821afc67-ff0d-4840-9e4b-d635de6254e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:27.962951 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821afc67-ff0d-4840-9e4b-d635de6254e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:27.963868 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821afc67-ff0d-4840-9e4b-d635de6254e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:27.965963 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821afc67-ff0d-4840-9e4b-d635de6254e8 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:27.994729 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1324/2667] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:36:27 2022] POST /identity/v3/projects => generated 365 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:36:27.998807 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4016cb1-caf0-4a03-af87-52f17ce91857 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:28.009861 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4016cb1-caf0-4a03-af87-52f17ce91857 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:28.070545 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1cc1b9-faf3-412b-8c85-3691d2f39b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:28.071077 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1cc1b9-faf3-412b-8c85-3691d2f39b8f admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:28.071355 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1cc1b9-faf3-412b-8c85-3691d2f39b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:28.071658 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1cc1b9-faf3-412b-8c85-3691d2f39b8f admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:28.072304 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1cc1b9-faf3-412b-8c85-3691d2f39b8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:28.074249 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1cc1b9-faf3-412b-8c85-3691d2f39b8f admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:28.099666 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1344/2668] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:36:27 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:36:28.104778 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821afc67-ff0d-4840-9e4b-d635de6254e8 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:28.115829 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821afc67-ff0d-4840-9e4b-d635de6254e8 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:28.120561 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ffb5f-1f65-4448-844f-eefc46fe62e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:28.121171 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ffb5f-1f65-4448-844f-eefc46fe62e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:28.121452 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ffb5f-1f65-4448-844f-eefc46fe62e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:28.121726 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ffb5f-1f65-4448-844f-eefc46fe62e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:28.122372 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7ffb5f-1f65-4448-844f-eefc46fe62e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:28.124011 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7ffb5f-1f65-4448-844f-eefc46fe62e6 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:28.135834 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1325/2669] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:36:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:36:28.140980 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1cc1b9-faf3-412b-8c85-3691d2f39b8f admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:28.152679 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1cc1b9-faf3-412b-8c85-3691d2f39b8f admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:28.158098 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28cb55a-d380-487b-b253-33a0214842a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:28.158755 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28cb55a-d380-487b-b253-33a0214842a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:28.159165 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28cb55a-d380-487b-b253-33a0214842a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:28.159663 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28cb55a-d380-487b-b253-33a0214842a5 admin admin] PATH_INFO: `/v3/projects/9e5f22a2f49b4443a52fe07a96aa28cf/users/683dc2c039424776be379318d116bed6/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:28.176375 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28cb55a-d380-487b-b253-33a0214842a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e5f22a2f49b4443a52fe07a96aa28cf, user_id=683dc2c039424776be379318d116bed6, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:28.179164 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28cb55a-d380-487b-b253-33a0214842a5 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:28.187671 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:36:28.196074 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1345/2670] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:36:28 2022] PUT /identity/v3/projects/9e5f22a2f49b4443a52fe07a96aa28cf/users/683dc2c039424776be379318d116bed6/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:36:28.200269 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ffb5f-1f65-4448-844f-eefc46fe62e6 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:28.210727 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ffb5f-1f65-4448-844f-eefc46fe62e6 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:28.275570 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4190c30-395c-4c9f-8ec3-752b8d93540a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:28.276182 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4190c30-395c-4c9f-8ec3-752b8d93540a admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:28.276466 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4190c30-395c-4c9f-8ec3-752b8d93540a admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:28.276742 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4190c30-395c-4c9f-8ec3-752b8d93540a admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:28.277421 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4190c30-395c-4c9f-8ec3-752b8d93540a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:28.279107 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4190c30-395c-4c9f-8ec3-752b8d93540a admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:28.291403 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1326/2671] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:36:28 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:36:28.295754 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28cb55a-d380-487b-b253-33a0214842a5 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:28.308624 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28cb55a-d380-487b-b253-33a0214842a5 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:28.314189 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b3ff7b-6f69-4466-ac5a-075ffe6371ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:28.314985 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b3ff7b-6f69-4466-ac5a-075ffe6371ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:28.315248 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b3ff7b-6f69-4466-ac5a-075ffe6371ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:28.315678 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b3ff7b-6f69-4466-ac5a-075ffe6371ef admin admin] PATH_INFO: `/v3/projects/9e5f22a2f49b4443a52fe07a96aa28cf/users/683dc2c039424776be379318d116bed6/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:28.317403 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b3ff7b-6f69-4466-ac5a-075ffe6371ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e5f22a2f49b4443a52fe07a96aa28cf, user_id=683dc2c039424776be379318d116bed6, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:28.320300 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b3ff7b-6f69-4466-ac5a-075ffe6371ef admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:28.333661 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1346/2672] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:36:28 2022] PUT /identity/v3/projects/9e5f22a2f49b4443a52fe07a96aa28cf/users/683dc2c039424776be379318d116bed6/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:36:28.345346 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5113c9d-cb48-4284-9e0a-4d3c5bdd4d5f None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:28.345634 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5113c9d-cb48-4284-9e0a-4d3c5bdd4d5f None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:28.346178 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5113c9d-cb48-4284-9e0a-4d3c5bdd4d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:28.377108 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-f5113c9d-cb48-4284-9e0a-4d3c5bdd4d5f None None] MFA Rules not processed for user `683dc2c039424776be379318d116bed6`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:36:28.378353 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-f5113c9d-cb48-4284-9e0a-4d3c5bdd4d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:28.434124 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:36:28.457101 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1327/2673] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:36:28 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:36:28.470880 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b3ff7b-6f69-4466-ac5a-075ffe6371ef admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:28.473041 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-57b3ff7b-6f69-4466-ac5a-075ffe6371ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:28.546639 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b3ff7b-6f69-4466-ac5a-075ffe6371ef admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:28.550863 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c205c-8e47-43b9-b505-08e3dd919e0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:28.551514 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c205c-8e47-43b9-b505-08e3dd919e0f service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:28.551801 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c205c-8e47-43b9-b505-08e3dd919e0f service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:28.552079 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c205c-8e47-43b9-b505-08e3dd919e0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:28.563793 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c205c-8e47-43b9-b505-08e3dd919e0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:28.565483 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c205c-8e47-43b9-b505-08e3dd919e0f service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:28.576118 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1347/2674] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:36:28 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:36:28.662874 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5113c9d-cb48-4284-9e0a-4d3c5bdd4d5f None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:28.672729 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5113c9d-cb48-4284-9e0a-4d3c5bdd4d5f None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:28.676645 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b3b92-5188-4b34-89ee-ad8c4613ab05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:28.677271 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b3b92-5188-4b34-89ee-ad8c4613ab05 service cinder] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:28.677553 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b3b92-5188-4b34-89ee-ad8c4613ab05 service cinder] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:28.677823 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b3b92-5188-4b34-89ee-ad8c4613ab05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:28.739723 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397b3b92-5188-4b34-89ee-ad8c4613ab05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:28.741168 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397b3b92-5188-4b34-89ee-ad8c4613ab05 service cinder] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:28.750920 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1328/2675] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:36:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:36:31.510978 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c205c-8e47-43b9-b505-08e3dd919e0f service cinder] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:31.575418 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c205c-8e47-43b9-b505-08e3dd919e0f service cinder] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:31.579956 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad35d0ac-5494-44ff-a32a-cc12d13495dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:31.580578 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35d0ac-5494-44ff-a32a-cc12d13495dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:31.580854 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35d0ac-5494-44ff-a32a-cc12d13495dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:31.581123 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35d0ac-5494-44ff-a32a-cc12d13495dd admin admin] PATH_INFO: `/v3/users/b852f901143f428186ada94dc6025c2e` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:31.582256 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad35d0ac-5494-44ff-a32a-cc12d13495dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b852f901143f428186ada94dc6025c2e)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:31.584466 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad35d0ac-5494-44ff-a32a-cc12d13495dd admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:31.632446 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-ad35d0ac-5494-44ff-a32a-cc12d13495dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b852f901143f428186ada94dc6025c2e'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:31.642269 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-ad35d0ac-5494-44ff-a32a-cc12d13495dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b852f901143f428186ada94dc6025c2e'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:31.643844 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-ad35d0ac-5494-44ff-a32a-cc12d13495dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b852f901143f428186ada94dc6025c2e'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:31.661215 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-ad35d0ac-5494-44ff-a32a-cc12d13495dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b852f901143f428186ada94dc6025c2e'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:31.661905 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-ad35d0ac-5494-44ff-a32a-cc12d13495dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b852f901143f428186ada94dc6025c2e'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:31.678589 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1348/2676] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:36:31 2022] DELETE /identity/v3/users/b852f901143f428186ada94dc6025c2e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:36:31.688708 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998df9d-8467-4591-9e34-145c903eba4f None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:31.689655 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998df9d-8467-4591-9e34-145c903eba4f None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:31.690760 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998df9d-8467-4591-9e34-145c903eba4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:31.712917 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-3998df9d-8467-4591-9e34-145c903eba4f None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:36:31.714136 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-3998df9d-8467-4591-9e34-145c903eba4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:31.776170 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1329/2677] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:36:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:36:31.785993 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad35d0ac-5494-44ff-a32a-cc12d13495dd admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:31.787726 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-ad35d0ac-5494-44ff-a32a-cc12d13495dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:31.798084 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:36:31.849151 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad35d0ac-5494-44ff-a32a-cc12d13495dd admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:31.852832 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130aaabd-d8d5-4697-9751-c479380d111c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:31.853434 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130aaabd-d8d5-4697-9751-c479380d111c service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:31.853714 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130aaabd-d8d5-4697-9751-c479380d111c service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:31.853993 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130aaabd-d8d5-4697-9751-c479380d111c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:31.863067 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130aaabd-d8d5-4697-9751-c479380d111c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:31.864543 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130aaabd-d8d5-4697-9751-c479380d111c service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:31.874734 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1349/2678] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:36:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:36:32.151526 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3998df9d-8467-4591-9e34-145c903eba4f None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:32.152941 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-3998df9d-8467-4591-9e34-145c903eba4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:32.165247 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3998df9d-8467-4591-9e34-145c903eba4f None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:32.170179 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec11619a-7899-44f5-b3d8-fbb568f64e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:32.171719 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11619a-7899-44f5-b3d8-fbb568f64e63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:32.171719 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11619a-7899-44f5-b3d8-fbb568f64e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:32.171719 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11619a-7899-44f5-b3d8-fbb568f64e63 admin admin] PATH_INFO: `/v3/projects/4bb1323699ea4e19b0ba9c0239b194d7` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:32.172667 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec11619a-7899-44f5-b3d8-fbb568f64e63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bb1323699ea4e19b0ba9c0239b194d7)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:32.174627 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec11619a-7899-44f5-b3d8-fbb568f64e63 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:32.224589 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-ec11619a-7899-44f5-b3d8-fbb568f64e63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bb1323699ea4e19b0ba9c0239b194d7', 'request_id': 'req-ec11619a-7899-44f5-b3d8-fbb568f64e63'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:32.231596 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-ec11619a-7899-44f5-b3d8-fbb568f64e63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bb1323699ea4e19b0ba9c0239b194d7', 'request_id': 'req-ec11619a-7899-44f5-b3d8-fbb568f64e63'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:32.239452 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-ec11619a-7899-44f5-b3d8-fbb568f64e63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bb1323699ea4e19b0ba9c0239b194d7', 'request_id': 'req-ec11619a-7899-44f5-b3d8-fbb568f64e63'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:32.250257 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-ec11619a-7899-44f5-b3d8-fbb568f64e63 admin admin] The token cache is being invalidate because project 4bb1323699ea4e19b0ba9c0239b194d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81447) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:36:32.250538 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-ec11619a-7899-44f5-b3d8-fbb568f64e63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:32.251174 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-ec11619a-7899-44f5-b3d8-fbb568f64e63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:32.252641 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1330/2679] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:36:32 2022] DELETE /identity/v3/projects/4bb1323699ea4e19b0ba9c0239b194d7 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:36:32.256614 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130aaabd-d8d5-4697-9751-c479380d111c service neutron] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:32.266492 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130aaabd-d8d5-4697-9751-c479380d111c service neutron] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:32.323806 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ec548-02eb-4d07-8713-6fc6296273fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:32.324435 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ec548-02eb-4d07-8713-6fc6296273fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:32.324715 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ec548-02eb-4d07-8713-6fc6296273fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:32.324987 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ec548-02eb-4d07-8713-6fc6296273fb admin admin] PATH_INFO: `/v3/users/683dc2c039424776be379318d116bed6` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:32.326113 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22ec548-02eb-4d07-8713-6fc6296273fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=683dc2c039424776be379318d116bed6)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:32.328091 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22ec548-02eb-4d07-8713-6fc6296273fb admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:32.378317 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-f22ec548-02eb-4d07-8713-6fc6296273fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '683dc2c039424776be379318d116bed6'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:32.385017 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-f22ec548-02eb-4d07-8713-6fc6296273fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '683dc2c039424776be379318d116bed6'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:32.385645 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-f22ec548-02eb-4d07-8713-6fc6296273fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '683dc2c039424776be379318d116bed6'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:32.397801 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-f22ec548-02eb-4d07-8713-6fc6296273fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '683dc2c039424776be379318d116bed6'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:32.398439 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-f22ec548-02eb-4d07-8713-6fc6296273fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '683dc2c039424776be379318d116bed6'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:32.412261 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1350/2680] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:36:32 2022] DELETE /identity/v3/users/683dc2c039424776be379318d116bed6 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:36:32.689148 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec11619a-7899-44f5-b3d8-fbb568f64e63 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:32.690917 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-ec11619a-7899-44f5-b3d8-fbb568f64e63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:32.707352 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec11619a-7899-44f5-b3d8-fbb568f64e63 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:32.719169 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:36:32.771714 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56fd25c-461c-469d-a4ff-32e0e001e62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:32.772273 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56fd25c-461c-469d-a4ff-32e0e001e62a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:32.772578 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56fd25c-461c-469d-a4ff-32e0e001e62a admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:32.772841 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56fd25c-461c-469d-a4ff-32e0e001e62a admin admin] PATH_INFO: `/v3/projects/9e5f22a2f49b4443a52fe07a96aa28cf` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:32.774534 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56fd25c-461c-469d-a4ff-32e0e001e62a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e5f22a2f49b4443a52fe07a96aa28cf)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:32.776480 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56fd25c-461c-469d-a4ff-32e0e001e62a admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:32.826925 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-b56fd25c-461c-469d-a4ff-32e0e001e62a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e5f22a2f49b4443a52fe07a96aa28cf', 'request_id': 'req-b56fd25c-461c-469d-a4ff-32e0e001e62a'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:32.833471 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-b56fd25c-461c-469d-a4ff-32e0e001e62a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e5f22a2f49b4443a52fe07a96aa28cf', 'request_id': 'req-b56fd25c-461c-469d-a4ff-32e0e001e62a'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:32.842599 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-b56fd25c-461c-469d-a4ff-32e0e001e62a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e5f22a2f49b4443a52fe07a96aa28cf', 'request_id': 'req-b56fd25c-461c-469d-a4ff-32e0e001e62a'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:32.854269 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-b56fd25c-461c-469d-a4ff-32e0e001e62a admin admin] The token cache is being invalidate because project 9e5f22a2f49b4443a52fe07a96aa28cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81447) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:36:32.854787 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-b56fd25c-461c-469d-a4ff-32e0e001e62a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:32.855323 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-b56fd25c-461c-469d-a4ff-32e0e001e62a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:32.856921 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1331/2681] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:36:32 2022] DELETE /identity/v3/projects/9e5f22a2f49b4443a52fe07a96aa28cf => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:36:32.862031 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f9805-ec80-47ec-982b-f94821a6dfde None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:32.862552 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f9805-ec80-47ec-982b-f94821a6dfde None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:32.862552 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f9805-ec80-47ec-982b-f94821a6dfde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:32.886803 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-f96f9805-ec80-47ec-982b-f94821a6dfde None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:36:32.888156 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-f96f9805-ec80-47ec-982b-f94821a6dfde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:32.914735 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:36:32.953253 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1351/2682] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:36:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:36:32.963242 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c027908a-a7de-4740-8194-db1bd4656df7 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:32.963558 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c027908a-a7de-4740-8194-db1bd4656df7 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:32.963823 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c027908a-a7de-4740-8194-db1bd4656df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:32.984582 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-c027908a-a7de-4740-8194-db1bd4656df7 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:36:32.985805 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-c027908a-a7de-4740-8194-db1bd4656df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:32.993841 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1332/2683] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:36:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:36:32.998153 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f9805-ec80-47ec-982b-f94821a6dfde None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:33.008358 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f9805-ec80-47ec-982b-f94821a6dfde None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:33.013582 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e1e3e-e531-42ec-b9e6-66ab72b56c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:33.014292 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e1e3e-e531-42ec-b9e6-66ab72b56c85 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:33.014639 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e1e3e-e531-42ec-b9e6-66ab72b56c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:33.014981 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e1e3e-e531-42ec-b9e6-66ab72b56c85 admin admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:33.015737 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e1e3e-e531-42ec-b9e6-66ab72b56c85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:36:33.016104 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e1e3e-e531-42ec-b9e6-66ab72b56c85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:33.017980 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e1e3e-e531-42ec-b9e6-66ab72b56c85 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:33.032603 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1352/2684] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 30 01:36:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:36:33.037255 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c027908a-a7de-4740-8194-db1bd4656df7 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:33.046788 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c027908a-a7de-4740-8194-db1bd4656df7 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:33.051381 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1b902a-0e35-4875-bbad-2e88215905f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:33.052139 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b902a-0e35-4875-bbad-2e88215905f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:33.052427 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b902a-0e35-4875-bbad-2e88215905f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:33.052718 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b902a-0e35-4875-bbad-2e88215905f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:33.053353 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1b902a-0e35-4875-bbad-2e88215905f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:33.055820 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1b902a-0e35-4875-bbad-2e88215905f0 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:33.087472 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1333/2685] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:36:33 2022] POST /identity/v3/projects => generated 367 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:36:33.091492 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e1e3e-e531-42ec-b9e6-66ab72b56c85 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:33.101875 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e1e3e-e531-42ec-b9e6-66ab72b56c85 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:33.165975 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4dfc48-bfb7-4eea-9988-2cb0a6326375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:33.166590 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4dfc48-bfb7-4eea-9988-2cb0a6326375 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:33.166887 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4dfc48-bfb7-4eea-9988-2cb0a6326375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:33.167146 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4dfc48-bfb7-4eea-9988-2cb0a6326375 admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:33.167836 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4dfc48-bfb7-4eea-9988-2cb0a6326375 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:33.169774 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4dfc48-bfb7-4eea-9988-2cb0a6326375 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:33.194351 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1353/2686] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:36:33 2022] POST /identity/v3/users => generated 284 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:36:33.199089 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1b902a-0e35-4875-bbad-2e88215905f0 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:33.209602 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1b902a-0e35-4875-bbad-2e88215905f0 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:33.214627 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc4adb-3e31-49ea-854b-fbca70529f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:33.215249 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc4adb-3e31-49ea-854b-fbca70529f90 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:33.215612 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc4adb-3e31-49ea-854b-fbca70529f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:33.215885 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc4adb-3e31-49ea-854b-fbca70529f90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:33.216542 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fc4adb-3e31-49ea-854b-fbca70529f90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:33.218169 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fc4adb-3e31-49ea-854b-fbca70529f90 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:33.230932 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1334/2687] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:36:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:36:33.237833 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4dfc48-bfb7-4eea-9988-2cb0a6326375 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:33.248464 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4dfc48-bfb7-4eea-9988-2cb0a6326375 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:33.253204 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1733737-8b1f-47ef-b110-9575ac411bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:33.253872 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1733737-8b1f-47ef-b110-9575ac411bda admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:33.254098 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1733737-8b1f-47ef-b110-9575ac411bda admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:33.254384 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1733737-8b1f-47ef-b110-9575ac411bda admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:33.255002 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1733737-8b1f-47ef-b110-9575ac411bda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:33.256670 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1733737-8b1f-47ef-b110-9575ac411bda admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:33.274728 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1354/2688] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:36:33 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:36:33.279664 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc4adb-3e31-49ea-854b-fbca70529f90 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:33.289681 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc4adb-3e31-49ea-854b-fbca70529f90 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:33.295245 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3646173e-0d28-4b71-991a-f38fd86627c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:33.296068 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3646173e-0d28-4b71-991a-f38fd86627c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:33.296546 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3646173e-0d28-4b71-991a-f38fd86627c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:33.296908 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3646173e-0d28-4b71-991a-f38fd86627c9 admin admin] PATH_INFO: `/v3/projects/fa79bf464b29432e809c227cbc5df57d/users/ffbbe731312e44cc9f3eb3f9c46b0ba7/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:33.314129 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3646173e-0d28-4b71-991a-f38fd86627c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa79bf464b29432e809c227cbc5df57d, user_id=ffbbe731312e44cc9f3eb3f9c46b0ba7, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:33.316993 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3646173e-0d28-4b71-991a-f38fd86627c9 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:33.331351 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1335/2689] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:36:33 2022] PUT /identity/v3/projects/fa79bf464b29432e809c227cbc5df57d/users/ffbbe731312e44cc9f3eb3f9c46b0ba7/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:36:33.342918 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8e248-33ad-41ef-9bed-6e9a28b0e24b None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:33.343688 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8e248-33ad-41ef-9bed-6e9a28b0e24b None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:33.343974 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8e248-33ad-41ef-9bed-6e9a28b0e24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:33.372346 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-08e8e248-33ad-41ef-9bed-6e9a28b0e24b None None] MFA Rules not processed for user `ffbbe731312e44cc9f3eb3f9c46b0ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:36:33.373585 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-08e8e248-33ad-41ef-9bed-6e9a28b0e24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:33.443792 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1355/2690] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:36:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:36:33.449464 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3646173e-0d28-4b71-991a-f38fd86627c9 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:33.494120 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:36:33.514619 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3646173e-0d28-4b71-991a-f38fd86627c9 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:33.519221 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51653903-efb8-4fe6-a7cd-9b913761ee63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:33.519865 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51653903-efb8-4fe6-a7cd-9b913761ee63 admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:33.520145 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51653903-efb8-4fe6-a7cd-9b913761ee63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:33.520414 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51653903-efb8-4fe6-a7cd-9b913761ee63 admin admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:33.521056 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51653903-efb8-4fe6-a7cd-9b913761ee63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:33.522942 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51653903-efb8-4fe6-a7cd-9b913761ee63 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:33.554078 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1336/2691] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:36:33 2022] POST /identity/v3/projects => generated 369 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:36:33.555875 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e8e248-33ad-41ef-9bed-6e9a28b0e24b None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:33.566571 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e8e248-33ad-41ef-9bed-6e9a28b0e24b None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:33.590529 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:36:33.629569 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ebe09-e94c-4e07-9609-0d5fb82ec7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:33.630185 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ebe09-e94c-4e07-9609-0d5fb82ec7d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:33.630527 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ebe09-e94c-4e07-9609-0d5fb82ec7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:33.630772 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ebe09-e94c-4e07-9609-0d5fb82ec7d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:33.631411 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91ebe09-e94c-4e07-9609-0d5fb82ec7d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:33.633913 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91ebe09-e94c-4e07-9609-0d5fb82ec7d0 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:33.655229 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1356/2692] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:36:33 2022] POST /identity/v3/users => generated 291 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:36:33.659391 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51653903-efb8-4fe6-a7cd-9b913761ee63 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:33.669870 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51653903-efb8-4fe6-a7cd-9b913761ee63 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:33.674578 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef7392c-0e57-40f4-ad28-b43f05cb0693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:33.675177 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef7392c-0e57-40f4-ad28-b43f05cb0693 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:33.675485 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef7392c-0e57-40f4-ad28-b43f05cb0693 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:33.675764 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef7392c-0e57-40f4-ad28-b43f05cb0693 admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:33.676408 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef7392c-0e57-40f4-ad28-b43f05cb0693 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:33.678020 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef7392c-0e57-40f4-ad28-b43f05cb0693 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:33.688893 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1337/2693] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:36:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:36:33.693114 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ebe09-e94c-4e07-9609-0d5fb82ec7d0 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:33.703732 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ebe09-e94c-4e07-9609-0d5fb82ec7d0 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:33.708440 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e040a-cae4-49d3-9b88-b0c39ea2f231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:33.709089 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e040a-cae4-49d3-9b88-b0c39ea2f231 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:33.709633 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e040a-cae4-49d3-9b88-b0c39ea2f231 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:33.709907 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e040a-cae4-49d3-9b88-b0c39ea2f231 admin admin] PATH_INFO: `/v3/projects/28e8821d004d4446b80cde3e89ef99cd/users/2ba83dcbe2d3419a84efafd59ed3310c/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:33.725728 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575e040a-cae4-49d3-9b88-b0c39ea2f231 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28e8821d004d4446b80cde3e89ef99cd, user_id=2ba83dcbe2d3419a84efafd59ed3310c, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:33.728522 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575e040a-cae4-49d3-9b88-b0c39ea2f231 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:33.742568 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1357/2694] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:36:33 2022] PUT /identity/v3/projects/28e8821d004d4446b80cde3e89ef99cd/users/2ba83dcbe2d3419a84efafd59ed3310c/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:36:33.746585 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef7392c-0e57-40f4-ad28-b43f05cb0693 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:33.756643 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef7392c-0e57-40f4-ad28-b43f05cb0693 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:33.813401 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a16990-3b8d-4386-85f3-de3c9761f37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:33.813927 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a16990-3b8d-4386-85f3-de3c9761f37a admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:33.814206 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a16990-3b8d-4386-85f3-de3c9761f37a admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:33.814479 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a16990-3b8d-4386-85f3-de3c9761f37a admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:33.815145 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a16990-3b8d-4386-85f3-de3c9761f37a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:33.816844 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a16990-3b8d-4386-85f3-de3c9761f37a admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:33.827407 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1338/2695] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:36:33 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:36:33.831775 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e040a-cae4-49d3-9b88-b0c39ea2f231 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:33.842434 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e040a-cae4-49d3-9b88-b0c39ea2f231 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:33.847225 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d009c-f840-49a7-9970-9157c8bc2f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:33.847905 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d009c-f840-49a7-9970-9157c8bc2f99 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:33.848185 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d009c-f840-49a7-9970-9157c8bc2f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:33.848455 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d009c-f840-49a7-9970-9157c8bc2f99 admin admin] PATH_INFO: `/v3/projects/28e8821d004d4446b80cde3e89ef99cd/users/2ba83dcbe2d3419a84efafd59ed3310c/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:33.850398 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d009c-f840-49a7-9970-9157c8bc2f99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28e8821d004d4446b80cde3e89ef99cd, user_id=2ba83dcbe2d3419a84efafd59ed3310c, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:33.853157 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d009c-f840-49a7-9970-9157c8bc2f99 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:33.864233 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1358/2696] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:36:33 2022] PUT /identity/v3/projects/28e8821d004d4446b80cde3e89ef99cd/users/2ba83dcbe2d3419a84efafd59ed3310c/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:36:33.874860 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759671a7-b46c-4dff-bcc1-a338470bd3b0 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:33.875150 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759671a7-b46c-4dff-bcc1-a338470bd3b0 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:33.875482 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759671a7-b46c-4dff-bcc1-a338470bd3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:33.904719 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-759671a7-b46c-4dff-bcc1-a338470bd3b0 None None] MFA Rules not processed for user `2ba83dcbe2d3419a84efafd59ed3310c`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:36:33.905940 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-759671a7-b46c-4dff-bcc1-a338470bd3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:33.977942 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1339/2697] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:36:33 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:36:33.988981 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d009c-f840-49a7-9970-9157c8bc2f99 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:33.990782 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-806d009c-f840-49a7-9970-9157c8bc2f99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:34.053359 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d009c-f840-49a7-9970-9157c8bc2f99 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:34.057512 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda3c523-6bf2-4ac7-82e4-7cda67a49488 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:34.058115 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3c523-6bf2-4ac7-82e4-7cda67a49488 service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:34.058526 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3c523-6bf2-4ac7-82e4-7cda67a49488 service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:34.058754 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3c523-6bf2-4ac7-82e4-7cda67a49488 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:34.067964 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda3c523-6bf2-4ac7-82e4-7cda67a49488 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:34.069333 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda3c523-6bf2-4ac7-82e4-7cda67a49488 service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:34.080467 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1359/2698] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:36:33 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:36:34.215644 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759671a7-b46c-4dff-bcc1-a338470bd3b0 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:34.217231 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-759671a7-b46c-4dff-bcc1-a338470bd3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:34.263570 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:36:34.289759 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759671a7-b46c-4dff-bcc1-a338470bd3b0 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:34.295067 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d83758a-6e2c-4df7-b775-9662b9a648ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:34.295746 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83758a-6e2c-4df7-b775-9662b9a648ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:34.296022 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83758a-6e2c-4df7-b775-9662b9a648ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:34.296287 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83758a-6e2c-4df7-b775-9662b9a648ac admin admin] PATH_INFO: `/v3/users/04e773a8e0f846039f98f267e8968b28` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:34.297395 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d83758a-6e2c-4df7-b775-9662b9a648ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=04e773a8e0f846039f98f267e8968b28)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:34.299369 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d83758a-6e2c-4df7-b775-9662b9a648ac admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:34.352593 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-5d83758a-6e2c-4df7-b775-9662b9a648ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04e773a8e0f846039f98f267e8968b28'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:34.360490 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-5d83758a-6e2c-4df7-b775-9662b9a648ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04e773a8e0f846039f98f267e8968b28'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:34.361126 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-5d83758a-6e2c-4df7-b775-9662b9a648ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04e773a8e0f846039f98f267e8968b28'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:34.361761 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-5d83758a-6e2c-4df7-b775-9662b9a648ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04e773a8e0f846039f98f267e8968b28'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:34.375797 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-5d83758a-6e2c-4df7-b775-9662b9a648ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04e773a8e0f846039f98f267e8968b28'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:34.393464 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1340/2699] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:36:34 2022] DELETE /identity/v3/users/04e773a8e0f846039f98f267e8968b28 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:36:34.398009 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e15769-89ee-4b70-bd6d-7f7479a44d5e None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:34.398299 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e15769-89ee-4b70-bd6d-7f7479a44d5e None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:34.398610 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e15769-89ee-4b70-bd6d-7f7479a44d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:34.420318 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-e6e15769-89ee-4b70-bd6d-7f7479a44d5e None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:36:34.421749 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-e6e15769-89ee-4b70-bd6d-7f7479a44d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:34.490913 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1360/2700] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:36:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:36:34.501696 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d83758a-6e2c-4df7-b775-9662b9a648ac admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:34.503276 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-5d83758a-6e2c-4df7-b775-9662b9a648ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:34.573427 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d83758a-6e2c-4df7-b775-9662b9a648ac admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:34.578097 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e84cef0-9848-4fca-9ead-1134b02bd4a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:34.578904 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84cef0-9848-4fca-9ead-1134b02bd4a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:34.579223 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84cef0-9848-4fca-9ead-1134b02bd4a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:34.579608 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84cef0-9848-4fca-9ead-1134b02bd4a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:34.598217 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e84cef0-9848-4fca-9ead-1134b02bd4a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:34.599789 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e84cef0-9848-4fca-9ead-1134b02bd4a1 service neutron] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:34.617570 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1341/2701] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:36:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:36:34.959914 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e15769-89ee-4b70-bd6d-7f7479a44d5e None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:34.961876 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-e6e15769-89ee-4b70-bd6d-7f7479a44d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:34.975465 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e15769-89ee-4b70-bd6d-7f7479a44d5e None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:34.981210 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5ddaa7-7fdd-4c83-9b48-3518fced85fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:34.981874 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ddaa7-7fdd-4c83-9b48-3518fced85fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:34.982157 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ddaa7-7fdd-4c83-9b48-3518fced85fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:34.982436 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ddaa7-7fdd-4c83-9b48-3518fced85fd admin admin] PATH_INFO: `/v3/projects/f87ee4b2bfc643d29da2bbbabe0ae07a` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:34.983635 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5ddaa7-7fdd-4c83-9b48-3518fced85fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=f87ee4b2bfc643d29da2bbbabe0ae07a)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:34.986609 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5ddaa7-7fdd-4c83-9b48-3518fced85fd admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:35.007140 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:36:35.047476 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-ce5ddaa7-7fdd-4c83-9b48-3518fced85fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f87ee4b2bfc643d29da2bbbabe0ae07a', 'request_id': 'req-ce5ddaa7-7fdd-4c83-9b48-3518fced85fd'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:35.056264 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-ce5ddaa7-7fdd-4c83-9b48-3518fced85fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f87ee4b2bfc643d29da2bbbabe0ae07a', 'request_id': 'req-ce5ddaa7-7fdd-4c83-9b48-3518fced85fd'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:35.065318 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-ce5ddaa7-7fdd-4c83-9b48-3518fced85fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f87ee4b2bfc643d29da2bbbabe0ae07a', 'request_id': 'req-ce5ddaa7-7fdd-4c83-9b48-3518fced85fd'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:35.076258 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-ce5ddaa7-7fdd-4c83-9b48-3518fced85fd admin admin] The token cache is being invalidate because project f87ee4b2bfc643d29da2bbbabe0ae07a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:36:35.076546 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-ce5ddaa7-7fdd-4c83-9b48-3518fced85fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:35.077196 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-ce5ddaa7-7fdd-4c83-9b48-3518fced85fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:35.078650 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1361/2702] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:36:34 2022] DELETE /identity/v3/projects/f87ee4b2bfc643d29da2bbbabe0ae07a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:36:35.087668 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a94ecab-648f-4831-a7c5-0f1628eb1c56 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:35.087668 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a94ecab-648f-4831-a7c5-0f1628eb1c56 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:35.087668 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a94ecab-648f-4831-a7c5-0f1628eb1c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:35.108799 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-4a94ecab-648f-4831-a7c5-0f1628eb1c56 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:36:35.110109 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-4a94ecab-648f-4831-a7c5-0f1628eb1c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:35.169635 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:36:35.187586 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1342/2703] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:36:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:36:35.195226 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d2d29-84fe-4b5a-bd4a-ba8519375583 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:35.195789 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d2d29-84fe-4b5a-bd4a-ba8519375583 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:35.195913 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d2d29-84fe-4b5a-bd4a-ba8519375583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:35.217099 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-104d2d29-84fe-4b5a-bd4a-ba8519375583 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:36:35.218328 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-104d2d29-84fe-4b5a-bd4a-ba8519375583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:35.228032 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1362/2704] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:36:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:36:35.232139 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a94ecab-648f-4831-a7c5-0f1628eb1c56 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:35.248339 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a94ecab-648f-4831-a7c5-0f1628eb1c56 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:35.253962 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf41dd0-9bc5-4a37-8142-e0f73889b73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:35.254657 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf41dd0-9bc5-4a37-8142-e0f73889b73c admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:35.254853 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf41dd0-9bc5-4a37-8142-e0f73889b73c admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:35.255146 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf41dd0-9bc5-4a37-8142-e0f73889b73c admin admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:35.255845 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf41dd0-9bc5-4a37-8142-e0f73889b73c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:36:35.256179 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf41dd0-9bc5-4a37-8142-e0f73889b73c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:35.257828 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf41dd0-9bc5-4a37-8142-e0f73889b73c admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:35.272825 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1343/2705] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 30 01:36:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:36:35.277177 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104d2d29-84fe-4b5a-bd4a-ba8519375583 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:35.291549 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104d2d29-84fe-4b5a-bd4a-ba8519375583 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:35.297961 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59680f04-94ed-49ac-9cbe-8f977d7c5353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:35.298598 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59680f04-94ed-49ac-9cbe-8f977d7c5353 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:35.299159 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59680f04-94ed-49ac-9cbe-8f977d7c5353 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:35.299423 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59680f04-94ed-49ac-9cbe-8f977d7c5353 admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:35.300758 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59680f04-94ed-49ac-9cbe-8f977d7c5353 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:35.302691 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59680f04-94ed-49ac-9cbe-8f977d7c5353 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:35.339895 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1363/2706] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:36:35 2022] POST /identity/v3/projects => generated 371 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:36:35.341769 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf41dd0-9bc5-4a37-8142-e0f73889b73c admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:35.358519 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf41dd0-9bc5-4a37-8142-e0f73889b73c admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:35.427035 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1a0127-0e15-4684-bdd0-d732d9093b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:35.427694 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a0127-0e15-4684-bdd0-d732d9093b95 admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:35.428975 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a0127-0e15-4684-bdd0-d732d9093b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:35.429413 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a0127-0e15-4684-bdd0-d732d9093b95 admin admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:35.430191 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1a0127-0e15-4684-bdd0-d732d9093b95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:35.432337 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1a0127-0e15-4684-bdd0-d732d9093b95 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:35.467945 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1344/2707] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:36:35 2022] POST /identity/v3/users => generated 286 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:36:35.469748 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59680f04-94ed-49ac-9cbe-8f977d7c5353 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:35.486638 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59680f04-94ed-49ac-9cbe-8f977d7c5353 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:35.492342 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1bf91a-a203-493e-8ff8-172f54eeac32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:35.493120 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1bf91a-a203-493e-8ff8-172f54eeac32 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:35.493497 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1bf91a-a203-493e-8ff8-172f54eeac32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:35.493839 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1bf91a-a203-493e-8ff8-172f54eeac32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:35.494577 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1bf91a-a203-493e-8ff8-172f54eeac32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:35.496330 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1bf91a-a203-493e-8ff8-172f54eeac32 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:35.516420 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1364/2708] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:36:35 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:36:35.520885 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1a0127-0e15-4684-bdd0-d732d9093b95 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:35.534489 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1a0127-0e15-4684-bdd0-d732d9093b95 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:35.540772 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc2063a-a26c-4f4e-9b5a-cec11ce44f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:35.541533 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2063a-a26c-4f4e-9b5a-cec11ce44f78 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:35.541909 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2063a-a26c-4f4e-9b5a-cec11ce44f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:35.542285 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2063a-a26c-4f4e-9b5a-cec11ce44f78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:35.543271 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc2063a-a26c-4f4e-9b5a-cec11ce44f78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:35.545229 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc2063a-a26c-4f4e-9b5a-cec11ce44f78 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:35.558558 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1345/2709] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:36:35 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:36:35.562949 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1bf91a-a203-493e-8ff8-172f54eeac32 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:35.575642 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1bf91a-a203-493e-8ff8-172f54eeac32 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:35.580919 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b05c767-212e-48e2-a9a6-d01a10474692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:35.581641 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b05c767-212e-48e2-a9a6-d01a10474692 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:35.582204 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b05c767-212e-48e2-a9a6-d01a10474692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:35.582661 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b05c767-212e-48e2-a9a6-d01a10474692 admin admin] PATH_INFO: `/v3/projects/7f9e334b29ae425db1a00ef8d6fcfd15/users/88f55a6d5e1e4bd2a67e736f2c1eaecc/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:35.600533 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b05c767-212e-48e2-a9a6-d01a10474692 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f9e334b29ae425db1a00ef8d6fcfd15, user_id=88f55a6d5e1e4bd2a67e736f2c1eaecc, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:35.604177 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b05c767-212e-48e2-a9a6-d01a10474692 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:35.621118 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1365/2710] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:36:35 2022] PUT /identity/v3/projects/7f9e334b29ae425db1a00ef8d6fcfd15/users/88f55a6d5e1e4bd2a67e736f2c1eaecc/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:36:35.629229 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076dcab4-2f0d-4a66-9d80-94a86289d758 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:35.629516 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076dcab4-2f0d-4a66-9d80-94a86289d758 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:35.629791 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076dcab4-2f0d-4a66-9d80-94a86289d758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:35.660048 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-076dcab4-2f0d-4a66-9d80-94a86289d758 None None] MFA Rules not processed for user `88f55a6d5e1e4bd2a67e736f2c1eaecc`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:36:35.661271 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-076dcab4-2f0d-4a66-9d80-94a86289d758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:35.706080 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b05c767-212e-48e2-a9a6-d01a10474692 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:35.708024 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-5b05c767-212e-48e2-a9a6-d01a10474692 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:35.736658 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1346/2711] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:36:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:36:35.748500 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076dcab4-2f0d-4a66-9d80-94a86289d758 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:35.750009 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-076dcab4-2f0d-4a66-9d80-94a86289d758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:35.793800 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b05c767-212e-48e2-a9a6-d01a10474692 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:35.798791 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f2741-ebe0-4a96-8fa7-bedc79c5d161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:35.799552 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f2741-ebe0-4a96-8fa7-bedc79c5d161 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:35.799878 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f2741-ebe0-4a96-8fa7-bedc79c5d161 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:35.800287 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f2741-ebe0-4a96-8fa7-bedc79c5d161 admin admin] PATH_INFO: `/v3/users/ffbbe731312e44cc9f3eb3f9c46b0ba7` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:35.801347 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371f2741-ebe0-4a96-8fa7-bedc79c5d161 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffbbe731312e44cc9f3eb3f9c46b0ba7)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:35.804226 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371f2741-ebe0-4a96-8fa7-bedc79c5d161 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:35.813480 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076dcab4-2f0d-4a66-9d80-94a86289d758 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:35.817307 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c532360-340d-4cc0-a4d4-52462e1dacb8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2de6decc90df4df58217d5eed9c5e190', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:35.817924 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c532360-340d-4cc0-a4d4-52462e1dacb8 service glance] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:35.818211 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c532360-340d-4cc0-a4d4-52462e1dacb8 service glance] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:35.818484 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c532360-340d-4cc0-a4d4-52462e1dacb8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:35.825805 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:36:35.829571 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c532360-340d-4cc0-a4d4-52462e1dacb8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:35.831200 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c532360-340d-4cc0-a4d4-52462e1dacb8 service glance] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:35.846283 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1347/2712] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:36:35 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:36:35.860920 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:36:35.866998 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-371f2741-ebe0-4a96-8fa7-bedc79c5d161 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffbbe731312e44cc9f3eb3f9c46b0ba7'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:35.881115 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-371f2741-ebe0-4a96-8fa7-bedc79c5d161 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffbbe731312e44cc9f3eb3f9c46b0ba7'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:35.883532 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-371f2741-ebe0-4a96-8fa7-bedc79c5d161 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffbbe731312e44cc9f3eb3f9c46b0ba7'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:35.898654 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-371f2741-ebe0-4a96-8fa7-bedc79c5d161 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffbbe731312e44cc9f3eb3f9c46b0ba7'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:35.900577 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-371f2741-ebe0-4a96-8fa7-bedc79c5d161 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffbbe731312e44cc9f3eb3f9c46b0ba7'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:35.927875 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1366/2713] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:36:35 2022] DELETE /identity/v3/users/ffbbe731312e44cc9f3eb3f9c46b0ba7 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:36:35.932852 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f2a38d-ae3c-48f3-8903-38340dbdf237 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:35.933141 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f2a38d-ae3c-48f3-8903-38340dbdf237 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:35.933450 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f2a38d-ae3c-48f3-8903-38340dbdf237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:35.953977 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-20f2a38d-ae3c-48f3-8903-38340dbdf237 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:36:35.955192 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-20f2a38d-ae3c-48f3-8903-38340dbdf237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:36.048271 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1348/2714] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:36:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:36:36.060481 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f2741-ebe0-4a96-8fa7-bedc79c5d161 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:36.061994 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-371f2741-ebe0-4a96-8fa7-bedc79c5d161 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:36.137543 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f2741-ebe0-4a96-8fa7-bedc79c5d161 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:36.147144 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62731c0-04bb-48d6-8f42-1febc9f8ba23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:36.148155 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62731c0-04bb-48d6-8f42-1febc9f8ba23 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:36.149335 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62731c0-04bb-48d6-8f42-1febc9f8ba23 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:36.149987 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62731c0-04bb-48d6-8f42-1febc9f8ba23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:36.162403 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62731c0-04bb-48d6-8f42-1febc9f8ba23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:36.164770 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62731c0-04bb-48d6-8f42-1febc9f8ba23 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:36.175520 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1367/2715] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:36:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:36:36.475332 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f2a38d-ae3c-48f3-8903-38340dbdf237 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:36.477380 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-20f2a38d-ae3c-48f3-8903-38340dbdf237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:36.490424 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f2a38d-ae3c-48f3-8903-38340dbdf237 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:36.496423 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5453deb1-6147-4bf9-9aca-f7b161d79292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:36.497094 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5453deb1-6147-4bf9-9aca-f7b161d79292 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:36.497373 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5453deb1-6147-4bf9-9aca-f7b161d79292 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:36.497648 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5453deb1-6147-4bf9-9aca-f7b161d79292 admin admin] PATH_INFO: `/v3/projects/fa79bf464b29432e809c227cbc5df57d` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:36.498811 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5453deb1-6147-4bf9-9aca-f7b161d79292 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa79bf464b29432e809c227cbc5df57d)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:36.501176 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5453deb1-6147-4bf9-9aca-f7b161d79292 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:36.553048 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-5453deb1-6147-4bf9-9aca-f7b161d79292 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa79bf464b29432e809c227cbc5df57d', 'request_id': 'req-5453deb1-6147-4bf9-9aca-f7b161d79292'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:36.560451 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-5453deb1-6147-4bf9-9aca-f7b161d79292 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa79bf464b29432e809c227cbc5df57d', 'request_id': 'req-5453deb1-6147-4bf9-9aca-f7b161d79292'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:36.568553 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-5453deb1-6147-4bf9-9aca-f7b161d79292 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa79bf464b29432e809c227cbc5df57d', 'request_id': 'req-5453deb1-6147-4bf9-9aca-f7b161d79292'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:36.581257 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-5453deb1-6147-4bf9-9aca-f7b161d79292 admin admin] The token cache is being invalidate because project fa79bf464b29432e809c227cbc5df57d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81447) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:36:36.581550 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-5453deb1-6147-4bf9-9aca-f7b161d79292 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:36.582199 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-5453deb1-6147-4bf9-9aca-f7b161d79292 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:36.583757 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1349/2716] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:36:36 2022] DELETE /identity/v3/projects/fa79bf464b29432e809c227cbc5df57d => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:36:36.588109 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62731c0-04bb-48d6-8f42-1febc9f8ba23 service neutron] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:36.600046 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62731c0-04bb-48d6-8f42-1febc9f8ba23 service neutron] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:36.678247 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7cd145-9a85-49fc-a35e-2674ab2b4203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:36.678892 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7cd145-9a85-49fc-a35e-2674ab2b4203 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:36.679156 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7cd145-9a85-49fc-a35e-2674ab2b4203 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:36.679447 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7cd145-9a85-49fc-a35e-2674ab2b4203 admin admin] PATH_INFO: `/v3/users/2ba83dcbe2d3419a84efafd59ed3310c` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:36.681177 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7cd145-9a85-49fc-a35e-2674ab2b4203 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ba83dcbe2d3419a84efafd59ed3310c)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:36.683091 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7cd145-9a85-49fc-a35e-2674ab2b4203 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:36.743664 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-1b7cd145-9a85-49fc-a35e-2674ab2b4203 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ba83dcbe2d3419a84efafd59ed3310c'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:36.756295 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-1b7cd145-9a85-49fc-a35e-2674ab2b4203 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ba83dcbe2d3419a84efafd59ed3310c'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:36.756969 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-1b7cd145-9a85-49fc-a35e-2674ab2b4203 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ba83dcbe2d3419a84efafd59ed3310c'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:36.765021 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:36:36.774272 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-1b7cd145-9a85-49fc-a35e-2674ab2b4203 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ba83dcbe2d3419a84efafd59ed3310c'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:36.778510 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-1b7cd145-9a85-49fc-a35e-2674ab2b4203 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ba83dcbe2d3419a84efafd59ed3310c'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:36.799424 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1368/2717] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:36:36 2022] DELETE /identity/v3/users/2ba83dcbe2d3419a84efafd59ed3310c => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:36:37.092754 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5453deb1-6147-4bf9-9aca-f7b161d79292 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:37.094254 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-5453deb1-6147-4bf9-9aca-f7b161d79292 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:37.110064 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5453deb1-6147-4bf9-9aca-f7b161d79292 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:37.171015 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984111b7-fdf7-4f3f-a8ac-f94e7adafb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:37.171817 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984111b7-fdf7-4f3f-a8ac-f94e7adafb50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:37.172097 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984111b7-fdf7-4f3f-a8ac-f94e7adafb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:37.172471 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984111b7-fdf7-4f3f-a8ac-f94e7adafb50 admin admin] PATH_INFO: `/v3/projects/28e8821d004d4446b80cde3e89ef99cd` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:37.173703 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984111b7-fdf7-4f3f-a8ac-f94e7adafb50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28e8821d004d4446b80cde3e89ef99cd)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:37.176133 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984111b7-fdf7-4f3f-a8ac-f94e7adafb50 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:37.201260 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:36:37.228025 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-984111b7-fdf7-4f3f-a8ac-f94e7adafb50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28e8821d004d4446b80cde3e89ef99cd', 'request_id': 'req-984111b7-fdf7-4f3f-a8ac-f94e7adafb50'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:37.234464 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-984111b7-fdf7-4f3f-a8ac-f94e7adafb50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28e8821d004d4446b80cde3e89ef99cd', 'request_id': 'req-984111b7-fdf7-4f3f-a8ac-f94e7adafb50'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:37.243540 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-984111b7-fdf7-4f3f-a8ac-f94e7adafb50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28e8821d004d4446b80cde3e89ef99cd', 'request_id': 'req-984111b7-fdf7-4f3f-a8ac-f94e7adafb50'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:37.254896 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-984111b7-fdf7-4f3f-a8ac-f94e7adafb50 admin admin] The token cache is being invalidate because project 28e8821d004d4446b80cde3e89ef99cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81447) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:36:37.255185 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-984111b7-fdf7-4f3f-a8ac-f94e7adafb50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:37.256008 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-984111b7-fdf7-4f3f-a8ac-f94e7adafb50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:37.257624 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1350/2718] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:36:37 2022] DELETE /identity/v3/projects/28e8821d004d4446b80cde3e89ef99cd => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:36:37.263064 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33425db-03ca-489e-95b1-0d0f7cbbf72b None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:37.263558 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33425db-03ca-489e-95b1-0d0f7cbbf72b None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:37.263689 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33425db-03ca-489e-95b1-0d0f7cbbf72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:37.286063 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-c33425db-03ca-489e-95b1-0d0f7cbbf72b None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:36:37.287302 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-c33425db-03ca-489e-95b1-0d0f7cbbf72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:37.352084 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1369/2719] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:36:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:36:37.361897 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af4570-9a2d-41d4-9102-0814ba2dfd64 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:37.362294 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af4570-9a2d-41d4-9102-0814ba2dfd64 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:37.362630 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af4570-9a2d-41d4-9102-0814ba2dfd64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:37.394996 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-90af4570-9a2d-41d4-9102-0814ba2dfd64 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:36:37.396498 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-90af4570-9a2d-41d4-9102-0814ba2dfd64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:37.407884 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1351/2720] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:36:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:36:37.412612 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33425db-03ca-489e-95b1-0d0f7cbbf72b None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:37.429495 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33425db-03ca-489e-95b1-0d0f7cbbf72b None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:37.435547 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76386e2f-a123-4aac-ab4b-d321c2fe6eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:37.436276 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76386e2f-a123-4aac-ab4b-d321c2fe6eee admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:37.436623 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76386e2f-a123-4aac-ab4b-d321c2fe6eee admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:37.436964 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76386e2f-a123-4aac-ab4b-d321c2fe6eee admin admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:37.437718 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76386e2f-a123-4aac-ab4b-d321c2fe6eee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:36:37.438256 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76386e2f-a123-4aac-ab4b-d321c2fe6eee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:37.440066 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76386e2f-a123-4aac-ab4b-d321c2fe6eee admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:37.464315 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1370/2721] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 30 01:36:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:36:37.468887 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90af4570-9a2d-41d4-9102-0814ba2dfd64 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:37.478285 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90af4570-9a2d-41d4-9102-0814ba2dfd64 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:37.483125 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f34bf-63d2-4ffe-a3e4-b82d608287cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:37.483789 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f34bf-63d2-4ffe-a3e4-b82d608287cf admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:37.484068 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f34bf-63d2-4ffe-a3e4-b82d608287cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:37.484457 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f34bf-63d2-4ffe-a3e4-b82d608287cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:37.485196 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736f34bf-63d2-4ffe-a3e4-b82d608287cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:37.487339 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736f34bf-63d2-4ffe-a3e4-b82d608287cf admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:37.519596 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1352/2722] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:36:37 2022] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:36:37.524350 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76386e2f-a123-4aac-ab4b-d321c2fe6eee admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:37.534681 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76386e2f-a123-4aac-ab4b-d321c2fe6eee admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:37.608188 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6784b8-1038-498c-ae0e-901e3e1f6acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:37.608812 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6784b8-1038-498c-ae0e-901e3e1f6acb admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:37.609089 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6784b8-1038-498c-ae0e-901e3e1f6acb admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:37.609359 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6784b8-1038-498c-ae0e-901e3e1f6acb admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:37.610040 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6784b8-1038-498c-ae0e-901e3e1f6acb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:37.612026 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6784b8-1038-498c-ae0e-901e3e1f6acb admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:37.640832 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1371/2723] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:36:37 2022] POST /identity/v3/users => generated 291 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:36:37.641979 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f34bf-63d2-4ffe-a3e4-b82d608287cf admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:37.657079 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f34bf-63d2-4ffe-a3e4-b82d608287cf admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:37.662146 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c10b2-acda-40ac-bba5-619586a104da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:37.662762 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c10b2-acda-40ac-bba5-619586a104da admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:37.663048 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c10b2-acda-40ac-bba5-619586a104da admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:37.663315 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c10b2-acda-40ac-bba5-619586a104da admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:37.664036 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424c10b2-acda-40ac-bba5-619586a104da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:37.665715 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424c10b2-acda-40ac-bba5-619586a104da admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:37.677264 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1353/2724] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:36:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:36:37.682032 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6784b8-1038-498c-ae0e-901e3e1f6acb admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:37.698134 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6784b8-1038-498c-ae0e-901e3e1f6acb admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:37.703268 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd948537-172c-4720-8725-bd5b34effc1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:37.703909 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd948537-172c-4720-8725-bd5b34effc1f admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:37.704186 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd948537-172c-4720-8725-bd5b34effc1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:37.704487 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd948537-172c-4720-8725-bd5b34effc1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:37.705137 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd948537-172c-4720-8725-bd5b34effc1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:37.706743 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd948537-172c-4720-8725-bd5b34effc1f admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:37.718756 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1372/2725] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:36:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:36:37.723033 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c10b2-acda-40ac-bba5-619586a104da admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:37.737824 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c10b2-acda-40ac-bba5-619586a104da admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:37.743036 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71271e58-010d-437f-8623-5b42261c8a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:37.743725 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71271e58-010d-437f-8623-5b42261c8a9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:37.744005 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71271e58-010d-437f-8623-5b42261c8a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:37.744273 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71271e58-010d-437f-8623-5b42261c8a9f admin admin] PATH_INFO: `/v3/projects/07224e7f4b42491aaf16bbe081fffd9e/users/97768a62360d4a06b1afde2e8b27921a/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:37.763787 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71271e58-010d-437f-8623-5b42261c8a9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=07224e7f4b42491aaf16bbe081fffd9e, user_id=97768a62360d4a06b1afde2e8b27921a, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:37.766488 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71271e58-010d-437f-8623-5b42261c8a9f admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:37.784040 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1354/2726] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:36:37 2022] PUT /identity/v3/projects/07224e7f4b42491aaf16bbe081fffd9e/users/97768a62360d4a06b1afde2e8b27921a/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:36:37.794692 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a62ce5e-cf22-4664-8f68-49d2110e1b92 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:37.795245 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a62ce5e-cf22-4664-8f68-49d2110e1b92 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:37.795698 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a62ce5e-cf22-4664-8f68-49d2110e1b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:37.828794 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-9a62ce5e-cf22-4664-8f68-49d2110e1b92 None None] MFA Rules not processed for user `97768a62360d4a06b1afde2e8b27921a`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:36:37.830192 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-9a62ce5e-cf22-4664-8f68-49d2110e1b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:37.876275 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:36:37.917378 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1373/2727] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:36:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:36:37.921981 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71271e58-010d-437f-8623-5b42261c8a9f admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:37.992691 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71271e58-010d-437f-8623-5b42261c8a9f admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:37.998220 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a005371-0bd7-4c6d-ae7f-58e4ca9ed98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:37.998857 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a005371-0bd7-4c6d-ae7f-58e4ca9ed98c admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:37.999140 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a005371-0bd7-4c6d-ae7f-58e4ca9ed98c admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:37.999462 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a005371-0bd7-4c6d-ae7f-58e4ca9ed98c admin admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:38.000188 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a005371-0bd7-4c6d-ae7f-58e4ca9ed98c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:38.002212 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a005371-0bd7-4c6d-ae7f-58e4ca9ed98c admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:38.033270 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1355/2728] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:36:37 2022] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:36:38.037535 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a62ce5e-cf22-4664-8f68-49d2110e1b92 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:38.050448 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a62ce5e-cf22-4664-8f68-49d2110e1b92 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:38.121232 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e7fd1e-62a5-4dee-a227-9e6f41191ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:38.121879 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7fd1e-62a5-4dee-a227-9e6f41191ccb admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:38.122161 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7fd1e-62a5-4dee-a227-9e6f41191ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:38.122439 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7fd1e-62a5-4dee-a227-9e6f41191ccb admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:38.123105 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e7fd1e-62a5-4dee-a227-9e6f41191ccb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:38.125116 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e7fd1e-62a5-4dee-a227-9e6f41191ccb admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:38.150051 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1374/2729] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:36:38 2022] POST /identity/v3/users => generated 298 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:36:38.154355 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a005371-0bd7-4c6d-ae7f-58e4ca9ed98c admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:38.168492 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a005371-0bd7-4c6d-ae7f-58e4ca9ed98c admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:38.174319 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f34f1-0a0a-41cc-97aa-8d566c230a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:38.174966 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f34f1-0a0a-41cc-97aa-8d566c230a91 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:38.175417 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f34f1-0a0a-41cc-97aa-8d566c230a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:38.175714 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f34f1-0a0a-41cc-97aa-8d566c230a91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:38.176373 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7f34f1-0a0a-41cc-97aa-8d566c230a91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:38.177987 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7f34f1-0a0a-41cc-97aa-8d566c230a91 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:38.190147 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1356/2730] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:36:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:36:38.194638 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e7fd1e-62a5-4dee-a227-9e6f41191ccb admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:38.206252 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e7fd1e-62a5-4dee-a227-9e6f41191ccb admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:38.211377 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aefe61-e345-4c07-96de-2f95077386a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:38.212111 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aefe61-e345-4c07-96de-2f95077386a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:38.212390 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aefe61-e345-4c07-96de-2f95077386a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:38.212665 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aefe61-e345-4c07-96de-2f95077386a1 admin admin] PATH_INFO: `/v3/projects/3af20d96aac949a2b9019e7a047dcd79/users/ee48a595d33a4e70a6afd64949bfe368/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:38.229793 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aefe61-e345-4c07-96de-2f95077386a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3af20d96aac949a2b9019e7a047dcd79, user_id=ee48a595d33a4e70a6afd64949bfe368, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:38.232490 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aefe61-e345-4c07-96de-2f95077386a1 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:38.253998 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1375/2731] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:36:38 2022] PUT /identity/v3/projects/3af20d96aac949a2b9019e7a047dcd79/users/ee48a595d33a4e70a6afd64949bfe368/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:36:38.258206 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f34f1-0a0a-41cc-97aa-8d566c230a91 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:38.268674 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f34f1-0a0a-41cc-97aa-8d566c230a91 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:38.288086 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:36:38.337799 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1699fa-554a-443d-9000-e177f113f8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:38.338431 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1699fa-554a-443d-9000-e177f113f8a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:38.338712 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1699fa-554a-443d-9000-e177f113f8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:38.338991 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1699fa-554a-443d-9000-e177f113f8a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:38.340648 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1699fa-554a-443d-9000-e177f113f8a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:38.341275 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1699fa-554a-443d-9000-e177f113f8a2 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:38.353353 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1357/2732] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:36:38 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:36:38.357980 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aefe61-e345-4c07-96de-2f95077386a1 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:38.373335 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aefe61-e345-4c07-96de-2f95077386a1 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:38.379362 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92d571e-8518-4697-9a56-ba84d6c0f602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:38.380076 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d571e-8518-4697-9a56-ba84d6c0f602 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:38.380359 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d571e-8518-4697-9a56-ba84d6c0f602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:38.380636 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d571e-8518-4697-9a56-ba84d6c0f602 admin admin] PATH_INFO: `/v3/projects/3af20d96aac949a2b9019e7a047dcd79/users/ee48a595d33a4e70a6afd64949bfe368/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:38.382620 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92d571e-8518-4697-9a56-ba84d6c0f602 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3af20d96aac949a2b9019e7a047dcd79, user_id=ee48a595d33a4e70a6afd64949bfe368, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:38.385344 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92d571e-8518-4697-9a56-ba84d6c0f602 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:38.398205 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1376/2733] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:36:38 2022] PUT /identity/v3/projects/3af20d96aac949a2b9019e7a047dcd79/users/ee48a595d33a4e70a6afd64949bfe368/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:36:38.416003 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e578ed-7dcc-456d-acec-ced345921095 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:38.416269 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e578ed-7dcc-456d-acec-ced345921095 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:38.416550 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e578ed-7dcc-456d-acec-ced345921095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:38.446417 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-03e578ed-7dcc-456d-acec-ced345921095 None None] MFA Rules not processed for user `ee48a595d33a4e70a6afd64949bfe368`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:36:38.447724 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-03e578ed-7dcc-456d-acec-ced345921095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:38.551416 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1358/2734] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:36:38 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:36:38.564295 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92d571e-8518-4697-9a56-ba84d6c0f602 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:38.565931 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-e92d571e-8518-4697-9a56-ba84d6c0f602 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:38.640988 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92d571e-8518-4697-9a56-ba84d6c0f602 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:38.646503 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48190308-ca54-4916-9a2b-ad23c7f92d49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:38.647589 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48190308-ca54-4916-9a2b-ad23c7f92d49 service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:38.648077 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48190308-ca54-4916-9a2b-ad23c7f92d49 service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:38.649433 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48190308-ca54-4916-9a2b-ad23c7f92d49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:38.661597 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48190308-ca54-4916-9a2b-ad23c7f92d49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:38.663079 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48190308-ca54-4916-9a2b-ad23c7f92d49 service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:38.674334 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1377/2735] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:36:38 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:36:38.752793 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e578ed-7dcc-456d-acec-ced345921095 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:38.763309 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e578ed-7dcc-456d-acec-ced345921095 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:38.767399 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4291c959-480b-4fae-80a2-6cea25977cc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:38.768224 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291c959-480b-4fae-80a2-6cea25977cc3 service cinder] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:38.768476 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291c959-480b-4fae-80a2-6cea25977cc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:38.768613 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291c959-480b-4fae-80a2-6cea25977cc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:38.833133 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4291c959-480b-4fae-80a2-6cea25977cc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:38.834856 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4291c959-480b-4fae-80a2-6cea25977cc3 service cinder] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:38.844524 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1359/2736] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:36:38 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:36:39.148776 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48190308-ca54-4916-9a2b-ad23c7f92d49 service cinder] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:39.183720 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:36:39.217266 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48190308-ca54-4916-9a2b-ad23c7f92d49 service cinder] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:39.222213 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e06f7d-44aa-401f-a73c-ac6c5927558e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:39.222847 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e06f7d-44aa-401f-a73c-ac6c5927558e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:39.223142 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e06f7d-44aa-401f-a73c-ac6c5927558e admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:39.223403 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e06f7d-44aa-401f-a73c-ac6c5927558e admin admin] PATH_INFO: `/v3/users/97768a62360d4a06b1afde2e8b27921a` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:39.224565 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e06f7d-44aa-401f-a73c-ac6c5927558e admin admin] RBAC: Authorizing `identity:delete_user(user_id=97768a62360d4a06b1afde2e8b27921a)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:39.226500 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e06f7d-44aa-401f-a73c-ac6c5927558e admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:39.274951 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-83e06f7d-44aa-401f-a73c-ac6c5927558e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97768a62360d4a06b1afde2e8b27921a'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:39.282421 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-83e06f7d-44aa-401f-a73c-ac6c5927558e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97768a62360d4a06b1afde2e8b27921a'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:39.283479 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-83e06f7d-44aa-401f-a73c-ac6c5927558e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97768a62360d4a06b1afde2e8b27921a'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:39.297862 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-83e06f7d-44aa-401f-a73c-ac6c5927558e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97768a62360d4a06b1afde2e8b27921a'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:39.298506 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-83e06f7d-44aa-401f-a73c-ac6c5927558e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97768a62360d4a06b1afde2e8b27921a'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:39.311333 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1378/2737] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:36:39 2022] DELETE /identity/v3/users/97768a62360d4a06b1afde2e8b27921a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:36:39.315878 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65277f5-9fc6-4f14-9415-f7504dacf5c8 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:39.316161 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65277f5-9fc6-4f14-9415-f7504dacf5c8 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:39.316425 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65277f5-9fc6-4f14-9415-f7504dacf5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:39.336165 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-a65277f5-9fc6-4f14-9415-f7504dacf5c8 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:36:39.337371 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-a65277f5-9fc6-4f14-9415-f7504dacf5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:39.374651 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:36:39.403735 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1360/2738] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:36:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:36:39.415781 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e06f7d-44aa-401f-a73c-ac6c5927558e admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:39.417305 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-83e06f7d-44aa-401f-a73c-ac6c5927558e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:39.485892 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e06f7d-44aa-401f-a73c-ac6c5927558e admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:39.489668 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0eca3e-0fa3-4190-8147-2f5585801cfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:39.490282 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0eca3e-0fa3-4190-8147-2f5585801cfb service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:39.490563 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0eca3e-0fa3-4190-8147-2f5585801cfb service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:39.490838 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0eca3e-0fa3-4190-8147-2f5585801cfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:39.500880 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0eca3e-0fa3-4190-8147-2f5585801cfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:39.502318 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0eca3e-0fa3-4190-8147-2f5585801cfb service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:39.515246 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1379/2739] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:36:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:36:39.889681 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65277f5-9fc6-4f14-9415-f7504dacf5c8 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:39.891190 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-a65277f5-9fc6-4f14-9415-f7504dacf5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:39.909569 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65277f5-9fc6-4f14-9415-f7504dacf5c8 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:39.915816 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d2b18f-af1b-4566-bf04-d473ad2c2ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:39.916464 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2b18f-af1b-4566-bf04-d473ad2c2ea4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:39.916744 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2b18f-af1b-4566-bf04-d473ad2c2ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:39.917149 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2b18f-af1b-4566-bf04-d473ad2c2ea4 admin admin] PATH_INFO: `/v3/projects/07224e7f4b42491aaf16bbe081fffd9e` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:39.918245 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d2b18f-af1b-4566-bf04-d473ad2c2ea4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07224e7f4b42491aaf16bbe081fffd9e)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:39.920266 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d2b18f-af1b-4566-bf04-d473ad2c2ea4 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:39.979671 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-34d2b18f-af1b-4566-bf04-d473ad2c2ea4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07224e7f4b42491aaf16bbe081fffd9e', 'request_id': 'req-34d2b18f-af1b-4566-bf04-d473ad2c2ea4'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:39.989315 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-34d2b18f-af1b-4566-bf04-d473ad2c2ea4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07224e7f4b42491aaf16bbe081fffd9e', 'request_id': 'req-34d2b18f-af1b-4566-bf04-d473ad2c2ea4'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:39.997836 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-34d2b18f-af1b-4566-bf04-d473ad2c2ea4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07224e7f4b42491aaf16bbe081fffd9e', 'request_id': 'req-34d2b18f-af1b-4566-bf04-d473ad2c2ea4'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:40.011707 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-34d2b18f-af1b-4566-bf04-d473ad2c2ea4 admin admin] The token cache is being invalidate because project 07224e7f4b42491aaf16bbe081fffd9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81447) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:36:40.012005 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-34d2b18f-af1b-4566-bf04-d473ad2c2ea4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:40.012711 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-34d2b18f-af1b-4566-bf04-d473ad2c2ea4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:40.014313 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1361/2740] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:36:39 2022] DELETE /identity/v3/projects/07224e7f4b42491aaf16bbe081fffd9e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:36:40.018312 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0eca3e-0fa3-4190-8147-2f5585801cfb service neutron] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:40.028458 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0eca3e-0fa3-4190-8147-2f5585801cfb service neutron] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:40.080542 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:36:40.091553 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381863f6-cbaf-4cc1-a2c3-eed86a0e11f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:40.092386 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381863f6-cbaf-4cc1-a2c3-eed86a0e11f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:40.092726 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381863f6-cbaf-4cc1-a2c3-eed86a0e11f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:40.093175 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381863f6-cbaf-4cc1-a2c3-eed86a0e11f2 admin admin] PATH_INFO: `/v3/users/ee48a595d33a4e70a6afd64949bfe368` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:40.094309 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381863f6-cbaf-4cc1-a2c3-eed86a0e11f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee48a595d33a4e70a6afd64949bfe368)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:40.096282 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381863f6-cbaf-4cc1-a2c3-eed86a0e11f2 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:40.151735 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-381863f6-cbaf-4cc1-a2c3-eed86a0e11f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee48a595d33a4e70a6afd64949bfe368'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:40.159619 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-381863f6-cbaf-4cc1-a2c3-eed86a0e11f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee48a595d33a4e70a6afd64949bfe368'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:40.160244 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-381863f6-cbaf-4cc1-a2c3-eed86a0e11f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee48a595d33a4e70a6afd64949bfe368'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:40.175486 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-381863f6-cbaf-4cc1-a2c3-eed86a0e11f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee48a595d33a4e70a6afd64949bfe368'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:40.176291 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-381863f6-cbaf-4cc1-a2c3-eed86a0e11f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee48a595d33a4e70a6afd64949bfe368'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:40.188682 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1380/2741] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:36:40 2022] DELETE /identity/v3/users/ee48a595d33a4e70a6afd64949bfe368 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:36:40.499631 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d2b18f-af1b-4566-bf04-d473ad2c2ea4 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:40.501139 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-34d2b18f-af1b-4566-bf04-d473ad2c2ea4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:40.515633 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d2b18f-af1b-4566-bf04-d473ad2c2ea4 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:40.609887 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52588a8-c579-4594-a1f9-987b675a5bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:40.610541 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52588a8-c579-4594-a1f9-987b675a5bf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:40.610822 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52588a8-c579-4594-a1f9-987b675a5bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:40.611097 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52588a8-c579-4594-a1f9-987b675a5bf7 admin admin] PATH_INFO: `/v3/projects/3af20d96aac949a2b9019e7a047dcd79` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:40.612369 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52588a8-c579-4594-a1f9-987b675a5bf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3af20d96aac949a2b9019e7a047dcd79)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:40.614556 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52588a8-c579-4594-a1f9-987b675a5bf7 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:40.672422 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-a52588a8-c579-4594-a1f9-987b675a5bf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3af20d96aac949a2b9019e7a047dcd79', 'request_id': 'req-a52588a8-c579-4594-a1f9-987b675a5bf7'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:40.678579 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-a52588a8-c579-4594-a1f9-987b675a5bf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3af20d96aac949a2b9019e7a047dcd79', 'request_id': 'req-a52588a8-c579-4594-a1f9-987b675a5bf7'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:40.687289 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-a52588a8-c579-4594-a1f9-987b675a5bf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3af20d96aac949a2b9019e7a047dcd79', 'request_id': 'req-a52588a8-c579-4594-a1f9-987b675a5bf7'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:40.699679 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:36:40.707515 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-a52588a8-c579-4594-a1f9-987b675a5bf7 admin admin] The token cache is being invalidate because project 3af20d96aac949a2b9019e7a047dcd79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81447) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:36:40.708023 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-a52588a8-c579-4594-a1f9-987b675a5bf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:40.708982 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-a52588a8-c579-4594-a1f9-987b675a5bf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:40.710808 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1362/2742] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:36:40 2022] DELETE /identity/v3/projects/3af20d96aac949a2b9019e7a047dcd79 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:36:40.715837 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634c2d7-5cc3-4f90-9219-2539dc2113e2 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:40.716349 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634c2d7-5cc3-4f90-9219-2539dc2113e2 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:40.716464 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634c2d7-5cc3-4f90-9219-2539dc2113e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:40.740899 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-a634c2d7-5cc3-4f90-9219-2539dc2113e2 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:36:40.742670 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-a634c2d7-5cc3-4f90-9219-2539dc2113e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:40.803892 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1381/2743] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:36:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:36:40.812770 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4982b-f37b-452d-9a74-ac3396e91330 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:40.813051 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4982b-f37b-452d-9a74-ac3396e91330 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:40.813323 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4982b-f37b-452d-9a74-ac3396e91330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:40.833775 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-06d4982b-f37b-452d-9a74-ac3396e91330 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:36:40.835251 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-06d4982b-f37b-452d-9a74-ac3396e91330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:40.843736 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1363/2744] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:36:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:36:40.849018 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a634c2d7-5cc3-4f90-9219-2539dc2113e2 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:40.859373 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a634c2d7-5cc3-4f90-9219-2539dc2113e2 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:40.864288 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46c7fc5-226f-4812-87aa-9ae498d76bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:40.864900 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c7fc5-226f-4812-87aa-9ae498d76bd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:40.865181 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c7fc5-226f-4812-87aa-9ae498d76bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:40.865455 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c7fc5-226f-4812-87aa-9ae498d76bd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:40.866104 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46c7fc5-226f-4812-87aa-9ae498d76bd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:36:40.866409 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46c7fc5-226f-4812-87aa-9ae498d76bd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:40.868567 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46c7fc5-226f-4812-87aa-9ae498d76bd7 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:40.880197 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1382/2745] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 30 01:36:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:36:40.885280 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4982b-f37b-452d-9a74-ac3396e91330 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:40.895035 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4982b-f37b-452d-9a74-ac3396e91330 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:40.899795 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b5727-6e05-49af-ba8f-7313a2eb1bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:40.900465 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b5727-6e05-49af-ba8f-7313a2eb1bbf admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:40.900663 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b5727-6e05-49af-ba8f-7313a2eb1bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:40.900936 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b5727-6e05-49af-ba8f-7313a2eb1bbf admin admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:40.901626 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7b5727-6e05-49af-ba8f-7313a2eb1bbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:40.903649 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7b5727-6e05-49af-ba8f-7313a2eb1bbf admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:40.933144 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1364/2746] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:36:40 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:36:40.937731 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46c7fc5-226f-4812-87aa-9ae498d76bd7 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:40.949280 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46c7fc5-226f-4812-87aa-9ae498d76bd7 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:41.014223 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b2b65c-d302-45ff-b40b-622a7e235932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:41.015134 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2b65c-d302-45ff-b40b-622a7e235932 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:41.015591 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2b65c-d302-45ff-b40b-622a7e235932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:41.015872 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2b65c-d302-45ff-b40b-622a7e235932 admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:41.016534 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b2b65c-d302-45ff-b40b-622a7e235932 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:41.018489 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b2b65c-d302-45ff-b40b-622a7e235932 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:41.026820 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:36:41.051033 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1383/2747] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:36:40 2022] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:36:41.056691 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b5727-6e05-49af-ba8f-7313a2eb1bbf admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:41.067985 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b5727-6e05-49af-ba8f-7313a2eb1bbf admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:41.072805 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f431e9-b4d0-408a-80a8-186181013efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:41.073424 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f431e9-b4d0-408a-80a8-186181013efa admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:41.073703 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f431e9-b4d0-408a-80a8-186181013efa admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:41.073980 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f431e9-b4d0-408a-80a8-186181013efa admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:41.074830 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f431e9-b4d0-408a-80a8-186181013efa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:41.076660 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f431e9-b4d0-408a-80a8-186181013efa admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:41.090942 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1365/2748] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:36:41.095116 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b2b65c-d302-45ff-b40b-622a7e235932 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:41.106239 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b2b65c-d302-45ff-b40b-622a7e235932 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:41.111324 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb52c02b-b9b9-4d4c-a64e-3eb52911b0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:41.111978 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb52c02b-b9b9-4d4c-a64e-3eb52911b0d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:41.112263 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb52c02b-b9b9-4d4c-a64e-3eb52911b0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:41.112534 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb52c02b-b9b9-4d4c-a64e-3eb52911b0d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:41.113191 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb52c02b-b9b9-4d4c-a64e-3eb52911b0d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:41.114817 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb52c02b-b9b9-4d4c-a64e-3eb52911b0d4 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:41.126713 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1384/2749] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:36:41.130908 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f431e9-b4d0-408a-80a8-186181013efa admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:41.141106 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f431e9-b4d0-408a-80a8-186181013efa admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:41.145985 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6833c0-f0c8-41c8-8ac4-16640e25b128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:41.146633 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6833c0-f0c8-41c8-8ac4-16640e25b128 admin admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:41.146914 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6833c0-f0c8-41c8-8ac4-16640e25b128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:41.147189 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6833c0-f0c8-41c8-8ac4-16640e25b128 admin admin] PATH_INFO: `/v3/projects/88a115ac036e4a01aabd3c65453852ef/users/b7de3bf339814e899ac804fb6c8483ba/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:41.163245 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6833c0-f0c8-41c8-8ac4-16640e25b128 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88a115ac036e4a01aabd3c65453852ef, user_id=b7de3bf339814e899ac804fb6c8483ba, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:41.166698 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6833c0-f0c8-41c8-8ac4-16640e25b128 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:41.181072 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1366/2750] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:36:41 2022] PUT /identity/v3/projects/88a115ac036e4a01aabd3c65453852ef/users/b7de3bf339814e899ac804fb6c8483ba/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:36:41.191734 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd568ff-608b-4098-9a50-8d319f1d22e1 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:41.191973 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd568ff-608b-4098-9a50-8d319f1d22e1 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:41.192268 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd568ff-608b-4098-9a50-8d319f1d22e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:41.219697 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-8cd568ff-608b-4098-9a50-8d319f1d22e1 None None] MFA Rules not processed for user `b7de3bf339814e899ac804fb6c8483ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:36:41.220909 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-8cd568ff-608b-4098-9a50-8d319f1d22e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:41.288171 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1385/2751] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:36:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:36:41.300793 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6833c0-f0c8-41c8-8ac4-16640e25b128 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:41.302766 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-3c6833c0-f0c8-41c8-8ac4-16640e25b128 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:41.364712 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6833c0-f0c8-41c8-8ac4-16640e25b128 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:41.368550 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7018c0a-6cef-4023-9772-9873e43f6e10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:41.369234 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7018c0a-6cef-4023-9772-9873e43f6e10 service cinder] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:41.369558 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7018c0a-6cef-4023-9772-9873e43f6e10 service cinder] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:41.369853 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7018c0a-6cef-4023-9772-9873e43f6e10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:41.383510 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7018c0a-6cef-4023-9772-9873e43f6e10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:41.384981 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7018c0a-6cef-4023-9772-9873e43f6e10 service cinder] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:41.395110 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1367/2752] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:36:41 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:36:46.863827 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd568ff-608b-4098-9a50-8d319f1d22e1 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:46.929364 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd568ff-608b-4098-9a50-8d319f1d22e1 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:46.934551 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0119532a-aa2c-47bc-a576-f2d68bfc5527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:46.935195 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119532a-aa2c-47bc-a576-f2d68bfc5527 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:46.935562 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119532a-aa2c-47bc-a576-f2d68bfc5527 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:46.936503 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119532a-aa2c-47bc-a576-f2d68bfc5527 admin admin] PATH_INFO: `/v3/users/b7de3bf339814e899ac804fb6c8483ba` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:46.937144 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0119532a-aa2c-47bc-a576-f2d68bfc5527 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7de3bf339814e899ac804fb6c8483ba)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:46.939099 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0119532a-aa2c-47bc-a576-f2d68bfc5527 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:46.997243 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-0119532a-aa2c-47bc-a576-f2d68bfc5527 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7de3bf339814e899ac804fb6c8483ba'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:47.007318 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-0119532a-aa2c-47bc-a576-f2d68bfc5527 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7de3bf339814e899ac804fb6c8483ba'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:47.008613 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-0119532a-aa2c-47bc-a576-f2d68bfc5527 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7de3bf339814e899ac804fb6c8483ba'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:47.020808 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:36:47.037490 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-0119532a-aa2c-47bc-a576-f2d68bfc5527 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7de3bf339814e899ac804fb6c8483ba'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:47.037490 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-0119532a-aa2c-47bc-a576-f2d68bfc5527 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7de3bf339814e899ac804fb6c8483ba'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:47.038315 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1386/2753] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:36:46 2022] DELETE /identity/v3/users/b7de3bf339814e899ac804fb6c8483ba => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:36:47.042892 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4921f0f-fc8a-46b0-babc-d5bff8b31ecc None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:47.043412 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4921f0f-fc8a-46b0-babc-d5bff8b31ecc None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:47.043412 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4921f0f-fc8a-46b0-babc-d5bff8b31ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:47.063600 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-f4921f0f-fc8a-46b0-babc-d5bff8b31ecc None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:36:47.064847 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-f4921f0f-fc8a-46b0-babc-d5bff8b31ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:47.132801 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1368/2754] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:36:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:36:47.145028 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0119532a-aa2c-47bc-a576-f2d68bfc5527 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:47.146784 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-0119532a-aa2c-47bc-a576-f2d68bfc5527 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:47.240981 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0119532a-aa2c-47bc-a576-f2d68bfc5527 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:47.247654 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ec398a-fa3f-48f7-abf7-3b09557aac03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:47.248572 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec398a-fa3f-48f7-abf7-3b09557aac03 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:47.249005 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec398a-fa3f-48f7-abf7-3b09557aac03 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:47.249425 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec398a-fa3f-48f7-abf7-3b09557aac03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:47.265849 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ec398a-fa3f-48f7-abf7-3b09557aac03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:47.268053 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ec398a-fa3f-48f7-abf7-3b09557aac03 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:47.285497 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1387/2755] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:36:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 01:36:47.736708 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4921f0f-fc8a-46b0-babc-d5bff8b31ecc None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:47.738191 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-f4921f0f-fc8a-46b0-babc-d5bff8b31ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:47.751850 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4921f0f-fc8a-46b0-babc-d5bff8b31ecc None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:47.757130 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe66d0b-f283-4d40-a8ba-58a9b2f301c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:47.758347 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe66d0b-f283-4d40-a8ba-58a9b2f301c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:47.758561 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe66d0b-f283-4d40-a8ba-58a9b2f301c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:47.758946 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe66d0b-f283-4d40-a8ba-58a9b2f301c6 admin admin] PATH_INFO: `/v3/projects/88a115ac036e4a01aabd3c65453852ef` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:47.760131 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe66d0b-f283-4d40-a8ba-58a9b2f301c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88a115ac036e4a01aabd3c65453852ef)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:47.762060 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe66d0b-f283-4d40-a8ba-58a9b2f301c6 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:47.798607 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:36:47.817247 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-bbe66d0b-f283-4d40-a8ba-58a9b2f301c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88a115ac036e4a01aabd3c65453852ef', 'request_id': 'req-bbe66d0b-f283-4d40-a8ba-58a9b2f301c6'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:47.825014 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-bbe66d0b-f283-4d40-a8ba-58a9b2f301c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88a115ac036e4a01aabd3c65453852ef', 'request_id': 'req-bbe66d0b-f283-4d40-a8ba-58a9b2f301c6'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:47.832640 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-bbe66d0b-f283-4d40-a8ba-58a9b2f301c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88a115ac036e4a01aabd3c65453852ef', 'request_id': 'req-bbe66d0b-f283-4d40-a8ba-58a9b2f301c6'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:47.844290 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-bbe66d0b-f283-4d40-a8ba-58a9b2f301c6 admin admin] The token cache is being invalidate because project 88a115ac036e4a01aabd3c65453852ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81447) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:36:47.844585 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-bbe66d0b-f283-4d40-a8ba-58a9b2f301c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:47.845227 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-bbe66d0b-f283-4d40-a8ba-58a9b2f301c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:47.846752 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1369/2756] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:36:47 2022] DELETE /identity/v3/projects/88a115ac036e4a01aabd3c65453852ef => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:36:47.851611 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ed073-fda1-466d-9671-550b8ef4a6e5 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:47.851904 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ed073-fda1-466d-9671-550b8ef4a6e5 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:47.852183 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ed073-fda1-466d-9671-550b8ef4a6e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:47.872981 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-118ed073-fda1-466d-9671-550b8ef4a6e5 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:36:47.874318 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-118ed073-fda1-466d-9671-550b8ef4a6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:47.938379 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1388/2757] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:36:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:36:47.947736 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe42dc-37d1-4f7f-b844-530d030fe8c4 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:47.948269 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe42dc-37d1-4f7f-b844-530d030fe8c4 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:47.948633 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe42dc-37d1-4f7f-b844-530d030fe8c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:47.970700 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-adfe42dc-37d1-4f7f-b844-530d030fe8c4 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:36:47.971949 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-adfe42dc-37d1-4f7f-b844-530d030fe8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:47.980297 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1370/2758] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:36:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:36:47.985305 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ed073-fda1-466d-9671-550b8ef4a6e5 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:47.996390 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ed073-fda1-466d-9671-550b8ef4a6e5 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:48.001262 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a708cd5-09de-480d-9f24-fa2c6101544d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:48.001891 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a708cd5-09de-480d-9f24-fa2c6101544d admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:48.002172 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a708cd5-09de-480d-9f24-fa2c6101544d admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:48.002447 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a708cd5-09de-480d-9f24-fa2c6101544d admin admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:48.003135 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a708cd5-09de-480d-9f24-fa2c6101544d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:36:48.003470 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a708cd5-09de-480d-9f24-fa2c6101544d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:48.005127 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a708cd5-09de-480d-9f24-fa2c6101544d admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:48.021870 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1389/2759] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 30 01:36:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:36:48.024284 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfe42dc-37d1-4f7f-b844-530d030fe8c4 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:48.045417 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfe42dc-37d1-4f7f-b844-530d030fe8c4 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:48.045417 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4c9c4d-6c01-42c2-aa80-fd32b98fff2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:48.045417 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c9c4d-6c01-42c2-aa80-fd32b98fff2c admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:48.045417 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c9c4d-6c01-42c2-aa80-fd32b98fff2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:48.046213 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c9c4d-6c01-42c2-aa80-fd32b98fff2c admin admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:48.046213 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4c9c4d-6c01-42c2-aa80-fd32b98fff2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:48.046213 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4c9c4d-6c01-42c2-aa80-fd32b98fff2c admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:48.077172 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1371/2760] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:36:48 2022] POST /identity/v3/projects => generated 359 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:36:48.081623 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a708cd5-09de-480d-9f24-fa2c6101544d admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:48.092604 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a708cd5-09de-480d-9f24-fa2c6101544d admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:48.152300 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7ce070-1b09-4af5-acde-ce66b90a63c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:48.152907 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7ce070-1b09-4af5-acde-ce66b90a63c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:48.153188 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7ce070-1b09-4af5-acde-ce66b90a63c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:48.153461 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7ce070-1b09-4af5-acde-ce66b90a63c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:48.154107 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7ce070-1b09-4af5-acde-ce66b90a63c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:48.156113 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7ce070-1b09-4af5-acde-ce66b90a63c3 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:48.178038 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1390/2761] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:36:48 2022] POST /identity/v3/users => generated 280 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:36:48.182602 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4c9c4d-6c01-42c2-aa80-fd32b98fff2c admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:48.193030 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4c9c4d-6c01-42c2-aa80-fd32b98fff2c admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:48.198325 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89761407-aa12-428a-9af0-25a83f5f69ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:48.198919 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89761407-aa12-428a-9af0-25a83f5f69ee admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:48.199203 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89761407-aa12-428a-9af0-25a83f5f69ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:48.199502 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89761407-aa12-428a-9af0-25a83f5f69ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:48.200155 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89761407-aa12-428a-9af0-25a83f5f69ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:48.201785 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89761407-aa12-428a-9af0-25a83f5f69ee admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:48.212807 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1372/2762] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:36:48.216711 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7ce070-1b09-4af5-acde-ce66b90a63c3 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:48.226654 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7ce070-1b09-4af5-acde-ce66b90a63c3 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:48.231195 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feba3cd-cc03-4225-b55b-8d81bc4e90a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:48.231822 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feba3cd-cc03-4225-b55b-8d81bc4e90a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:48.232099 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feba3cd-cc03-4225-b55b-8d81bc4e90a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:48.232367 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feba3cd-cc03-4225-b55b-8d81bc4e90a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:48.233008 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feba3cd-cc03-4225-b55b-8d81bc4e90a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:48.234602 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feba3cd-cc03-4225-b55b-8d81bc4e90a2 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:48.236062 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:36:48.248420 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1391/2763] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:36:48.251879 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89761407-aa12-428a-9af0-25a83f5f69ee admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:48.262532 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89761407-aa12-428a-9af0-25a83f5f69ee admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:48.267066 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6cb0ed-99a5-4bba-a80c-a868c0a42c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:48.267674 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6cb0ed-99a5-4bba-a80c-a868c0a42c74 admin admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:48.267953 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6cb0ed-99a5-4bba-a80c-a868c0a42c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:48.268221 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6cb0ed-99a5-4bba-a80c-a868c0a42c74 admin admin] PATH_INFO: `/v3/projects/a12137c083e5478880a7e1e030d13cd6/users/4bd21aaa974b4331b8f138ca1c9b409b/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:48.282544 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6cb0ed-99a5-4bba-a80c-a868c0a42c74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a12137c083e5478880a7e1e030d13cd6, user_id=4bd21aaa974b4331b8f138ca1c9b409b, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:48.285210 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6cb0ed-99a5-4bba-a80c-a868c0a42c74 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:48.301207 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1373/2764] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:36:48 2022] PUT /identity/v3/projects/a12137c083e5478880a7e1e030d13cd6/users/4bd21aaa974b4331b8f138ca1c9b409b/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:36:48.312243 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230e882-bf18-4131-a4df-2c184d936cdc None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:48.312529 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230e882-bf18-4131-a4df-2c184d936cdc None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:48.312830 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230e882-bf18-4131-a4df-2c184d936cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:48.342085 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-1230e882-bf18-4131-a4df-2c184d936cdc None None] MFA Rules not processed for user `4bd21aaa974b4331b8f138ca1c9b409b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:36:48.343314 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-1230e882-bf18-4131-a4df-2c184d936cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:48.451323 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1392/2765] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:36:48 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:36:48.487850 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6cb0ed-99a5-4bba-a80c-a868c0a42c74 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:48.491016 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-fe6cb0ed-99a5-4bba-a80c-a868c0a42c74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:48.573159 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6cb0ed-99a5-4bba-a80c-a868c0a42c74 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:48.577721 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81f2140-add6-4831-a15a-882a6759f042 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:48.578499 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f2140-add6-4831-a15a-882a6759f042 service cinder] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:48.578772 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f2140-add6-4831-a15a-882a6759f042 service cinder] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:48.579039 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f2140-add6-4831-a15a-882a6759f042 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:48.589363 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81f2140-add6-4831-a15a-882a6759f042 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:48.590868 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81f2140-add6-4831-a15a-882a6759f042 service cinder] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:48.603233 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1374/2766] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:36:48 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:36:48.619825 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230e882-bf18-4131-a4df-2c184d936cdc None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:48.688851 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230e882-bf18-4131-a4df-2c184d936cdc None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:48.693825 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd82fc20-c528-4640-bd8a-3c8f614e9de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:48.694476 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82fc20-c528-4640-bd8a-3c8f614e9de3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:48.694807 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82fc20-c528-4640-bd8a-3c8f614e9de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:48.695157 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82fc20-c528-4640-bd8a-3c8f614e9de3 admin admin] PATH_INFO: `/v3/users/4bd21aaa974b4331b8f138ca1c9b409b` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:48.696719 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd82fc20-c528-4640-bd8a-3c8f614e9de3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bd21aaa974b4331b8f138ca1c9b409b)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:48.699044 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd82fc20-c528-4640-bd8a-3c8f614e9de3 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:48.758377 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-dd82fc20-c528-4640-bd8a-3c8f614e9de3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bd21aaa974b4331b8f138ca1c9b409b'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:48.768516 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-dd82fc20-c528-4640-bd8a-3c8f614e9de3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bd21aaa974b4331b8f138ca1c9b409b'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:48.769061 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-dd82fc20-c528-4640-bd8a-3c8f614e9de3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bd21aaa974b4331b8f138ca1c9b409b'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:48.781886 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-dd82fc20-c528-4640-bd8a-3c8f614e9de3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bd21aaa974b4331b8f138ca1c9b409b'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:48.782575 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-dd82fc20-c528-4640-bd8a-3c8f614e9de3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bd21aaa974b4331b8f138ca1c9b409b'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:48.797339 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1393/2767] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:36:48 2022] DELETE /identity/v3/users/4bd21aaa974b4331b8f138ca1c9b409b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:36:48.801844 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e619c5e-3e62-4377-9bba-e6e1f6056fec None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:48.802133 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e619c5e-3e62-4377-9bba-e6e1f6056fec None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:48.802413 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e619c5e-3e62-4377-9bba-e6e1f6056fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:48.824345 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-1e619c5e-3e62-4377-9bba-e6e1f6056fec None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:36:48.825576 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-1e619c5e-3e62-4377-9bba-e6e1f6056fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:48.878943 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:36:48.891136 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1375/2768] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:36:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:36:48.901394 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd82fc20-c528-4640-bd8a-3c8f614e9de3 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:48.902877 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-dd82fc20-c528-4640-bd8a-3c8f614e9de3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:48.909472 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:36:48.965256 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd82fc20-c528-4640-bd8a-3c8f614e9de3 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:48.970047 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c462a7-874a-44f8-8799-2b8acf5a9c86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:48.970667 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c462a7-874a-44f8-8799-2b8acf5a9c86 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:48.970951 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c462a7-874a-44f8-8799-2b8acf5a9c86 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:48.971225 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c462a7-874a-44f8-8799-2b8acf5a9c86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:48.981914 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c462a7-874a-44f8-8799-2b8acf5a9c86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:48.983365 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c462a7-874a-44f8-8799-2b8acf5a9c86 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:48.993362 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1394/2769] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:36:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:36:49.318914 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e619c5e-3e62-4377-9bba-e6e1f6056fec None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:49.320951 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-1e619c5e-3e62-4377-9bba-e6e1f6056fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:49.333344 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e619c5e-3e62-4377-9bba-e6e1f6056fec None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:49.339555 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9d1115-dd52-45ff-82dd-6784bfc70aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:49.340206 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d1115-dd52-45ff-82dd-6784bfc70aa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:49.340484 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d1115-dd52-45ff-82dd-6784bfc70aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:49.340758 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d1115-dd52-45ff-82dd-6784bfc70aa7 admin admin] PATH_INFO: `/v3/projects/a12137c083e5478880a7e1e030d13cd6` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:49.341909 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9d1115-dd52-45ff-82dd-6784bfc70aa7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a12137c083e5478880a7e1e030d13cd6)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:49.343872 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9d1115-dd52-45ff-82dd-6784bfc70aa7 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:49.407019 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-5c9d1115-dd52-45ff-82dd-6784bfc70aa7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a12137c083e5478880a7e1e030d13cd6', 'request_id': 'req-5c9d1115-dd52-45ff-82dd-6784bfc70aa7'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:49.413360 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-5c9d1115-dd52-45ff-82dd-6784bfc70aa7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a12137c083e5478880a7e1e030d13cd6', 'request_id': 'req-5c9d1115-dd52-45ff-82dd-6784bfc70aa7'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:49.421934 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-5c9d1115-dd52-45ff-82dd-6784bfc70aa7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a12137c083e5478880a7e1e030d13cd6', 'request_id': 'req-5c9d1115-dd52-45ff-82dd-6784bfc70aa7'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:49.436113 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-5c9d1115-dd52-45ff-82dd-6784bfc70aa7 admin admin] The token cache is being invalidate because project a12137c083e5478880a7e1e030d13cd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81447) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:36:49.436414 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-5c9d1115-dd52-45ff-82dd-6784bfc70aa7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:49.437202 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-5c9d1115-dd52-45ff-82dd-6784bfc70aa7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:49.438834 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1376/2770] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:36:49 2022] DELETE /identity/v3/projects/a12137c083e5478880a7e1e030d13cd6 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:36:57.584859 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c462a7-874a-44f8-8799-2b8acf5a9c86 service neutron] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:57.586880 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-65c462a7-874a-44f8-8799-2b8acf5a9c86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:57.599889 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c462a7-874a-44f8-8799-2b8acf5a9c86 service neutron] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:57.656211 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b306d708-fb65-45b3-bc77-19067697a864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:57.656849 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306d708-fb65-45b3-bc77-19067697a864 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:57.657124 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306d708-fb65-45b3-bc77-19067697a864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:57.657400 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306d708-fb65-45b3-bc77-19067697a864 admin admin] PATH_INFO: `/v3/users/88f55a6d5e1e4bd2a67e736f2c1eaecc` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:57.658552 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b306d708-fb65-45b3-bc77-19067697a864 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88f55a6d5e1e4bd2a67e736f2c1eaecc)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:57.660522 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b306d708-fb65-45b3-bc77-19067697a864 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:57.707089 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-b306d708-fb65-45b3-bc77-19067697a864 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88f55a6d5e1e4bd2a67e736f2c1eaecc'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:57.714832 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-b306d708-fb65-45b3-bc77-19067697a864 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88f55a6d5e1e4bd2a67e736f2c1eaecc'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:57.715555 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-b306d708-fb65-45b3-bc77-19067697a864 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88f55a6d5e1e4bd2a67e736f2c1eaecc'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:57.727847 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-b306d708-fb65-45b3-bc77-19067697a864 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88f55a6d5e1e4bd2a67e736f2c1eaecc'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:57.728478 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-b306d708-fb65-45b3-bc77-19067697a864 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88f55a6d5e1e4bd2a67e736f2c1eaecc'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:57.740561 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1395/2771] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:36:57 2022] DELETE /identity/v3/users/88f55a6d5e1e4bd2a67e736f2c1eaecc => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:36:57.745881 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea24521-e608-45b1-9c24-a266b4003aed None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:57.746385 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea24521-e608-45b1-9c24-a266b4003aed None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:57.746503 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea24521-e608-45b1-9c24-a266b4003aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:57.765792 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-dea24521-e608-45b1-9c24-a266b4003aed None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:36:57.767018 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-dea24521-e608-45b1-9c24-a266b4003aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:57.825798 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1377/2772] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:36:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:36:57.835736 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b306d708-fb65-45b3-bc77-19067697a864 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:57.837700 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-b306d708-fb65-45b3-bc77-19067697a864 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:57.868944 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:36:57.897484 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b306d708-fb65-45b3-bc77-19067697a864 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:57.901611 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a5c511-d744-46ce-82cc-ae085c5d928e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:57.902205 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5c511-d744-46ce-82cc-ae085c5d928e service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:57.902482 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5c511-d744-46ce-82cc-ae085c5d928e service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:57.902751 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5c511-d744-46ce-82cc-ae085c5d928e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:57.911522 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a5c511-d744-46ce-82cc-ae085c5d928e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:57.913015 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a5c511-d744-46ce-82cc-ae085c5d928e service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:57.922806 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1396/2773] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:36:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:36:58.197916 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea24521-e608-45b1-9c24-a266b4003aed None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:58.199347 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-dea24521-e608-45b1-9c24-a266b4003aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:58.212247 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea24521-e608-45b1-9c24-a266b4003aed None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:58.216839 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d08e33-4369-49df-8ca4-e7a951c9f1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:58.217493 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d08e33-4369-49df-8ca4-e7a951c9f1c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:58.217760 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d08e33-4369-49df-8ca4-e7a951c9f1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:58.218035 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d08e33-4369-49df-8ca4-e7a951c9f1c1 admin admin] PATH_INFO: `/v3/projects/7f9e334b29ae425db1a00ef8d6fcfd15` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:58.219166 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d08e33-4369-49df-8ca4-e7a951c9f1c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f9e334b29ae425db1a00ef8d6fcfd15)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:58.221120 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d08e33-4369-49df-8ca4-e7a951c9f1c1 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:58.268918 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-14d08e33-4369-49df-8ca4-e7a951c9f1c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f9e334b29ae425db1a00ef8d6fcfd15', 'request_id': 'req-14d08e33-4369-49df-8ca4-e7a951c9f1c1'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:58.275657 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-14d08e33-4369-49df-8ca4-e7a951c9f1c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f9e334b29ae425db1a00ef8d6fcfd15', 'request_id': 'req-14d08e33-4369-49df-8ca4-e7a951c9f1c1'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:58.282885 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-14d08e33-4369-49df-8ca4-e7a951c9f1c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f9e334b29ae425db1a00ef8d6fcfd15', 'request_id': 'req-14d08e33-4369-49df-8ca4-e7a951c9f1c1'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:58.293022 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-14d08e33-4369-49df-8ca4-e7a951c9f1c1 admin admin] The token cache is being invalidate because project 7f9e334b29ae425db1a00ef8d6fcfd15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81447) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:36:58.293310 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-14d08e33-4369-49df-8ca4-e7a951c9f1c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:58.293930 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-14d08e33-4369-49df-8ca4-e7a951c9f1c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:36:58.295417 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1378/2774] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:36:58 2022] DELETE /identity/v3/projects/7f9e334b29ae425db1a00ef8d6fcfd15 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:36:58.711683 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a5c511-d744-46ce-82cc-ae085c5d928e service neutron] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:36:58.713098 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-64a5c511-d744-46ce-82cc-ae085c5d928e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:58.724339 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a5c511-d744-46ce-82cc-ae085c5d928e service neutron] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:36:58.783066 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e3761-606e-4a36-b3e0-0dd85b248ae0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:36:58.783690 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e3761-606e-4a36-b3e0-0dd85b248ae0 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:36:58.783966 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e3761-606e-4a36-b3e0-0dd85b248ae0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:36:58.784237 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e3761-606e-4a36-b3e0-0dd85b248ae0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:36:58.786135 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-0e3e3761-606e-4a36-b3e0-0dd85b248ae0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:36:58.847052 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3e3761-606e-4a36-b3e0-0dd85b248ae0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:36:58.848531 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3e3761-606e-4a36-b3e0-0dd85b248ae0 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:36:58.857552 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1397/2775] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:36:58 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:37:03.642874 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d08e33-4369-49df-8ca4-e7a951c9f1c1 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:37:03.644387 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-14d08e33-4369-49df-8ca4-e7a951c9f1c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:37:03.652378 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:37:03.660578 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d08e33-4369-49df-8ca4-e7a951c9f1c1 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:37:03.665475 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a58ee9-fdd3-4f83-9905-0630fe018c57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:37:03.666171 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a58ee9-fdd3-4f83-9905-0630fe018c57 service neutron] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:37:03.666814 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a58ee9-fdd3-4f83-9905-0630fe018c57 service neutron] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:37:03.667120 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a58ee9-fdd3-4f83-9905-0630fe018c57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:37:03.669534 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-93a58ee9-fdd3-4f83-9905-0630fe018c57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:37:03.744902 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a58ee9-fdd3-4f83-9905-0630fe018c57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:37:03.746242 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a58ee9-fdd3-4f83-9905-0630fe018c57 service neutron] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:37:03.756732 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1379/2776] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:37:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:37:06.856462 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e3761-606e-4a36-b3e0-0dd85b248ae0 service neutron] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:37:06.857893 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-0e3e3761-606e-4a36-b3e0-0dd85b248ae0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:37:06.940072 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e3761-606e-4a36-b3e0-0dd85b248ae0 service neutron] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:37:06.945002 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa07ed-a107-4bb8-b1c9-d6e502adb120 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8dbb4742c3944b9ad389e9628b5a047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:37:06.945646 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa07ed-a107-4bb8-b1c9-d6e502adb120 service placement] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:37:06.945927 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa07ed-a107-4bb8-b1c9-d6e502adb120 service placement] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:37:06.946201 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa07ed-a107-4bb8-b1c9-d6e502adb120 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:37:06.948235 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-d0aa07ed-a107-4bb8-b1c9-d6e502adb120 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:37:06.960478 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aa07ed-a107-4bb8-b1c9-d6e502adb120 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:37:06.962698 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aa07ed-a107-4bb8-b1c9-d6e502adb120 service placement] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:37:06.973176 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1398/2777] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:37:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:37:10.012370 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a58ee9-fdd3-4f83-9905-0630fe018c57 service neutron] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:37:10.013830 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-93a58ee9-fdd3-4f83-9905-0630fe018c57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:37:10.026390 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a58ee9-fdd3-4f83-9905-0630fe018c57 service neutron] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:37:10.031027 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ffec20-5bf5-44e3-b93e-fed4af9f0fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:37:10.031697 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ffec20-5bf5-44e3-b93e-fed4af9f0fca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:37:10.031972 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ffec20-5bf5-44e3-b93e-fed4af9f0fca admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:37:10.032241 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ffec20-5bf5-44e3-b93e-fed4af9f0fca admin admin] PATH_INFO: `/v3/users/91bfcdadb42441538cd25b83c7143808` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:37:10.033352 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ffec20-5bf5-44e3-b93e-fed4af9f0fca admin admin] RBAC: Authorizing `identity:delete_user(user_id=91bfcdadb42441538cd25b83c7143808)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:37:10.035246 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ffec20-5bf5-44e3-b93e-fed4af9f0fca admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:37:10.081409 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-d1ffec20-5bf5-44e3-b93e-fed4af9f0fca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91bfcdadb42441538cd25b83c7143808'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:37:10.089419 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-d1ffec20-5bf5-44e3-b93e-fed4af9f0fca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91bfcdadb42441538cd25b83c7143808'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:37:10.090150 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-d1ffec20-5bf5-44e3-b93e-fed4af9f0fca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91bfcdadb42441538cd25b83c7143808'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:37:10.090788 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-d1ffec20-5bf5-44e3-b93e-fed4af9f0fca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91bfcdadb42441538cd25b83c7143808'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:37:10.103321 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-d1ffec20-5bf5-44e3-b93e-fed4af9f0fca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91bfcdadb42441538cd25b83c7143808'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:37:10.115041 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1380/2778] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:37:10 2022] DELETE /identity/v3/users/91bfcdadb42441538cd25b83c7143808 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:37:10.290982 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa07ed-a107-4bb8-b1c9-d6e502adb120 service placement] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:37:10.307557 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa07ed-a107-4bb8-b1c9-d6e502adb120 service placement] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:37:10.317713 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:37:10.368140 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c3d7d-4684-4599-8de2-eba7c7a1bc51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:37:10.368536 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c3d7d-4684-4599-8de2-eba7c7a1bc51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:37:10.368812 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c3d7d-4684-4599-8de2-eba7c7a1bc51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:37:10.369079 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c3d7d-4684-4599-8de2-eba7c7a1bc51 admin admin] PATH_INFO: `/v3/projects/698a8ca01bfe4d4cabba581342416471` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:37:10.370189 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c3d7d-4684-4599-8de2-eba7c7a1bc51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=698a8ca01bfe4d4cabba581342416471)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:37:10.372118 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c3d7d-4684-4599-8de2-eba7c7a1bc51 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:37:10.416945 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-fd8c3d7d-4684-4599-8de2-eba7c7a1bc51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '698a8ca01bfe4d4cabba581342416471', 'request_id': 'req-fd8c3d7d-4684-4599-8de2-eba7c7a1bc51'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:37:10.422979 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-fd8c3d7d-4684-4599-8de2-eba7c7a1bc51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '698a8ca01bfe4d4cabba581342416471', 'request_id': 'req-fd8c3d7d-4684-4599-8de2-eba7c7a1bc51'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:37:10.430236 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-fd8c3d7d-4684-4599-8de2-eba7c7a1bc51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '698a8ca01bfe4d4cabba581342416471', 'request_id': 'req-fd8c3d7d-4684-4599-8de2-eba7c7a1bc51'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:37:10.440457 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-fd8c3d7d-4684-4599-8de2-eba7c7a1bc51 admin admin] The token cache is being invalidate because project 698a8ca01bfe4d4cabba581342416471 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:37:10.440750 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-fd8c3d7d-4684-4599-8de2-eba7c7a1bc51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:37:10.441373 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-fd8c3d7d-4684-4599-8de2-eba7c7a1bc51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:37:10.442894 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1399/2779] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:37:10 2022] DELETE /identity/v3/projects/698a8ca01bfe4d4cabba581342416471 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:37:10.447400 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ffec20-5bf5-44e3-b93e-fed4af9f0fca admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:37:10.448863 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-d1ffec20-5bf5-44e3-b93e-fed4af9f0fca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:37:10.462680 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ffec20-5bf5-44e3-b93e-fed4af9f0fca admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:37:10.517776 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c4306-f180-437b-9184-028aaab27ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:37:10.518402 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c4306-f180-437b-9184-028aaab27ada admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:37:10.518679 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c4306-f180-437b-9184-028aaab27ada admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:37:10.518946 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c4306-f180-437b-9184-028aaab27ada admin admin] PATH_INFO: `/v3/users/6b718ad9162a43778ee997d4fa07c3f0` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:37:10.520083 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3c4306-f180-437b-9184-028aaab27ada admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b718ad9162a43778ee997d4fa07c3f0)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:37:10.521994 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3c4306-f180-437b-9184-028aaab27ada admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:37:10.533368 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:37:10.568745 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-bb3c4306-f180-437b-9184-028aaab27ada admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b718ad9162a43778ee997d4fa07c3f0'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:37:10.577212 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-bb3c4306-f180-437b-9184-028aaab27ada admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b718ad9162a43778ee997d4fa07c3f0'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:37:10.577823 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-bb3c4306-f180-437b-9184-028aaab27ada admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b718ad9162a43778ee997d4fa07c3f0'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:37:10.578447 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-bb3c4306-f180-437b-9184-028aaab27ada admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b718ad9162a43778ee997d4fa07c3f0'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:37:10.591080 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-bb3c4306-f180-437b-9184-028aaab27ada admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b718ad9162a43778ee997d4fa07c3f0'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:37:10.603890 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1381/2780] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:37:10 2022] DELETE /identity/v3/users/6b718ad9162a43778ee997d4fa07c3f0 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:37:10.777550 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c3d7d-4684-4599-8de2-eba7c7a1bc51 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:37:10.779020 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-fd8c3d7d-4684-4599-8de2-eba7c7a1bc51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:37:10.793010 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c3d7d-4684-4599-8de2-eba7c7a1bc51 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:37:10.851358 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a075884a-4099-4cd0-bab5-9ce8682ba048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:37:10.852050 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a075884a-4099-4cd0-bab5-9ce8682ba048 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:37:10.852328 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a075884a-4099-4cd0-bab5-9ce8682ba048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:37:10.852598 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a075884a-4099-4cd0-bab5-9ce8682ba048 admin admin] PATH_INFO: `/v3/projects/d2e6cdaf30c44018aa8c3eb77323da5b` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:37:10.853872 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a075884a-4099-4cd0-bab5-9ce8682ba048 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2e6cdaf30c44018aa8c3eb77323da5b)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:37:10.857105 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a075884a-4099-4cd0-bab5-9ce8682ba048 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:37:10.904188 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:37:10.907295 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-a075884a-4099-4cd0-bab5-9ce8682ba048 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2e6cdaf30c44018aa8c3eb77323da5b', 'request_id': 'req-a075884a-4099-4cd0-bab5-9ce8682ba048'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:37:10.915199 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-a075884a-4099-4cd0-bab5-9ce8682ba048 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2e6cdaf30c44018aa8c3eb77323da5b', 'request_id': 'req-a075884a-4099-4cd0-bab5-9ce8682ba048'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:37:10.922697 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-a075884a-4099-4cd0-bab5-9ce8682ba048 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2e6cdaf30c44018aa8c3eb77323da5b', 'request_id': 'req-a075884a-4099-4cd0-bab5-9ce8682ba048'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:37:10.933685 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-a075884a-4099-4cd0-bab5-9ce8682ba048 admin admin] The token cache is being invalidate because project d2e6cdaf30c44018aa8c3eb77323da5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:37:10.934003 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-a075884a-4099-4cd0-bab5-9ce8682ba048 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:37:10.934591 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-a075884a-4099-4cd0-bab5-9ce8682ba048 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:37:10.936128 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1400/2781] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:37:10 2022] DELETE /identity/v3/projects/d2e6cdaf30c44018aa8c3eb77323da5b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:37:20.599980 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:DELETE=10,keystone:SELECT=22,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:37:20.930698 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:DELETE=4,keystone:SELECT=7,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:37:27.943010 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9bdabb-698d-4189-9105-32bd8978c48f None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:37:27.943610 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9bdabb-698d-4189-9105-32bd8978c48f None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:37:27.943610 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9bdabb-698d-4189-9105-32bd8978c48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:37:27.973655 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-ba9bdabb-698d-4189-9105-32bd8978c48f None None] MFA Rules not processed for user `6077403c858243858f4a9dab97a7eac6`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:37:27.974866 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-ba9bdabb-698d-4189-9105-32bd8978c48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:37:28.042864 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1382/2782] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:37:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:37:38.035752 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=35 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:37:38.948010 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a075884a-4099-4cd0-bab5-9ce8682ba048 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:37:38.949459 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-a075884a-4099-4cd0-bab5-9ce8682ba048 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:37:39.044307 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9bdabb-698d-4189-9105-32bd8978c48f None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:37:39.046068 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-ba9bdabb-698d-4189-9105-32bd8978c48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:37:39.109708 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a075884a-4099-4cd0-bab5-9ce8682ba048 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:37:39.115927 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb48a99-b322-454f-a443-31065665f76b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8dbb4742c3944b9ad389e9628b5a047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:37:39.115927 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb48a99-b322-454f-a443-31065665f76b service placement] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:37:39.116256 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb48a99-b322-454f-a443-31065665f76b service placement] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:37:39.116483 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb48a99-b322-454f-a443-31065665f76b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:37:39.118568 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-4cb48a99-b322-454f-a443-31065665f76b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:37:39.130748 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb48a99-b322-454f-a443-31065665f76b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:37:39.132300 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb48a99-b322-454f-a443-31065665f76b service placement] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:37:39.142638 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1401/2783] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:37:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:37:39.176418 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9bdabb-698d-4189-9105-32bd8978c48f None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:37:39.182493 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc759da-65d8-4cb7-ba25-52c15aa7174d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8889145228a24fb6bd539a11925e62f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:37:39.183110 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc759da-65d8-4cb7-ba25-52c15aa7174d service nova] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:37:39.183395 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc759da-65d8-4cb7-ba25-52c15aa7174d service nova] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:37:39.183693 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc759da-65d8-4cb7-ba25-52c15aa7174d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:37:39.185437 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-bdc759da-65d8-4cb7-ba25-52c15aa7174d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:37:39.199465 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc759da-65d8-4cb7-ba25-52c15aa7174d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:37:39.201369 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc759da-65d8-4cb7-ba25-52c15aa7174d service nova] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:37:39.213924 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1383/2784] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:37:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:37:49.138113 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=59 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:37:49.207713 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=48 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:38:35.001085 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb48a99-b322-454f-a443-31065665f76b service placement] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:35.002511 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-4cb48a99-b322-454f-a443-31065665f76b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:38:35.098166 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb48a99-b322-454f-a443-31065665f76b service placement] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:35.102796 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcd22a8-aa2c-4e8a-8c3a-e0a9b97f7713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:35.103474 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd22a8-aa2c-4e8a-8c3a-e0a9b97f7713 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:35.103760 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd22a8-aa2c-4e8a-8c3a-e0a9b97f7713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:35.104600 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd22a8-aa2c-4e8a-8c3a-e0a9b97f7713 admin admin] PATH_INFO: `/v3/users/6077403c858243858f4a9dab97a7eac6` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:35.105765 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcd22a8-aa2c-4e8a-8c3a-e0a9b97f7713 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6077403c858243858f4a9dab97a7eac6)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:35.107817 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcd22a8-aa2c-4e8a-8c3a-e0a9b97f7713 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:35.155237 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-9fcd22a8-aa2c-4e8a-8c3a-e0a9b97f7713 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6077403c858243858f4a9dab97a7eac6'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:35.162243 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-9fcd22a8-aa2c-4e8a-8c3a-e0a9b97f7713 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6077403c858243858f4a9dab97a7eac6'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:35.162808 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-9fcd22a8-aa2c-4e8a-8c3a-e0a9b97f7713 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6077403c858243858f4a9dab97a7eac6'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:35.175040 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-9fcd22a8-aa2c-4e8a-8c3a-e0a9b97f7713 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6077403c858243858f4a9dab97a7eac6'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:35.175714 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-9fcd22a8-aa2c-4e8a-8c3a-e0a9b97f7713 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6077403c858243858f4a9dab97a7eac6'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:35.187725 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1402/2785] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:38:34 2022] DELETE /identity/v3/users/6077403c858243858f4a9dab97a7eac6 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:38:35.376611 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc759da-65d8-4cb7-ba25-52c15aa7174d service nova] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:35.390883 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc759da-65d8-4cb7-ba25-52c15aa7174d service nova] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:35.449814 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae4742-7d3a-42eb-be5a-46352d38c3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:35.450443 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae4742-7d3a-42eb-be5a-46352d38c3c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:35.450721 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae4742-7d3a-42eb-be5a-46352d38c3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:35.450994 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae4742-7d3a-42eb-be5a-46352d38c3c1 admin admin] PATH_INFO: `/v3/projects/899ee0b769b54dc9bda9bc474a3907f3` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:35.452124 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ae4742-7d3a-42eb-be5a-46352d38c3c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=899ee0b769b54dc9bda9bc474a3907f3)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:35.454020 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ae4742-7d3a-42eb-be5a-46352d38c3c1 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:35.500438 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-e3ae4742-7d3a-42eb-be5a-46352d38c3c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '899ee0b769b54dc9bda9bc474a3907f3', 'request_id': 'req-e3ae4742-7d3a-42eb-be5a-46352d38c3c1'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:35.506434 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-e3ae4742-7d3a-42eb-be5a-46352d38c3c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '899ee0b769b54dc9bda9bc474a3907f3', 'request_id': 'req-e3ae4742-7d3a-42eb-be5a-46352d38c3c1'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:35.514540 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-e3ae4742-7d3a-42eb-be5a-46352d38c3c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '899ee0b769b54dc9bda9bc474a3907f3', 'request_id': 'req-e3ae4742-7d3a-42eb-be5a-46352d38c3c1'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:35.524654 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-e3ae4742-7d3a-42eb-be5a-46352d38c3c1 admin admin] The token cache is being invalidate because project 899ee0b769b54dc9bda9bc474a3907f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81447) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:38:35.524936 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-e3ae4742-7d3a-42eb-be5a-46352d38c3c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:35.525549 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-e3ae4742-7d3a-42eb-be5a-46352d38c3c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:35.527043 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1384/2786] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:38:35 2022] DELETE /identity/v3/projects/899ee0b769b54dc9bda9bc474a3907f3 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:38:35.532107 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef186b3-9022-4a69-9d3a-2a34243465e8 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:35.532394 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef186b3-9022-4a69-9d3a-2a34243465e8 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:35.532695 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef186b3-9022-4a69-9d3a-2a34243465e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:35.590518 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-6ef186b3-9022-4a69-9d3a-2a34243465e8 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:38:35.591767 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-6ef186b3-9022-4a69-9d3a-2a34243465e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:38:35.606322 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:38:35.654574 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1403/2787] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:38:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:38:35.662330 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868f26a-dfab-496c-b1ba-de71fd0aac11 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:35.662615 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868f26a-dfab-496c-b1ba-de71fd0aac11 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:35.662886 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868f26a-dfab-496c-b1ba-de71fd0aac11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:35.688569 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-6868f26a-dfab-496c-b1ba-de71fd0aac11 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:38:35.689771 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-6868f26a-dfab-496c-b1ba-de71fd0aac11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:38:35.698069 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1385/2788] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:38:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:38:35.702348 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef186b3-9022-4a69-9d3a-2a34243465e8 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:35.712670 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef186b3-9022-4a69-9d3a-2a34243465e8 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:35.717163 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae779f8d-c29b-4f8c-a786-20c4c0be63e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:35.717752 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae779f8d-c29b-4f8c-a786-20c4c0be63e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:35.718028 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae779f8d-c29b-4f8c-a786-20c4c0be63e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:35.718306 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae779f8d-c29b-4f8c-a786-20c4c0be63e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:35.718965 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae779f8d-c29b-4f8c-a786-20c4c0be63e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:38:35.719262 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae779f8d-c29b-4f8c-a786-20c4c0be63e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:35.720918 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae779f8d-c29b-4f8c-a786-20c4c0be63e7 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:35.732789 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1404/2789] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 30 01:38:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:38:35.736979 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868f26a-dfab-496c-b1ba-de71fd0aac11 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:35.746889 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868f26a-dfab-496c-b1ba-de71fd0aac11 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:35.751625 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad51c919-abaa-454c-82d4-637434c81895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:35.752225 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad51c919-abaa-454c-82d4-637434c81895 admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:35.752499 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad51c919-abaa-454c-82d4-637434c81895 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:35.752766 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad51c919-abaa-454c-82d4-637434c81895 admin admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:35.753435 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad51c919-abaa-454c-82d4-637434c81895 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:35.755365 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad51c919-abaa-454c-82d4-637434c81895 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:35.784391 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1386/2790] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:38:35 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:38:35.786116 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae779f8d-c29b-4f8c-a786-20c4c0be63e7 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:35.796441 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae779f8d-c29b-4f8c-a786-20c4c0be63e7 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:35.851344 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627aae67-f79d-45b5-9604-88d3ed271377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:35.853685 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627aae67-f79d-45b5-9604-88d3ed271377 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:35.854500 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627aae67-f79d-45b5-9604-88d3ed271377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:35.854772 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627aae67-f79d-45b5-9604-88d3ed271377 admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:35.855412 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627aae67-f79d-45b5-9604-88d3ed271377 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:35.857427 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627aae67-f79d-45b5-9604-88d3ed271377 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:35.879427 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1405/2791] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:38:35 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:38:35.883576 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad51c919-abaa-454c-82d4-637434c81895 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:35.893887 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad51c919-abaa-454c-82d4-637434c81895 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:35.898564 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b3e1f9-e78c-4672-8c87-5447062e55ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:35.899157 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3e1f9-e78c-4672-8c87-5447062e55ff admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:35.899590 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3e1f9-e78c-4672-8c87-5447062e55ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:35.899865 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3e1f9-e78c-4672-8c87-5447062e55ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:35.900502 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b3e1f9-e78c-4672-8c87-5447062e55ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:35.902106 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b3e1f9-e78c-4672-8c87-5447062e55ff admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:35.912099 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1387/2792] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:38:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:38:35.915989 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627aae67-f79d-45b5-9604-88d3ed271377 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:35.926208 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627aae67-f79d-45b5-9604-88d3ed271377 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:35.930755 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f346eae2-82c2-4aeb-a3cf-c5030842bdfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:35.931384 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346eae2-82c2-4aeb-a3cf-c5030842bdfc admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:35.931694 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346eae2-82c2-4aeb-a3cf-c5030842bdfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:35.931962 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346eae2-82c2-4aeb-a3cf-c5030842bdfc admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:35.933267 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f346eae2-82c2-4aeb-a3cf-c5030842bdfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:35.934850 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f346eae2-82c2-4aeb-a3cf-c5030842bdfc admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:35.945228 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1406/2793] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:38:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:38:35.949329 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b3e1f9-e78c-4672-8c87-5447062e55ff admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:35.959621 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b3e1f9-e78c-4672-8c87-5447062e55ff admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:35.964753 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9de0c9-29fa-481d-9e06-37b8ab2e3d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:35.965406 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9de0c9-29fa-481d-9e06-37b8ab2e3d12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:35.965858 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9de0c9-29fa-481d-9e06-37b8ab2e3d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:35.966108 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9de0c9-29fa-481d-9e06-37b8ab2e3d12 admin admin] PATH_INFO: `/v3/projects/309dcc02443f4b7db6a7e6b5ce4a03f8/users/9d9acfa90d624724bea5c361865bcbc4/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:35.984964 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9de0c9-29fa-481d-9e06-37b8ab2e3d12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=309dcc02443f4b7db6a7e6b5ce4a03f8, user_id=9d9acfa90d624724bea5c361865bcbc4, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:35.987656 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9de0c9-29fa-481d-9e06-37b8ab2e3d12 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:36.000710 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1388/2794] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:38:35 2022] PUT /identity/v3/projects/309dcc02443f4b7db6a7e6b5ce4a03f8/users/9d9acfa90d624724bea5c361865bcbc4/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:38:36.012074 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f1220-fd08-46da-a39e-71ad4eae5222 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:36.012611 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f1220-fd08-46da-a39e-71ad4eae5222 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:36.012611 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f1220-fd08-46da-a39e-71ad4eae5222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:36.040036 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-879f1220-fd08-46da-a39e-71ad4eae5222 None None] MFA Rules not processed for user `9d9acfa90d624724bea5c361865bcbc4`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:38:36.041228 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-879f1220-fd08-46da-a39e-71ad4eae5222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:38:36.106965 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1407/2795] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:38:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:38:36.118624 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9de0c9-29fa-481d-9e06-37b8ab2e3d12 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:36.120216 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-2a9de0c9-29fa-481d-9e06-37b8ab2e3d12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:38:36.150173 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:38:36.193764 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9de0c9-29fa-481d-9e06-37b8ab2e3d12 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:36.199308 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddcb012-318a-45ba-a0ff-27e68a6061d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8889145228a24fb6bd539a11925e62f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:36.199933 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddcb012-318a-45ba-a0ff-27e68a6061d2 service nova] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:36.200210 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddcb012-318a-45ba-a0ff-27e68a6061d2 service nova] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:36.200477 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddcb012-318a-45ba-a0ff-27e68a6061d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:36.208124 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddcb012-318a-45ba-a0ff-27e68a6061d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:36.209940 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddcb012-318a-45ba-a0ff-27e68a6061d2 service nova] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:36.219417 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1389/2796] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:38:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:38:38.900299 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f1220-fd08-46da-a39e-71ad4eae5222 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:38.916704 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:38:38.971232 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f1220-fd08-46da-a39e-71ad4eae5222 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:38.975897 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4f9157-126d-4f31-addc-bfa04ca5a1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:38.976538 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f9157-126d-4f31-addc-bfa04ca5a1d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:38.976784 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f9157-126d-4f31-addc-bfa04ca5a1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:38.977052 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f9157-126d-4f31-addc-bfa04ca5a1d2 admin admin] PATH_INFO: `/v3/users/9d9acfa90d624724bea5c361865bcbc4` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:38.978188 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4f9157-126d-4f31-addc-bfa04ca5a1d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d9acfa90d624724bea5c361865bcbc4)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:38.980192 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4f9157-126d-4f31-addc-bfa04ca5a1d2 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:39.034206 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-5e4f9157-126d-4f31-addc-bfa04ca5a1d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d9acfa90d624724bea5c361865bcbc4'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:39.044029 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-5e4f9157-126d-4f31-addc-bfa04ca5a1d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d9acfa90d624724bea5c361865bcbc4'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:39.044671 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-5e4f9157-126d-4f31-addc-bfa04ca5a1d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d9acfa90d624724bea5c361865bcbc4'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:39.057137 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-5e4f9157-126d-4f31-addc-bfa04ca5a1d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d9acfa90d624724bea5c361865bcbc4'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:39.057820 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-5e4f9157-126d-4f31-addc-bfa04ca5a1d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d9acfa90d624724bea5c361865bcbc4'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:39.070496 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1408/2797] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:38:38 2022] DELETE /identity/v3/users/9d9acfa90d624724bea5c361865bcbc4 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:38:39.075453 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87362626-132e-4b7e-9d8b-c384e8c43262 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:39.075948 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87362626-132e-4b7e-9d8b-c384e8c43262 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:39.076083 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87362626-132e-4b7e-9d8b-c384e8c43262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:39.102054 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-87362626-132e-4b7e-9d8b-c384e8c43262 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:38:39.103283 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-87362626-132e-4b7e-9d8b-c384e8c43262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:38:39.165274 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1390/2798] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:38:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:38:39.175860 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4f9157-126d-4f31-addc-bfa04ca5a1d2 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:39.177267 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-5e4f9157-126d-4f31-addc-bfa04ca5a1d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:38:39.255105 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4f9157-126d-4f31-addc-bfa04ca5a1d2 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:39.258797 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef2e980-b18f-4834-b080-a615d9dc79e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:39.259402 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2e980-b18f-4834-b080-a615d9dc79e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:39.259711 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2e980-b18f-4834-b080-a615d9dc79e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:39.259983 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2e980-b18f-4834-b080-a615d9dc79e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:39.268814 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef2e980-b18f-4834-b080-a615d9dc79e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:39.270251 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef2e980-b18f-4834-b080-a615d9dc79e4 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:39.280022 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1409/2799] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:38:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:38:39.577613 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87362626-132e-4b7e-9d8b-c384e8c43262 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:39.579402 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-87362626-132e-4b7e-9d8b-c384e8c43262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:38:39.593868 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87362626-132e-4b7e-9d8b-c384e8c43262 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:39.599886 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f1b1f3-28e8-4275-bb02-65fd9777369b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:39.600553 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1b1f3-28e8-4275-bb02-65fd9777369b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:39.600861 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1b1f3-28e8-4275-bb02-65fd9777369b admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:39.601221 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1b1f3-28e8-4275-bb02-65fd9777369b admin admin] PATH_INFO: `/v3/projects/309dcc02443f4b7db6a7e6b5ce4a03f8` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:39.602763 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f1b1f3-28e8-4275-bb02-65fd9777369b admin admin] RBAC: Authorizing `identity:delete_project(project_id=309dcc02443f4b7db6a7e6b5ce4a03f8)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:39.605289 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f1b1f3-28e8-4275-bb02-65fd9777369b admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:39.655998 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-b2f1b1f3-28e8-4275-bb02-65fd9777369b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '309dcc02443f4b7db6a7e6b5ce4a03f8', 'request_id': 'req-b2f1b1f3-28e8-4275-bb02-65fd9777369b'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:39.662205 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-b2f1b1f3-28e8-4275-bb02-65fd9777369b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '309dcc02443f4b7db6a7e6b5ce4a03f8', 'request_id': 'req-b2f1b1f3-28e8-4275-bb02-65fd9777369b'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:39.669143 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-b2f1b1f3-28e8-4275-bb02-65fd9777369b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '309dcc02443f4b7db6a7e6b5ce4a03f8', 'request_id': 'req-b2f1b1f3-28e8-4275-bb02-65fd9777369b'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:39.679755 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-b2f1b1f3-28e8-4275-bb02-65fd9777369b admin admin] The token cache is being invalidate because project 309dcc02443f4b7db6a7e6b5ce4a03f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81447) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:38:39.680044 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-b2f1b1f3-28e8-4275-bb02-65fd9777369b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:39.680661 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-b2f1b1f3-28e8-4275-bb02-65fd9777369b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:39.682194 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1391/2800] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:38:39 2022] DELETE /identity/v3/projects/309dcc02443f4b7db6a7e6b5ce4a03f8 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:38:39.687488 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d36bb-bfd3-4571-8ff0-f8763e1e2e26 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:39.687888 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d36bb-bfd3-4571-8ff0-f8763e1e2e26 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:39.688039 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d36bb-bfd3-4571-8ff0-f8763e1e2e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:39.708064 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-ce9d36bb-bfd3-4571-8ff0-f8763e1e2e26 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:38:39.709539 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-ce9d36bb-bfd3-4571-8ff0-f8763e1e2e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:38:39.721654 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:38:39.773884 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1410/2801] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:38:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:38:39.781738 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bab1ae-995f-4477-9381-1da5bea6f3ef None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:39.782026 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bab1ae-995f-4477-9381-1da5bea6f3ef None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:39.782362 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bab1ae-995f-4477-9381-1da5bea6f3ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:39.802156 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-80bab1ae-995f-4477-9381-1da5bea6f3ef None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:38:39.803350 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-80bab1ae-995f-4477-9381-1da5bea6f3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:38:39.811753 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1392/2802] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:38:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:38:39.816078 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d36bb-bfd3-4571-8ff0-f8763e1e2e26 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:39.826286 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d36bb-bfd3-4571-8ff0-f8763e1e2e26 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:39.830822 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc2f61-20da-4d1d-aa69-5bf38fa75a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:39.831419 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc2f61-20da-4d1d-aa69-5bf38fa75a2d admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:39.831724 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc2f61-20da-4d1d-aa69-5bf38fa75a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:39.831996 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc2f61-20da-4d1d-aa69-5bf38fa75a2d admin admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:39.832671 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc2f61-20da-4d1d-aa69-5bf38fa75a2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:38:39.832976 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc2f61-20da-4d1d-aa69-5bf38fa75a2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:39.834837 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc2f61-20da-4d1d-aa69-5bf38fa75a2d admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:39.846324 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1411/2803] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 30 01:38:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:38:39.850644 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bab1ae-995f-4477-9381-1da5bea6f3ef None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:39.859920 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bab1ae-995f-4477-9381-1da5bea6f3ef None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:39.864508 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11379ad3-d73b-4d70-a8b8-68bbc4d68b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:39.865095 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11379ad3-d73b-4d70-a8b8-68bbc4d68b37 admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:39.865374 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11379ad3-d73b-4d70-a8b8-68bbc4d68b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:39.865644 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11379ad3-d73b-4d70-a8b8-68bbc4d68b37 admin admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:39.866271 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11379ad3-d73b-4d70-a8b8-68bbc4d68b37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:39.868206 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11379ad3-d73b-4d70-a8b8-68bbc4d68b37 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:39.898831 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1393/2804] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:38:39 2022] POST /identity/v3/projects => generated 405 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:38:39.903184 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc2f61-20da-4d1d-aa69-5bf38fa75a2d admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:39.914095 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc2f61-20da-4d1d-aa69-5bf38fa75a2d admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:39.981775 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceccaa8-82c1-4a64-a5c5-90d0788d99c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:39.982396 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceccaa8-82c1-4a64-a5c5-90d0788d99c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:39.983151 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceccaa8-82c1-4a64-a5c5-90d0788d99c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:39.983426 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceccaa8-82c1-4a64-a5c5-90d0788d99c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:39.984226 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceccaa8-82c1-4a64-a5c5-90d0788d99c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:39.986177 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceccaa8-82c1-4a64-a5c5-90d0788d99c5 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:40.013946 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1412/2805] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:38:39 2022] POST /identity/v3/users => generated 303 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:38:40.016909 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11379ad3-d73b-4d70-a8b8-68bbc4d68b37 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:40.027496 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11379ad3-d73b-4d70-a8b8-68bbc4d68b37 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:40.032078 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8165e038-0e43-4b52-8a34-0dc28965d16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:40.032680 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165e038-0e43-4b52-8a34-0dc28965d16e admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:40.032961 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165e038-0e43-4b52-8a34-0dc28965d16e admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:40.033229 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165e038-0e43-4b52-8a34-0dc28965d16e admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:40.033867 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8165e038-0e43-4b52-8a34-0dc28965d16e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:40.035496 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8165e038-0e43-4b52-8a34-0dc28965d16e admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:40.036937 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:38:40.049367 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1394/2806] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:38:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:38:40.054182 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceccaa8-82c1-4a64-a5c5-90d0788d99c5 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:40.065322 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceccaa8-82c1-4a64-a5c5-90d0788d99c5 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:40.070192 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55435c6a-8623-40f7-a873-e7283bedb74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:40.070804 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55435c6a-8623-40f7-a873-e7283bedb74c admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:40.071089 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55435c6a-8623-40f7-a873-e7283bedb74c admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:40.071366 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55435c6a-8623-40f7-a873-e7283bedb74c admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:40.072058 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55435c6a-8623-40f7-a873-e7283bedb74c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:40.073703 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55435c6a-8623-40f7-a873-e7283bedb74c admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:40.085982 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1413/2807] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:38:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:38:40.090450 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8165e038-0e43-4b52-8a34-0dc28965d16e admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:40.100782 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8165e038-0e43-4b52-8a34-0dc28965d16e admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:40.106073 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a17ec0-7730-4bd9-a500-5b9a37c0d58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:40.106720 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a17ec0-7730-4bd9-a500-5b9a37c0d58c admin admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:40.107000 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a17ec0-7730-4bd9-a500-5b9a37c0d58c admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:40.107268 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a17ec0-7730-4bd9-a500-5b9a37c0d58c admin admin] PATH_INFO: `/v3/projects/f5a6fa43878b47e0973b7de4aacab6be/users/9eee9f6869214d118dcc762b0ac0dff9/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:40.125984 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a17ec0-7730-4bd9-a500-5b9a37c0d58c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5a6fa43878b47e0973b7de4aacab6be, user_id=9eee9f6869214d118dcc762b0ac0dff9, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:40.128695 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a17ec0-7730-4bd9-a500-5b9a37c0d58c admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:40.143814 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1395/2808] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:38:40 2022] PUT /identity/v3/projects/f5a6fa43878b47e0973b7de4aacab6be/users/9eee9f6869214d118dcc762b0ac0dff9/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:38:40.154238 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d993e2b-a31c-4226-8c98-c639b8e3c425 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:40.154530 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d993e2b-a31c-4226-8c98-c639b8e3c425 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:40.154803 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d993e2b-a31c-4226-8c98-c639b8e3c425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:40.186077 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-2d993e2b-a31c-4226-8c98-c639b8e3c425 None None] MFA Rules not processed for user `9eee9f6869214d118dcc762b0ac0dff9`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:38:40.187220 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-2d993e2b-a31c-4226-8c98-c639b8e3c425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:38:40.254626 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1414/2809] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:38:40 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:38:40.259132 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a17ec0-7730-4bd9-a500-5b9a37c0d58c admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:40.321995 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a17ec0-7730-4bd9-a500-5b9a37c0d58c admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:40.326834 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeae03d-3c9f-41f8-8af4-052b7f47478b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:40.327459 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeae03d-3c9f-41f8-8af4-052b7f47478b admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:40.327747 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeae03d-3c9f-41f8-8af4-052b7f47478b admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:40.328018 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeae03d-3c9f-41f8-8af4-052b7f47478b admin admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:40.328649 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeae03d-3c9f-41f8-8af4-052b7f47478b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:40.330546 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeae03d-3c9f-41f8-8af4-052b7f47478b admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:40.358385 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1396/2810] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:38:40 2022] POST /identity/v3/projects => generated 403 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:38:40.362416 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d993e2b-a31c-4226-8c98-c639b8e3c425 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:40.373999 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d993e2b-a31c-4226-8c98-c639b8e3c425 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:40.382637 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:38:40.431152 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4fd202-07f4-4654-bda9-3f74d9f8341f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:40.431788 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4fd202-07f4-4654-bda9-3f74d9f8341f admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:40.432071 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4fd202-07f4-4654-bda9-3f74d9f8341f admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:40.432331 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4fd202-07f4-4654-bda9-3f74d9f8341f admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:40.432976 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4fd202-07f4-4654-bda9-3f74d9f8341f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:40.435540 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4fd202-07f4-4654-bda9-3f74d9f8341f admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:40.456518 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1415/2811] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:38:40 2022] POST /identity/v3/users => generated 308 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:38:40.460721 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeae03d-3c9f-41f8-8af4-052b7f47478b admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:40.472283 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeae03d-3c9f-41f8-8af4-052b7f47478b admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:40.477001 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc2dc5-42f0-4493-9c36-48ce1dec6d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:40.477594 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc2dc5-42f0-4493-9c36-48ce1dec6d78 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:40.477878 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc2dc5-42f0-4493-9c36-48ce1dec6d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:40.478146 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc2dc5-42f0-4493-9c36-48ce1dec6d78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:40.478783 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccc2dc5-42f0-4493-9c36-48ce1dec6d78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:40.480988 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccc2dc5-42f0-4493-9c36-48ce1dec6d78 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:40.491727 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1397/2812] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:38:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:38:40.495995 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4fd202-07f4-4654-bda9-3f74d9f8341f admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:40.505946 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4fd202-07f4-4654-bda9-3f74d9f8341f admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:40.510602 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8655a6-8450-4780-b202-f03575ddc35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:40.511242 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8655a6-8450-4780-b202-f03575ddc35d admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:40.511575 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8655a6-8450-4780-b202-f03575ddc35d admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:40.511854 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8655a6-8450-4780-b202-f03575ddc35d admin admin] PATH_INFO: `/v3/projects/a858299ffc684beb91f8a9f0ba4fa770/users/f3bf6a310be04b39b1928a43e22385f4/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:40.526321 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8655a6-8450-4780-b202-f03575ddc35d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a858299ffc684beb91f8a9f0ba4fa770, user_id=f3bf6a310be04b39b1928a43e22385f4, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:40.529524 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8655a6-8450-4780-b202-f03575ddc35d admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:40.542782 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1416/2813] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:38:40 2022] PUT /identity/v3/projects/a858299ffc684beb91f8a9f0ba4fa770/users/f3bf6a310be04b39b1928a43e22385f4/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:38:40.547554 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc2dc5-42f0-4493-9c36-48ce1dec6d78 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:40.557922 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc2dc5-42f0-4493-9c36-48ce1dec6d78 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:40.616051 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9929dd-b032-46c1-9cc9-e7a272fdd342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:40.616670 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9929dd-b032-46c1-9cc9-e7a272fdd342 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:40.616952 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9929dd-b032-46c1-9cc9-e7a272fdd342 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:40.617228 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9929dd-b032-46c1-9cc9-e7a272fdd342 admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:40.618204 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9929dd-b032-46c1-9cc9-e7a272fdd342 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:40.623481 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9929dd-b032-46c1-9cc9-e7a272fdd342 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:40.629398 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1398/2814] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:38:40 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:38:40.633953 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8655a6-8450-4780-b202-f03575ddc35d admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:40.644350 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8655a6-8450-4780-b202-f03575ddc35d admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:40.648986 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d2719-21b8-4484-bf2b-e0ee34de7b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:40.649638 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d2719-21b8-4484-bf2b-e0ee34de7b10 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:40.649922 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d2719-21b8-4484-bf2b-e0ee34de7b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:40.650199 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d2719-21b8-4484-bf2b-e0ee34de7b10 admin admin] PATH_INFO: `/v3/projects/a858299ffc684beb91f8a9f0ba4fa770/users/f3bf6a310be04b39b1928a43e22385f4/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:40.652754 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507d2719-21b8-4484-bf2b-e0ee34de7b10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a858299ffc684beb91f8a9f0ba4fa770, user_id=f3bf6a310be04b39b1928a43e22385f4, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:40.655523 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507d2719-21b8-4484-bf2b-e0ee34de7b10 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:40.665772 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1417/2815] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:38:40 2022] PUT /identity/v3/projects/a858299ffc684beb91f8a9f0ba4fa770/users/f3bf6a310be04b39b1928a43e22385f4/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:38:40.677932 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf602e-fb1d-404c-880d-f17c1fe90377 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:40.678217 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf602e-fb1d-404c-880d-f17c1fe90377 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:40.678494 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf602e-fb1d-404c-880d-f17c1fe90377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:40.706865 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-a5bf602e-fb1d-404c-880d-f17c1fe90377 None None] MFA Rules not processed for user `f3bf6a310be04b39b1928a43e22385f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:38:40.707997 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-a5bf602e-fb1d-404c-880d-f17c1fe90377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:38:40.739253 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:38:40.779171 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1399/2816] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:38:40 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:38:40.789754 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d2719-21b8-4484-bf2b-e0ee34de7b10 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:40.791510 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-507d2719-21b8-4484-bf2b-e0ee34de7b10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:38:40.869038 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d2719-21b8-4484-bf2b-e0ee34de7b10 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:40.873588 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c9c6a-8eb7-4428-807b-dd45041815a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:40.874186 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c9c6a-8eb7-4428-807b-dd45041815a4 service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:40.874467 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c9c6a-8eb7-4428-807b-dd45041815a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:40.874740 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c9c6a-8eb7-4428-807b-dd45041815a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:40.883661 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7c9c6a-8eb7-4428-807b-dd45041815a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:40.885099 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7c9c6a-8eb7-4428-807b-dd45041815a4 service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:40.894882 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1418/2817] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:38:40 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:38:41.044902 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bf602e-fb1d-404c-880d-f17c1fe90377 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:41.111448 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bf602e-fb1d-404c-880d-f17c1fe90377 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:41.116488 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfbc513-3e00-42c0-8c1a-328b6d94ef80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:41.117120 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbc513-3e00-42c0-8c1a-328b6d94ef80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:41.117401 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbc513-3e00-42c0-8c1a-328b6d94ef80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:41.117673 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbc513-3e00-42c0-8c1a-328b6d94ef80 admin admin] PATH_INFO: `/v3/users/9eee9f6869214d118dcc762b0ac0dff9` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:41.118812 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfbc513-3e00-42c0-8c1a-328b6d94ef80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9eee9f6869214d118dcc762b0ac0dff9)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:41.120754 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfbc513-3e00-42c0-8c1a-328b6d94ef80 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:41.172441 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-3bfbc513-3e00-42c0-8c1a-328b6d94ef80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9eee9f6869214d118dcc762b0ac0dff9'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:41.180520 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-3bfbc513-3e00-42c0-8c1a-328b6d94ef80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9eee9f6869214d118dcc762b0ac0dff9'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:41.181200 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-3bfbc513-3e00-42c0-8c1a-328b6d94ef80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9eee9f6869214d118dcc762b0ac0dff9'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:41.181790 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-3bfbc513-3e00-42c0-8c1a-328b6d94ef80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9eee9f6869214d118dcc762b0ac0dff9'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:41.194452 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-3bfbc513-3e00-42c0-8c1a-328b6d94ef80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9eee9f6869214d118dcc762b0ac0dff9'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:41.208926 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1400/2818] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:38:41 2022] DELETE /identity/v3/users/9eee9f6869214d118dcc762b0ac0dff9 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:38:41.218920 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56445c-ec80-461b-a8cc-b9e60aed2159 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:41.219505 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56445c-ec80-461b-a8cc-b9e60aed2159 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:41.219505 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56445c-ec80-461b-a8cc-b9e60aed2159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:41.239957 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-cd56445c-ec80-461b-a8cc-b9e60aed2159 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:38:41.241157 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-cd56445c-ec80-461b-a8cc-b9e60aed2159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:38:41.291398 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:38:41.308214 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1419/2819] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:38:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:38:41.317951 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfbc513-3e00-42c0-8c1a-328b6d94ef80 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:41.319687 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-3bfbc513-3e00-42c0-8c1a-328b6d94ef80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:38:41.401002 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:38:41.408788 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfbc513-3e00-42c0-8c1a-328b6d94ef80 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:41.413873 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fc2e58-2044-44d5-8d91-b208f11d98fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:41.414492 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc2e58-2044-44d5-8d91-b208f11d98fa service neutron] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:41.414770 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc2e58-2044-44d5-8d91-b208f11d98fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:41.415043 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc2e58-2044-44d5-8d91-b208f11d98fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:41.425906 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fc2e58-2044-44d5-8d91-b208f11d98fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:41.428746 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fc2e58-2044-44d5-8d91-b208f11d98fa service neutron] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:41.438876 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1401/2820] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:38:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:38:41.717635 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd56445c-ec80-461b-a8cc-b9e60aed2159 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:41.719068 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-cd56445c-ec80-461b-a8cc-b9e60aed2159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:38:41.731124 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd56445c-ec80-461b-a8cc-b9e60aed2159 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:41.736692 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38cba0f-e735-403b-8600-220498426bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:41.737345 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38cba0f-e735-403b-8600-220498426bdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:41.737621 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38cba0f-e735-403b-8600-220498426bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:41.737894 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38cba0f-e735-403b-8600-220498426bdb admin admin] PATH_INFO: `/v3/projects/f5a6fa43878b47e0973b7de4aacab6be` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:41.739212 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38cba0f-e735-403b-8600-220498426bdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5a6fa43878b47e0973b7de4aacab6be)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:41.741224 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38cba0f-e735-403b-8600-220498426bdb admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:41.798748 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-a38cba0f-e735-403b-8600-220498426bdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5a6fa43878b47e0973b7de4aacab6be', 'request_id': 'req-a38cba0f-e735-403b-8600-220498426bdb'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:41.805551 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-a38cba0f-e735-403b-8600-220498426bdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5a6fa43878b47e0973b7de4aacab6be', 'request_id': 'req-a38cba0f-e735-403b-8600-220498426bdb'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:41.814345 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-a38cba0f-e735-403b-8600-220498426bdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5a6fa43878b47e0973b7de4aacab6be', 'request_id': 'req-a38cba0f-e735-403b-8600-220498426bdb'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:41.827925 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-a38cba0f-e735-403b-8600-220498426bdb admin admin] The token cache is being invalidate because project f5a6fa43878b47e0973b7de4aacab6be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:38:41.828272 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-a38cba0f-e735-403b-8600-220498426bdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:41.829005 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-a38cba0f-e735-403b-8600-220498426bdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:41.834000 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1420/2821] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:38:41 2022] DELETE /identity/v3/projects/f5a6fa43878b47e0973b7de4aacab6be => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:38:41.835210 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fc2e58-2044-44d5-8d91-b208f11d98fa service neutron] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:41.847154 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fc2e58-2044-44d5-8d91-b208f11d98fa service neutron] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:41.914925 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa284b58-da90-4715-a4fb-f02d6419eb66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:41.916034 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa284b58-da90-4715-a4fb-f02d6419eb66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:41.916478 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa284b58-da90-4715-a4fb-f02d6419eb66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:41.916921 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa284b58-da90-4715-a4fb-f02d6419eb66 admin admin] PATH_INFO: `/v3/users/f3bf6a310be04b39b1928a43e22385f4` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:41.918713 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa284b58-da90-4715-a4fb-f02d6419eb66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3bf6a310be04b39b1928a43e22385f4)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:41.921803 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa284b58-da90-4715-a4fb-f02d6419eb66 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:41.974875 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-aa284b58-da90-4715-a4fb-f02d6419eb66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3bf6a310be04b39b1928a43e22385f4'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:41.983655 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-aa284b58-da90-4715-a4fb-f02d6419eb66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3bf6a310be04b39b1928a43e22385f4'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:41.984296 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-aa284b58-da90-4715-a4fb-f02d6419eb66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3bf6a310be04b39b1928a43e22385f4'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:41.985002 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-aa284b58-da90-4715-a4fb-f02d6419eb66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3bf6a310be04b39b1928a43e22385f4'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:41.998206 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-aa284b58-da90-4715-a4fb-f02d6419eb66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3bf6a310be04b39b1928a43e22385f4'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:42.010459 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1402/2822] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:38:41 2022] DELETE /identity/v3/users/f3bf6a310be04b39b1928a43e22385f4 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:38:42.295943 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38cba0f-e735-403b-8600-220498426bdb admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:42.297541 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-a38cba0f-e735-403b-8600-220498426bdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:38:42.312014 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38cba0f-e735-403b-8600-220498426bdb admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:42.390400 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ac41e9-76b9-4504-b889-6e1d24e55c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:42.391150 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac41e9-76b9-4504-b889-6e1d24e55c2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:42.391601 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac41e9-76b9-4504-b889-6e1d24e55c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:42.392043 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac41e9-76b9-4504-b889-6e1d24e55c2f admin admin] PATH_INFO: `/v3/projects/a858299ffc684beb91f8a9f0ba4fa770` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:42.393954 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ac41e9-76b9-4504-b889-6e1d24e55c2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a858299ffc684beb91f8a9f0ba4fa770)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:42.397134 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ac41e9-76b9-4504-b889-6e1d24e55c2f admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:42.455296 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-57ac41e9-76b9-4504-b889-6e1d24e55c2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a858299ffc684beb91f8a9f0ba4fa770', 'request_id': 'req-57ac41e9-76b9-4504-b889-6e1d24e55c2f'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:42.462032 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-57ac41e9-76b9-4504-b889-6e1d24e55c2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a858299ffc684beb91f8a9f0ba4fa770', 'request_id': 'req-57ac41e9-76b9-4504-b889-6e1d24e55c2f'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:42.469985 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-57ac41e9-76b9-4504-b889-6e1d24e55c2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a858299ffc684beb91f8a9f0ba4fa770', 'request_id': 'req-57ac41e9-76b9-4504-b889-6e1d24e55c2f'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:42.482894 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-57ac41e9-76b9-4504-b889-6e1d24e55c2f admin admin] The token cache is being invalidate because project a858299ffc684beb91f8a9f0ba4fa770 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:38:42.483181 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-57ac41e9-76b9-4504-b889-6e1d24e55c2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:42.483855 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-57ac41e9-76b9-4504-b889-6e1d24e55c2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:42.485350 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1421/2823] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:38:42 2022] DELETE /identity/v3/projects/a858299ffc684beb91f8a9f0ba4fa770 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:38:42.490274 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7769b-d475-49ad-be95-8b0270485777 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:42.490802 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7769b-d475-49ad-be95-8b0270485777 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:42.490802 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7769b-d475-49ad-be95-8b0270485777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:42.512214 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-99c7769b-d475-49ad-be95-8b0270485777 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:38:42.513454 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-99c7769b-d475-49ad-be95-8b0270485777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:38:42.578762 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1403/2824] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:38:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:38:42.588034 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58efdc-19fd-40e9-961e-ae6a1fcf4ead None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:42.588324 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58efdc-19fd-40e9-961e-ae6a1fcf4ead None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:42.588602 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58efdc-19fd-40e9-961e-ae6a1fcf4ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:42.596281 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:38:42.612069 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-9d58efdc-19fd-40e9-961e-ae6a1fcf4ead None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:38:42.613304 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-9d58efdc-19fd-40e9-961e-ae6a1fcf4ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:38:42.621948 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1422/2825] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:38:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:38:42.626308 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c7769b-d475-49ad-be95-8b0270485777 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:42.635939 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c7769b-d475-49ad-be95-8b0270485777 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:42.640605 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b59f3ec-01b1-456b-a101-7d6ea4e5361e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:42.641151 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59f3ec-01b1-456b-a101-7d6ea4e5361e admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:42.641430 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59f3ec-01b1-456b-a101-7d6ea4e5361e admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:42.641700 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59f3ec-01b1-456b-a101-7d6ea4e5361e admin admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:42.642344 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b59f3ec-01b1-456b-a101-7d6ea4e5361e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:38:42.642644 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b59f3ec-01b1-456b-a101-7d6ea4e5361e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:42.644268 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b59f3ec-01b1-456b-a101-7d6ea4e5361e admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:42.646594 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:38:42.658172 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1404/2826] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 30 01:38:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:38:42.662672 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d58efdc-19fd-40e9-961e-ae6a1fcf4ead None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:42.673865 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d58efdc-19fd-40e9-961e-ae6a1fcf4ead None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:42.678740 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0f793-3dbb-44d6-8516-34d8a0117b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:42.679458 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0f793-3dbb-44d6-8516-34d8a0117b25 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:42.679738 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0f793-3dbb-44d6-8516-34d8a0117b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:42.680008 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0f793-3dbb-44d6-8516-34d8a0117b25 admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:42.680651 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd0f793-3dbb-44d6-8516-34d8a0117b25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:42.682556 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd0f793-3dbb-44d6-8516-34d8a0117b25 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:42.718517 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1423/2827] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:38:42 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:38:42.722850 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b59f3ec-01b1-456b-a101-7d6ea4e5361e admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:42.733838 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b59f3ec-01b1-456b-a101-7d6ea4e5361e admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:42.795147 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20604745-ad1e-4d9c-adbd-560fcb65b309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:42.795800 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20604745-ad1e-4d9c-adbd-560fcb65b309 admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:42.796082 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20604745-ad1e-4d9c-adbd-560fcb65b309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:42.796475 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20604745-ad1e-4d9c-adbd-560fcb65b309 admin admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:42.797616 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20604745-ad1e-4d9c-adbd-560fcb65b309 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:42.799941 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20604745-ad1e-4d9c-adbd-560fcb65b309 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:42.822355 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1405/2828] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:38:42 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:38:42.826514 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0f793-3dbb-44d6-8516-34d8a0117b25 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:42.838021 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0f793-3dbb-44d6-8516-34d8a0117b25 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:42.847736 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d7bd8-2889-483b-85bb-1c6a66bf2da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:42.848351 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d7bd8-2889-483b-85bb-1c6a66bf2da0 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:42.848625 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d7bd8-2889-483b-85bb-1c6a66bf2da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:42.848895 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d7bd8-2889-483b-85bb-1c6a66bf2da0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:42.849540 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152d7bd8-2889-483b-85bb-1c6a66bf2da0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:42.851146 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152d7bd8-2889-483b-85bb-1c6a66bf2da0 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:42.863380 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1424/2829] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:38:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:38:42.867587 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20604745-ad1e-4d9c-adbd-560fcb65b309 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:42.878006 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20604745-ad1e-4d9c-adbd-560fcb65b309 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:42.882621 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b33087-0504-4668-bbe6-85ba244e8467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:42.883265 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b33087-0504-4668-bbe6-85ba244e8467 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:42.883578 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b33087-0504-4668-bbe6-85ba244e8467 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:42.883851 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b33087-0504-4668-bbe6-85ba244e8467 admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:42.884495 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b33087-0504-4668-bbe6-85ba244e8467 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:42.886081 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b33087-0504-4668-bbe6-85ba244e8467 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:42.896715 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1406/2830] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:38:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:38:42.900738 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d7bd8-2889-483b-85bb-1c6a66bf2da0 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:42.911153 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d7bd8-2889-483b-85bb-1c6a66bf2da0 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:42.916036 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d3a7f7-0826-4c1d-ac3b-f2a53ceaea73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:42.916678 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3a7f7-0826-4c1d-ac3b-f2a53ceaea73 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:42.916954 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3a7f7-0826-4c1d-ac3b-f2a53ceaea73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:42.917217 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3a7f7-0826-4c1d-ac3b-f2a53ceaea73 admin admin] PATH_INFO: `/v3/projects/2d2a583e303c47b59f42c1b9b67990a9/users/9e41f420af6c4ad09e2dea9a44189bfb/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:42.932142 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d3a7f7-0826-4c1d-ac3b-f2a53ceaea73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d2a583e303c47b59f42c1b9b67990a9, user_id=9e41f420af6c4ad09e2dea9a44189bfb, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:42.934795 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d3a7f7-0826-4c1d-ac3b-f2a53ceaea73 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:42.947415 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1425/2831] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:38:42 2022] PUT /identity/v3/projects/2d2a583e303c47b59f42c1b9b67990a9/users/9e41f420af6c4ad09e2dea9a44189bfb/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:38:42.958991 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c9a3d-a0a3-4924-a693-348eae9fcaa5 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:42.959277 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c9a3d-a0a3-4924-a693-348eae9fcaa5 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:42.959585 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c9a3d-a0a3-4924-a693-348eae9fcaa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:42.988835 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-a36c9a3d-a0a3-4924-a693-348eae9fcaa5 None None] MFA Rules not processed for user `9e41f420af6c4ad09e2dea9a44189bfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:38:42.990035 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-a36c9a3d-a0a3-4924-a693-348eae9fcaa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:38:43.053807 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1407/2832] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:38:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:38:43.058251 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d3a7f7-0826-4c1d-ac3b-f2a53ceaea73 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:43.124495 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d3a7f7-0826-4c1d-ac3b-f2a53ceaea73 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:43.129153 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa26a4ea-5c14-4d8a-ac91-36e4b06f6990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:43.129752 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa26a4ea-5c14-4d8a-ac91-36e4b06f6990 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:43.130033 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa26a4ea-5c14-4d8a-ac91-36e4b06f6990 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:43.130305 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa26a4ea-5c14-4d8a-ac91-36e4b06f6990 admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:43.130938 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa26a4ea-5c14-4d8a-ac91-36e4b06f6990 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:43.132866 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa26a4ea-5c14-4d8a-ac91-36e4b06f6990 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:43.158500 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1426/2833] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:38:43 2022] POST /identity/v3/projects => generated 387 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:38:43.162658 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c9a3d-a0a3-4924-a693-348eae9fcaa5 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:43.173991 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c9a3d-a0a3-4924-a693-348eae9fcaa5 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:43.231831 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf5feca-778a-4360-8577-75b8f889d0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:43.232437 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5feca-778a-4360-8577-75b8f889d0ad admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:43.232713 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5feca-778a-4360-8577-75b8f889d0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:43.232982 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5feca-778a-4360-8577-75b8f889d0ad admin admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:43.233615 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf5feca-778a-4360-8577-75b8f889d0ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:43.235546 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf5feca-778a-4360-8577-75b8f889d0ad admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:43.245307 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:38:43.259951 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1408/2834] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:38:43 2022] POST /identity/v3/users => generated 300 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:38:43.263550 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa26a4ea-5c14-4d8a-ac91-36e4b06f6990 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:43.273907 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa26a4ea-5c14-4d8a-ac91-36e4b06f6990 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:43.279274 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e55ef88-e413-479d-ab9c-a0b60980354c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:43.279899 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e55ef88-e413-479d-ab9c-a0b60980354c admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:43.280184 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e55ef88-e413-479d-ab9c-a0b60980354c admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:43.280460 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e55ef88-e413-479d-ab9c-a0b60980354c admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:43.281441 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e55ef88-e413-479d-ab9c-a0b60980354c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:43.283053 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e55ef88-e413-479d-ab9c-a0b60980354c admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:43.293521 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1427/2835] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:38:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:38:43.297567 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf5feca-778a-4360-8577-75b8f889d0ad admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:43.307372 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf5feca-778a-4360-8577-75b8f889d0ad admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:43.312204 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9588f-d703-4866-9e2c-fe90b7fbfccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:43.312844 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9588f-d703-4866-9e2c-fe90b7fbfccd admin admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:43.313123 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9588f-d703-4866-9e2c-fe90b7fbfccd admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:43.313395 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9588f-d703-4866-9e2c-fe90b7fbfccd admin admin] PATH_INFO: `/v3/projects/325beb5c6708472c867e94c67911c5f1/users/d0b1d781c8c64df1aa697e36fda86a0f/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:43.328394 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c9588f-d703-4866-9e2c-fe90b7fbfccd admin admin] RBAC: Authorizing `identity:create_grant(project_id=325beb5c6708472c867e94c67911c5f1, user_id=d0b1d781c8c64df1aa697e36fda86a0f, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:43.331047 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c9588f-d703-4866-9e2c-fe90b7fbfccd admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:43.344340 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1409/2836] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:38:43 2022] PUT /identity/v3/projects/325beb5c6708472c867e94c67911c5f1/users/d0b1d781c8c64df1aa697e36fda86a0f/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:38:43.348199 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e55ef88-e413-479d-ab9c-a0b60980354c admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:43.358211 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e55ef88-e413-479d-ab9c-a0b60980354c admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:43.425202 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c969f293-d061-4164-bd1c-ff0a072dda85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:43.425718 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969f293-d061-4164-bd1c-ff0a072dda85 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:43.425999 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969f293-d061-4164-bd1c-ff0a072dda85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:43.426268 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969f293-d061-4164-bd1c-ff0a072dda85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:43.426900 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c969f293-d061-4164-bd1c-ff0a072dda85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:43.428552 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c969f293-d061-4164-bd1c-ff0a072dda85 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:43.438415 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1428/2837] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:38:43 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:38:43.442578 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9588f-d703-4866-9e2c-fe90b7fbfccd admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:43.453277 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9588f-d703-4866-9e2c-fe90b7fbfccd admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:43.458062 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e35a3-95de-482d-b7b7-f428cf357c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:43.459000 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e35a3-95de-482d-b7b7-f428cf357c56 admin admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:43.459274 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e35a3-95de-482d-b7b7-f428cf357c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:43.459579 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e35a3-95de-482d-b7b7-f428cf357c56 admin admin] PATH_INFO: `/v3/projects/325beb5c6708472c867e94c67911c5f1/users/d0b1d781c8c64df1aa697e36fda86a0f/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:43.461481 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234e35a3-95de-482d-b7b7-f428cf357c56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=325beb5c6708472c867e94c67911c5f1, user_id=d0b1d781c8c64df1aa697e36fda86a0f, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:43.464184 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234e35a3-95de-482d-b7b7-f428cf357c56 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:43.474372 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1410/2838] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:38:43 2022] PUT /identity/v3/projects/325beb5c6708472c867e94c67911c5f1/users/d0b1d781c8c64df1aa697e36fda86a0f/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:38:43.484467 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85792ed-d826-44bf-b121-8c649e19bdf0 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:43.484752 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85792ed-d826-44bf-b121-8c649e19bdf0 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:43.485024 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85792ed-d826-44bf-b121-8c649e19bdf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:43.504918 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:38:43.515846 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-b85792ed-d826-44bf-b121-8c649e19bdf0 None None] MFA Rules not processed for user `d0b1d781c8c64df1aa697e36fda86a0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:38:43.517056 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-b85792ed-d826-44bf-b121-8c649e19bdf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:38:43.584214 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1429/2839] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:38:43 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:38:43.595470 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e35a3-95de-482d-b7b7-f428cf357c56 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:43.599220 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-234e35a3-95de-482d-b7b7-f428cf357c56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:38:43.655999 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e35a3-95de-482d-b7b7-f428cf357c56 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:43.659635 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7283708-f1cc-457d-b992-a195e71bfaf4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:43.660233 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7283708-f1cc-457d-b992-a195e71bfaf4 service cinder] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:43.660512 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7283708-f1cc-457d-b992-a195e71bfaf4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:43.660785 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7283708-f1cc-457d-b992-a195e71bfaf4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:43.669639 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7283708-f1cc-457d-b992-a195e71bfaf4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:43.671061 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7283708-f1cc-457d-b992-a195e71bfaf4 service cinder] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:43.680364 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1411/2840] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:38:43 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:38:43.744150 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85792ed-d826-44bf-b121-8c649e19bdf0 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:43.805065 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85792ed-d826-44bf-b121-8c649e19bdf0 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:43.810125 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955de009-ec36-41b5-8e9f-e35f659d6b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:43.810746 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955de009-ec36-41b5-8e9f-e35f659d6b3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:43.811030 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955de009-ec36-41b5-8e9f-e35f659d6b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:43.811307 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955de009-ec36-41b5-8e9f-e35f659d6b3c admin admin] PATH_INFO: `/v3/users/9e41f420af6c4ad09e2dea9a44189bfb` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:43.812499 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955de009-ec36-41b5-8e9f-e35f659d6b3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e41f420af6c4ad09e2dea9a44189bfb)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:43.814726 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955de009-ec36-41b5-8e9f-e35f659d6b3c admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:43.861102 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-955de009-ec36-41b5-8e9f-e35f659d6b3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e41f420af6c4ad09e2dea9a44189bfb'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:43.868673 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-955de009-ec36-41b5-8e9f-e35f659d6b3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e41f420af6c4ad09e2dea9a44189bfb'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:43.869367 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-955de009-ec36-41b5-8e9f-e35f659d6b3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e41f420af6c4ad09e2dea9a44189bfb'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:43.882669 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-955de009-ec36-41b5-8e9f-e35f659d6b3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e41f420af6c4ad09e2dea9a44189bfb'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:43.883305 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-955de009-ec36-41b5-8e9f-e35f659d6b3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e41f420af6c4ad09e2dea9a44189bfb'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:43.895470 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1430/2841] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:38:43 2022] DELETE /identity/v3/users/9e41f420af6c4ad09e2dea9a44189bfb => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:38:43.900060 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff1c47-95df-4331-a347-8931e4f03081 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:43.900347 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff1c47-95df-4331-a347-8931e4f03081 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:43.900628 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff1c47-95df-4331-a347-8931e4f03081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:43.919984 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-b5ff1c47-95df-4331-a347-8931e4f03081 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:38:43.921243 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-b5ff1c47-95df-4331-a347-8931e4f03081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:38:43.979899 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1412/2842] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:38:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:38:43.990039 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955de009-ec36-41b5-8e9f-e35f659d6b3c admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:43.991571 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-955de009-ec36-41b5-8e9f-e35f659d6b3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:38:44.006303 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:38:44.050947 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955de009-ec36-41b5-8e9f-e35f659d6b3c admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:44.055311 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5e49fa-2bd8-422d-9eaa-b670a22e91f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:44.056020 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e49fa-2bd8-422d-9eaa-b670a22e91f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:44.056327 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e49fa-2bd8-422d-9eaa-b670a22e91f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:44.056609 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e49fa-2bd8-422d-9eaa-b670a22e91f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:44.066352 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5e49fa-2bd8-422d-9eaa-b670a22e91f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:44.067836 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5e49fa-2bd8-422d-9eaa-b670a22e91f3 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:44.077491 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1431/2843] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:38:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:38:44.336096 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ff1c47-95df-4331-a347-8931e4f03081 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:44.337516 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-b5ff1c47-95df-4331-a347-8931e4f03081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:38:44.349783 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ff1c47-95df-4331-a347-8931e4f03081 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:44.355146 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca8d52e-4b1f-4d86-8521-86133bba245d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:44.356465 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8d52e-4b1f-4d86-8521-86133bba245d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:44.356806 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8d52e-4b1f-4d86-8521-86133bba245d admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:44.357142 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8d52e-4b1f-4d86-8521-86133bba245d admin admin] PATH_INFO: `/v3/projects/2d2a583e303c47b59f42c1b9b67990a9` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:44.358368 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca8d52e-4b1f-4d86-8521-86133bba245d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d2a583e303c47b59f42c1b9b67990a9)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:44.360577 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca8d52e-4b1f-4d86-8521-86133bba245d admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:44.414177 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-bca8d52e-4b1f-4d86-8521-86133bba245d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d2a583e303c47b59f42c1b9b67990a9', 'request_id': 'req-bca8d52e-4b1f-4d86-8521-86133bba245d'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:44.423044 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-bca8d52e-4b1f-4d86-8521-86133bba245d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d2a583e303c47b59f42c1b9b67990a9', 'request_id': 'req-bca8d52e-4b1f-4d86-8521-86133bba245d'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:44.426261 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:INSERT=3,keystone:SELECT=93,keystone:DELETE=4 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:38:44.432087 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-bca8d52e-4b1f-4d86-8521-86133bba245d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d2a583e303c47b59f42c1b9b67990a9', 'request_id': 'req-bca8d52e-4b1f-4d86-8521-86133bba245d'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:44.443476 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-bca8d52e-4b1f-4d86-8521-86133bba245d admin admin] The token cache is being invalidate because project 2d2a583e303c47b59f42c1b9b67990a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81447) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:38:44.443772 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-bca8d52e-4b1f-4d86-8521-86133bba245d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:44.444402 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-bca8d52e-4b1f-4d86-8521-86133bba245d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:44.446025 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1413/2844] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:38:44 2022] DELETE /identity/v3/projects/2d2a583e303c47b59f42c1b9b67990a9 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:38:44.450067 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5e49fa-2bd8-422d-9eaa-b670a22e91f3 service neutron] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:44.460283 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5e49fa-2bd8-422d-9eaa-b670a22e91f3 service neutron] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:44.516909 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474103e0-a5fc-47e1-9a38-847323f78eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:44.517449 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474103e0-a5fc-47e1-9a38-847323f78eba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:44.517725 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474103e0-a5fc-47e1-9a38-847323f78eba admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:44.517993 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474103e0-a5fc-47e1-9a38-847323f78eba admin admin] PATH_INFO: `/v3/users/d0b1d781c8c64df1aa697e36fda86a0f` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:44.519107 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474103e0-a5fc-47e1-9a38-847323f78eba admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0b1d781c8c64df1aa697e36fda86a0f)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:44.521088 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474103e0-a5fc-47e1-9a38-847323f78eba admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:44.565386 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-474103e0-a5fc-47e1-9a38-847323f78eba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0b1d781c8c64df1aa697e36fda86a0f'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:44.575898 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-474103e0-a5fc-47e1-9a38-847323f78eba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0b1d781c8c64df1aa697e36fda86a0f'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:44.576536 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-474103e0-a5fc-47e1-9a38-847323f78eba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0b1d781c8c64df1aa697e36fda86a0f'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:44.593149 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-474103e0-a5fc-47e1-9a38-847323f78eba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0b1d781c8c64df1aa697e36fda86a0f'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:44.593846 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-474103e0-a5fc-47e1-9a38-847323f78eba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0b1d781c8c64df1aa697e36fda86a0f'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:44.606469 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1432/2845] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:38:44 2022] DELETE /identity/v3/users/d0b1d781c8c64df1aa697e36fda86a0f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:38:44.908200 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca8d52e-4b1f-4d86-8521-86133bba245d admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:44.909727 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-bca8d52e-4b1f-4d86-8521-86133bba245d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:38:44.923081 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca8d52e-4b1f-4d86-8521-86133bba245d admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:44.984421 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a77c9b-5229-4e17-afd6-66442c36b15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:44.985053 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a77c9b-5229-4e17-afd6-66442c36b15a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:44.985332 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a77c9b-5229-4e17-afd6-66442c36b15a admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:44.985602 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a77c9b-5229-4e17-afd6-66442c36b15a admin admin] PATH_INFO: `/v3/projects/325beb5c6708472c867e94c67911c5f1` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:44.986722 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a77c9b-5229-4e17-afd6-66442c36b15a admin admin] RBAC: Authorizing `identity:delete_project(project_id=325beb5c6708472c867e94c67911c5f1)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:44.988746 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a77c9b-5229-4e17-afd6-66442c36b15a admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:45.035299 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-b3a77c9b-5229-4e17-afd6-66442c36b15a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '325beb5c6708472c867e94c67911c5f1', 'request_id': 'req-b3a77c9b-5229-4e17-afd6-66442c36b15a'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:45.041455 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-b3a77c9b-5229-4e17-afd6-66442c36b15a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '325beb5c6708472c867e94c67911c5f1', 'request_id': 'req-b3a77c9b-5229-4e17-afd6-66442c36b15a'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:45.048817 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-b3a77c9b-5229-4e17-afd6-66442c36b15a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '325beb5c6708472c867e94c67911c5f1', 'request_id': 'req-b3a77c9b-5229-4e17-afd6-66442c36b15a'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:45.059719 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-b3a77c9b-5229-4e17-afd6-66442c36b15a admin admin] The token cache is being invalidate because project 325beb5c6708472c867e94c67911c5f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81447) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:38:45.060014 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-b3a77c9b-5229-4e17-afd6-66442c36b15a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:45.060644 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-b3a77c9b-5229-4e17-afd6-66442c36b15a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:45.062122 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1414/2846] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:38:44 2022] DELETE /identity/v3/projects/325beb5c6708472c867e94c67911c5f1 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:38:45.066920 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11efc179-54bf-4844-857b-c60006b9f4a7 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:45.067204 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11efc179-54bf-4844-857b-c60006b9f4a7 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:45.067498 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11efc179-54bf-4844-857b-c60006b9f4a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:45.087721 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-11efc179-54bf-4844-857b-c60006b9f4a7 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:38:45.088877 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-11efc179-54bf-4844-857b-c60006b9f4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:38:45.119028 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:38:45.150308 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1433/2847] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:38:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:38:45.158085 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19320da3-db2a-4694-9ad9-6827f45ef2fb None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:45.158447 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19320da3-db2a-4694-9ad9-6827f45ef2fb None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:45.158782 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19320da3-db2a-4694-9ad9-6827f45ef2fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:45.178158 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-19320da3-db2a-4694-9ad9-6827f45ef2fb None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:38:45.179453 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-19320da3-db2a-4694-9ad9-6827f45ef2fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:38:45.187681 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1415/2848] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:38:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:38:45.191892 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11efc179-54bf-4844-857b-c60006b9f4a7 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:45.202196 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11efc179-54bf-4844-857b-c60006b9f4a7 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:45.206759 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbe4593-19b2-4301-b3e4-50493f08597e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:45.207355 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbe4593-19b2-4301-b3e4-50493f08597e admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:45.207671 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbe4593-19b2-4301-b3e4-50493f08597e admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:45.207945 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbe4593-19b2-4301-b3e4-50493f08597e admin admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:45.208848 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbe4593-19b2-4301-b3e4-50493f08597e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:38:45.209154 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbe4593-19b2-4301-b3e4-50493f08597e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:45.210748 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbe4593-19b2-4301-b3e4-50493f08597e admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:45.222080 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1434/2849] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 30 01:38:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:38:45.227228 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19320da3-db2a-4694-9ad9-6827f45ef2fb None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:45.237005 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19320da3-db2a-4694-9ad9-6827f45ef2fb None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:45.241735 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52065e-2e03-4019-9f4c-e7d62b94327b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:45.242346 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52065e-2e03-4019-9f4c-e7d62b94327b admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:45.242625 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52065e-2e03-4019-9f4c-e7d62b94327b admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:45.242897 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52065e-2e03-4019-9f4c-e7d62b94327b admin admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:45.243575 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd52065e-2e03-4019-9f4c-e7d62b94327b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:45.245481 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd52065e-2e03-4019-9f4c-e7d62b94327b admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:45.273689 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1416/2850] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:38:45 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:38:45.278066 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbe4593-19b2-4301-b3e4-50493f08597e admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:45.288247 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbe4593-19b2-4301-b3e4-50493f08597e admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:45.344097 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dac64aa-45fe-4038-ac1c-d32a0b38c929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:45.344698 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac64aa-45fe-4038-ac1c-d32a0b38c929 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:45.344979 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac64aa-45fe-4038-ac1c-d32a0b38c929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:45.345251 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac64aa-45fe-4038-ac1c-d32a0b38c929 admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:45.345879 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dac64aa-45fe-4038-ac1c-d32a0b38c929 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:45.347850 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dac64aa-45fe-4038-ac1c-d32a0b38c929 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:45.373309 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1435/2851] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:38:45 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:38:45.378094 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52065e-2e03-4019-9f4c-e7d62b94327b admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:45.388697 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52065e-2e03-4019-9f4c-e7d62b94327b admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:45.393390 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb601230-d85d-4ecd-b4ed-2dc13fa3fa86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:45.394199 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb601230-d85d-4ecd-b4ed-2dc13fa3fa86 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:45.394654 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb601230-d85d-4ecd-b4ed-2dc13fa3fa86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:45.395113 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb601230-d85d-4ecd-b4ed-2dc13fa3fa86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:45.396286 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb601230-d85d-4ecd-b4ed-2dc13fa3fa86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:45.399315 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb601230-d85d-4ecd-b4ed-2dc13fa3fa86 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:45.413253 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1417/2852] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:38:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:38:45.418245 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dac64aa-45fe-4038-ac1c-d32a0b38c929 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:45.428220 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dac64aa-45fe-4038-ac1c-d32a0b38c929 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:45.434401 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493096a7-c4eb-4ffb-8e72-9953b74c30e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:45.435112 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493096a7-c4eb-4ffb-8e72-9953b74c30e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:45.435392 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493096a7-c4eb-4ffb-8e72-9953b74c30e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:45.435698 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493096a7-c4eb-4ffb-8e72-9953b74c30e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:45.436369 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493096a7-c4eb-4ffb-8e72-9953b74c30e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:45.437977 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493096a7-c4eb-4ffb-8e72-9953b74c30e7 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:45.448548 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1436/2853] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:38:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 01:38:45.452649 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb601230-d85d-4ecd-b4ed-2dc13fa3fa86 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:45.462846 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb601230-d85d-4ecd-b4ed-2dc13fa3fa86 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:45.467389 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b12681-aca5-4fce-ae01-afa0d819c472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:45.468054 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b12681-aca5-4fce-ae01-afa0d819c472 admin admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:45.468330 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b12681-aca5-4fce-ae01-afa0d819c472 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:45.468601 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b12681-aca5-4fce-ae01-afa0d819c472 admin admin] PATH_INFO: `/v3/projects/011ed2e2bcee4260b83177b76edba620/users/f2f1ac4f6cfd4072ae90fb86182f4ec8/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:45.483420 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b12681-aca5-4fce-ae01-afa0d819c472 admin admin] RBAC: Authorizing `identity:create_grant(project_id=011ed2e2bcee4260b83177b76edba620, user_id=f2f1ac4f6cfd4072ae90fb86182f4ec8, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:45.486089 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b12681-aca5-4fce-ae01-afa0d819c472 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:45.499534 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1418/2854] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:38:45 2022] PUT /identity/v3/projects/011ed2e2bcee4260b83177b76edba620/users/f2f1ac4f6cfd4072ae90fb86182f4ec8/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:38:45.563473 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a304900-fc18-42a3-abfe-2862402c4ec7 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:45.564000 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a304900-fc18-42a3-abfe-2862402c4ec7 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:45.564000 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a304900-fc18-42a3-abfe-2862402c4ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:45.593866 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-3a304900-fc18-42a3-abfe-2862402c4ec7 None None] MFA Rules not processed for user `f2f1ac4f6cfd4072ae90fb86182f4ec8`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:38:45.595057 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-3a304900-fc18-42a3-abfe-2862402c4ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:38:45.658995 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1437/2855] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:38:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:38:45.663650 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b12681-aca5-4fce-ae01-afa0d819c472 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:45.674098 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:INSERT=4,keystone:DELETE=10,keystone:SELECT=86 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:38:45.728563 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b12681-aca5-4fce-ae01-afa0d819c472 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:45.733756 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeae002-afbb-409d-992a-4e69f428fd89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:45.734353 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeae002-afbb-409d-992a-4e69f428fd89 admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:45.734633 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeae002-afbb-409d-992a-4e69f428fd89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:45.734904 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeae002-afbb-409d-992a-4e69f428fd89 admin admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:45.735555 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeae002-afbb-409d-992a-4e69f428fd89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:45.737448 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeae002-afbb-409d-992a-4e69f428fd89 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:45.763097 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1419/2856] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:38:45 2022] POST /identity/v3/projects => generated 387 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:38:45.767098 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a304900-fc18-42a3-abfe-2862402c4ec7 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:45.778277 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a304900-fc18-42a3-abfe-2862402c4ec7 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:45.807858 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:38:45.836814 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d157ffe5-e919-4870-aa3d-220c88aa1200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:45.837328 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157ffe5-e919-4870-aa3d-220c88aa1200 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:45.837613 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157ffe5-e919-4870-aa3d-220c88aa1200 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:45.837887 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157ffe5-e919-4870-aa3d-220c88aa1200 admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:45.838557 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d157ffe5-e919-4870-aa3d-220c88aa1200 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:45.841074 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d157ffe5-e919-4870-aa3d-220c88aa1200 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:45.862221 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1438/2857] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:38:45 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:38:45.866252 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeae002-afbb-409d-992a-4e69f428fd89 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:45.876524 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeae002-afbb-409d-992a-4e69f428fd89 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:45.881115 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2648d4-eaec-4eee-81be-532c0cb37177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:45.881730 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2648d4-eaec-4eee-81be-532c0cb37177 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:45.882042 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2648d4-eaec-4eee-81be-532c0cb37177 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:45.882288 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2648d4-eaec-4eee-81be-532c0cb37177 admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:45.882933 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2648d4-eaec-4eee-81be-532c0cb37177 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:45.884588 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2648d4-eaec-4eee-81be-532c0cb37177 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:45.895094 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1420/2858] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:38:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:38:45.899086 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d157ffe5-e919-4870-aa3d-220c88aa1200 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:45.909622 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d157ffe5-e919-4870-aa3d-220c88aa1200 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:45.914141 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5269081b-9fef-431a-b66a-667cb1b39580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:45.914730 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269081b-9fef-431a-b66a-667cb1b39580 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:45.915014 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269081b-9fef-431a-b66a-667cb1b39580 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:45.915283 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269081b-9fef-431a-b66a-667cb1b39580 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:45.915963 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5269081b-9fef-431a-b66a-667cb1b39580 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:45.918199 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5269081b-9fef-431a-b66a-667cb1b39580 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:45.927911 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1439/2859] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:38:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:38:45.931916 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2648d4-eaec-4eee-81be-532c0cb37177 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:45.941756 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2648d4-eaec-4eee-81be-532c0cb37177 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:45.946662 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5b5f3e-b879-4361-979e-55f890d5687f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:45.947301 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b5f3e-b879-4361-979e-55f890d5687f admin admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:45.947617 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b5f3e-b879-4361-979e-55f890d5687f admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:45.947894 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b5f3e-b879-4361-979e-55f890d5687f admin admin] PATH_INFO: `/v3/projects/fc2972985d314b6398c99c8497ecfad0/users/7c775d985a3c4d85b8c90564e12b5921/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:45.963699 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5b5f3e-b879-4361-979e-55f890d5687f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc2972985d314b6398c99c8497ecfad0, user_id=7c775d985a3c4d85b8c90564e12b5921, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:45.966941 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5b5f3e-b879-4361-979e-55f890d5687f admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:45.979466 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1421/2860] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:38:45 2022] PUT /identity/v3/projects/fc2972985d314b6398c99c8497ecfad0/users/7c775d985a3c4d85b8c90564e12b5921/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:38:45.990009 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2129b7b-84e0-4345-a3b4-f186946f1483 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:45.990276 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2129b7b-84e0-4345-a3b4-f186946f1483 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:45.990545 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2129b7b-84e0-4345-a3b4-f186946f1483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:46.018576 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-a2129b7b-84e0-4345-a3b4-f186946f1483 None None] MFA Rules not processed for user `7c775d985a3c4d85b8c90564e12b5921`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:38:46.019842 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-a2129b7b-84e0-4345-a3b4-f186946f1483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:38:46.084507 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1440/2861] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:38:45 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:38:46.089147 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5b5f3e-b879-4361-979e-55f890d5687f admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:46.155192 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5b5f3e-b879-4361-979e-55f890d5687f admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:46.159853 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31effa4-bfcf-48dc-9b13-32bf8c25b111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:46.160455 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31effa4-bfcf-48dc-9b13-32bf8c25b111 admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:46.160747 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31effa4-bfcf-48dc-9b13-32bf8c25b111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:46.161008 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31effa4-bfcf-48dc-9b13-32bf8c25b111 admin admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:46.161633 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31effa4-bfcf-48dc-9b13-32bf8c25b111 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:46.163561 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31effa4-bfcf-48dc-9b13-32bf8c25b111 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:46.189762 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1422/2862] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:38:46 2022] POST /identity/v3/projects => generated 387 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:38:46.193896 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2129b7b-84e0-4345-a3b4-f186946f1483 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:46.205396 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2129b7b-84e0-4345-a3b4-f186946f1483 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:46.262509 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a759c-fac6-42a6-aadd-c8e34c8f9269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:46.263107 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a759c-fac6-42a6-aadd-c8e34c8f9269 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:46.263388 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a759c-fac6-42a6-aadd-c8e34c8f9269 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:46.263697 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a759c-fac6-42a6-aadd-c8e34c8f9269 admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:46.264324 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768a759c-fac6-42a6-aadd-c8e34c8f9269 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:46.266298 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768a759c-fac6-42a6-aadd-c8e34c8f9269 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:46.288981 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1441/2863] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:38:46 2022] POST /identity/v3/users => generated 300 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:38:46.293021 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31effa4-bfcf-48dc-9b13-32bf8c25b111 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:46.303354 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31effa4-bfcf-48dc-9b13-32bf8c25b111 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:46.307922 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029a4455-9a0c-478f-8f34-ebc38f1941e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:46.308540 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a4455-9a0c-478f-8f34-ebc38f1941e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:46.308819 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a4455-9a0c-478f-8f34-ebc38f1941e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:46.309091 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a4455-9a0c-478f-8f34-ebc38f1941e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:46.309731 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029a4455-9a0c-478f-8f34-ebc38f1941e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:46.311353 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029a4455-9a0c-478f-8f34-ebc38f1941e8 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:46.321693 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1423/2864] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:38:46.326244 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a759c-fac6-42a6-aadd-c8e34c8f9269 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:46.336687 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a759c-fac6-42a6-aadd-c8e34c8f9269 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:46.342044 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed7c7c-5f8f-4e4c-9cad-3e0339ed2da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:46.342624 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed7c7c-5f8f-4e4c-9cad-3e0339ed2da2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:46.342904 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed7c7c-5f8f-4e4c-9cad-3e0339ed2da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:46.343174 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed7c7c-5f8f-4e4c-9cad-3e0339ed2da2 admin admin] PATH_INFO: `/v3/projects/98f3e3f0379745c395fc741e74897b5f/users/34ed97dccdf04e679d54439c0d9dfd4f/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:46.363983 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfed7c7c-5f8f-4e4c-9cad-3e0339ed2da2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98f3e3f0379745c395fc741e74897b5f, user_id=34ed97dccdf04e679d54439c0d9dfd4f, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:46.366680 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfed7c7c-5f8f-4e4c-9cad-3e0339ed2da2 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:46.380636 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1442/2865] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:38:46 2022] PUT /identity/v3/projects/98f3e3f0379745c395fc741e74897b5f/users/34ed97dccdf04e679d54439c0d9dfd4f/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:38:46.384557 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029a4455-9a0c-478f-8f34-ebc38f1941e8 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:46.395017 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029a4455-9a0c-478f-8f34-ebc38f1941e8 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:46.424611 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:38:46.452635 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f344f5c0-d4dd-4511-b4e9-988bbd314982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:46.453239 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344f5c0-d4dd-4511-b4e9-988bbd314982 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:46.453527 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344f5c0-d4dd-4511-b4e9-988bbd314982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:46.453804 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344f5c0-d4dd-4511-b4e9-988bbd314982 admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:46.454445 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f344f5c0-d4dd-4511-b4e9-988bbd314982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:46.456079 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f344f5c0-d4dd-4511-b4e9-988bbd314982 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:46.466082 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1424/2866] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:38:46.470324 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed7c7c-5f8f-4e4c-9cad-3e0339ed2da2 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:46.476947 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:38:46.480815 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed7c7c-5f8f-4e4c-9cad-3e0339ed2da2 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:46.486438 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e45daf1-8c50-4e92-8f3d-2ae64f8c91f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:46.487140 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45daf1-8c50-4e92-8f3d-2ae64f8c91f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:46.487423 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45daf1-8c50-4e92-8f3d-2ae64f8c91f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:46.487839 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45daf1-8c50-4e92-8f3d-2ae64f8c91f2 admin admin] PATH_INFO: `/v3/projects/98f3e3f0379745c395fc741e74897b5f/users/34ed97dccdf04e679d54439c0d9dfd4f/roles/f6bc03b6972e420eb338ee7fd1443974` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:46.489769 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e45daf1-8c50-4e92-8f3d-2ae64f8c91f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98f3e3f0379745c395fc741e74897b5f, user_id=34ed97dccdf04e679d54439c0d9dfd4f, role_id=f6bc03b6972e420eb338ee7fd1443974)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:46.492472 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e45daf1-8c50-4e92-8f3d-2ae64f8c91f2 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:46.503286 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1443/2867] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:38:46 2022] PUT /identity/v3/projects/98f3e3f0379745c395fc741e74897b5f/users/34ed97dccdf04e679d54439c0d9dfd4f/roles/f6bc03b6972e420eb338ee7fd1443974 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:38:46.514019 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481aa6c-7531-4545-bea7-f87d0c6fc87b None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:46.514292 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481aa6c-7531-4545-bea7-f87d0c6fc87b None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:46.514567 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481aa6c-7531-4545-bea7-f87d0c6fc87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:46.541633 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-1481aa6c-7531-4545-bea7-f87d0c6fc87b None None] MFA Rules not processed for user `34ed97dccdf04e679d54439c0d9dfd4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:38:46.542829 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-1481aa6c-7531-4545-bea7-f87d0c6fc87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:38:46.612121 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1425/2868] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:38:46 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:38:46.623996 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e45daf1-8c50-4e92-8f3d-2ae64f8c91f2 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:46.625816 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-2e45daf1-8c50-4e92-8f3d-2ae64f8c91f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:38:46.685346 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e45daf1-8c50-4e92-8f3d-2ae64f8c91f2 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:46.689531 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d118d-29df-4119-b261-0d0ba09aa74c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:46.690356 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d118d-29df-4119-b261-0d0ba09aa74c service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:46.690638 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d118d-29df-4119-b261-0d0ba09aa74c service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:46.690916 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d118d-29df-4119-b261-0d0ba09aa74c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:46.702526 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8d118d-29df-4119-b261-0d0ba09aa74c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:46.704010 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8d118d-29df-4119-b261-0d0ba09aa74c service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:46.714001 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1444/2869] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:38:46 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:38:47.212636 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1481aa6c-7531-4545-bea7-f87d0c6fc87b None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:47.214125 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-1481aa6c-7531-4545-bea7-f87d0c6fc87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:38:47.226594 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1481aa6c-7531-4545-bea7-f87d0c6fc87b None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:47.230832 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34582a08-ae2b-44bd-9065-fd2804752f56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:47.231468 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34582a08-ae2b-44bd-9065-fd2804752f56 service cinder] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:47.231745 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34582a08-ae2b-44bd-9065-fd2804752f56 service cinder] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:47.232021 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34582a08-ae2b-44bd-9065-fd2804752f56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:47.290755 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34582a08-ae2b-44bd-9065-fd2804752f56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:47.292232 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34582a08-ae2b-44bd-9065-fd2804752f56 service cinder] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:47.301849 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1426/2870] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:38:47 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:38:51.318201 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d118d-29df-4119-b261-0d0ba09aa74c service cinder] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:51.327295 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d118d-29df-4119-b261-0d0ba09aa74c service cinder] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:51.330895 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7409858-7005-4a6e-b909-47b22f46789f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:51.331523 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7409858-7005-4a6e-b909-47b22f46789f service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:51.331805 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7409858-7005-4a6e-b909-47b22f46789f service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:51.332076 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7409858-7005-4a6e-b909-47b22f46789f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:51.391662 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7409858-7005-4a6e-b909-47b22f46789f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:51.393106 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7409858-7005-4a6e-b909-47b22f46789f service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:51.402656 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1445/2871] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:38:51 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:38:53.480490 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34582a08-ae2b-44bd-9065-fd2804752f56 service cinder] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:53.531509 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=100 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:38:53.543597 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34582a08-ae2b-44bd-9065-fd2804752f56 service cinder] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:53.548123 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b3d4a9-cb20-4eab-a30a-96c1a8f4f194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:53.548746 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3d4a9-cb20-4eab-a30a-96c1a8f4f194 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:53.549028 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3d4a9-cb20-4eab-a30a-96c1a8f4f194 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:53.549302 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3d4a9-cb20-4eab-a30a-96c1a8f4f194 admin admin] PATH_INFO: `/v3/users/f2f1ac4f6cfd4072ae90fb86182f4ec8` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:53.550418 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b3d4a9-cb20-4eab-a30a-96c1a8f4f194 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2f1ac4f6cfd4072ae90fb86182f4ec8)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:53.552378 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b3d4a9-cb20-4eab-a30a-96c1a8f4f194 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:53.599420 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-53b3d4a9-cb20-4eab-a30a-96c1a8f4f194 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2f1ac4f6cfd4072ae90fb86182f4ec8'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:53.607365 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-53b3d4a9-cb20-4eab-a30a-96c1a8f4f194 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2f1ac4f6cfd4072ae90fb86182f4ec8'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:53.608087 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-53b3d4a9-cb20-4eab-a30a-96c1a8f4f194 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2f1ac4f6cfd4072ae90fb86182f4ec8'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:53.608724 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-53b3d4a9-cb20-4eab-a30a-96c1a8f4f194 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2f1ac4f6cfd4072ae90fb86182f4ec8'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:53.620773 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-53b3d4a9-cb20-4eab-a30a-96c1a8f4f194 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2f1ac4f6cfd4072ae90fb86182f4ec8'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:53.632539 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1427/2872] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:38:53 2022] DELETE /identity/v3/users/f2f1ac4f6cfd4072ae90fb86182f4ec8 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:38:53.637548 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de97f2f-b209-458e-9f90-cac15fd7665c None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:53.638028 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de97f2f-b209-458e-9f90-cac15fd7665c None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:53.638139 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de97f2f-b209-458e-9f90-cac15fd7665c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:53.657523 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-7de97f2f-b209-458e-9f90-cac15fd7665c None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:38:53.658730 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-7de97f2f-b209-458e-9f90-cac15fd7665c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:38:53.717284 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1446/2873] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:38:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:38:53.726849 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b3d4a9-cb20-4eab-a30a-96c1a8f4f194 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:53.728277 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-53b3d4a9-cb20-4eab-a30a-96c1a8f4f194 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:38:53.785648 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b3d4a9-cb20-4eab-a30a-96c1a8f4f194 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:53.790657 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33030bdc-4fb9-4639-b82c-9091c9ab4405 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:53.791275 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33030bdc-4fb9-4639-b82c-9091c9ab4405 service neutron] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:53.791597 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33030bdc-4fb9-4639-b82c-9091c9ab4405 service neutron] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:53.791876 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33030bdc-4fb9-4639-b82c-9091c9ab4405 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:53.801977 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33030bdc-4fb9-4639-b82c-9091c9ab4405 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:53.803405 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33030bdc-4fb9-4639-b82c-9091c9ab4405 service neutron] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:53.813639 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1428/2874] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:38:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:38:54.076768 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de97f2f-b209-458e-9f90-cac15fd7665c None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:54.078233 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-7de97f2f-b209-458e-9f90-cac15fd7665c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:38:54.094403 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de97f2f-b209-458e-9f90-cac15fd7665c None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:54.099629 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6316233-0c9b-4b13-a124-2dc8a3bfb3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:54.100270 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6316233-0c9b-4b13-a124-2dc8a3bfb3e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:54.100553 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6316233-0c9b-4b13-a124-2dc8a3bfb3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:54.100841 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6316233-0c9b-4b13-a124-2dc8a3bfb3e3 admin admin] PATH_INFO: `/v3/projects/011ed2e2bcee4260b83177b76edba620` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:54.102078 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6316233-0c9b-4b13-a124-2dc8a3bfb3e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=011ed2e2bcee4260b83177b76edba620)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:54.104293 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6316233-0c9b-4b13-a124-2dc8a3bfb3e3 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:54.138160 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:38:54.155180 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-c6316233-0c9b-4b13-a124-2dc8a3bfb3e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '011ed2e2bcee4260b83177b76edba620', 'request_id': 'req-c6316233-0c9b-4b13-a124-2dc8a3bfb3e3'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:54.161340 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-c6316233-0c9b-4b13-a124-2dc8a3bfb3e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '011ed2e2bcee4260b83177b76edba620', 'request_id': 'req-c6316233-0c9b-4b13-a124-2dc8a3bfb3e3'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:54.169418 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-c6316233-0c9b-4b13-a124-2dc8a3bfb3e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '011ed2e2bcee4260b83177b76edba620', 'request_id': 'req-c6316233-0c9b-4b13-a124-2dc8a3bfb3e3'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:54.180159 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-c6316233-0c9b-4b13-a124-2dc8a3bfb3e3 admin admin] The token cache is being invalidate because project 011ed2e2bcee4260b83177b76edba620 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:38:54.180449 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-c6316233-0c9b-4b13-a124-2dc8a3bfb3e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:54.181107 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-c6316233-0c9b-4b13-a124-2dc8a3bfb3e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:54.182602 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1447/2875] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:38:54 2022] DELETE /identity/v3/projects/011ed2e2bcee4260b83177b76edba620 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:38:54.186844 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33030bdc-4fb9-4639-b82c-9091c9ab4405 service neutron] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:54.197017 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33030bdc-4fb9-4639-b82c-9091c9ab4405 service neutron] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:54.256332 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e488dea-9cd9-495c-be05-50dd8170bf00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:54.256869 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e488dea-9cd9-495c-be05-50dd8170bf00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:54.257148 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e488dea-9cd9-495c-be05-50dd8170bf00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:54.257431 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e488dea-9cd9-495c-be05-50dd8170bf00 admin admin] PATH_INFO: `/v3/users/7c775d985a3c4d85b8c90564e12b5921` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:54.258591 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e488dea-9cd9-495c-be05-50dd8170bf00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c775d985a3c4d85b8c90564e12b5921)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:54.260546 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e488dea-9cd9-495c-be05-50dd8170bf00 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:54.277143 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:38:54.315081 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-6e488dea-9cd9-495c-be05-50dd8170bf00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c775d985a3c4d85b8c90564e12b5921'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:54.325166 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-6e488dea-9cd9-495c-be05-50dd8170bf00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c775d985a3c4d85b8c90564e12b5921'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:54.325790 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-6e488dea-9cd9-495c-be05-50dd8170bf00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c775d985a3c4d85b8c90564e12b5921'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:54.326476 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-6e488dea-9cd9-495c-be05-50dd8170bf00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c775d985a3c4d85b8c90564e12b5921'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:54.340522 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-6e488dea-9cd9-495c-be05-50dd8170bf00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c775d985a3c4d85b8c90564e12b5921'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:54.353553 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1429/2876] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:38:54 2022] DELETE /identity/v3/users/7c775d985a3c4d85b8c90564e12b5921 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:38:54.652642 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6316233-0c9b-4b13-a124-2dc8a3bfb3e3 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:54.654282 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-c6316233-0c9b-4b13-a124-2dc8a3bfb3e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:38:54.674431 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6316233-0c9b-4b13-a124-2dc8a3bfb3e3 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:54.745761 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb4f991-80f7-4ebd-9586-a338b744d210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:54.746393 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4f991-80f7-4ebd-9586-a338b744d210 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:54.746675 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4f991-80f7-4ebd-9586-a338b744d210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:54.746944 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4f991-80f7-4ebd-9586-a338b744d210 admin admin] PATH_INFO: `/v3/projects/fc2972985d314b6398c99c8497ecfad0` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:54.748079 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb4f991-80f7-4ebd-9586-a338b744d210 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc2972985d314b6398c99c8497ecfad0)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:54.749992 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb4f991-80f7-4ebd-9586-a338b744d210 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:54.798797 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-2bb4f991-80f7-4ebd-9586-a338b744d210 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc2972985d314b6398c99c8497ecfad0', 'request_id': 'req-2bb4f991-80f7-4ebd-9586-a338b744d210'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:54.804913 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-2bb4f991-80f7-4ebd-9586-a338b744d210 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc2972985d314b6398c99c8497ecfad0', 'request_id': 'req-2bb4f991-80f7-4ebd-9586-a338b744d210'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:54.812303 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-2bb4f991-80f7-4ebd-9586-a338b744d210 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc2972985d314b6398c99c8497ecfad0', 'request_id': 'req-2bb4f991-80f7-4ebd-9586-a338b744d210'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:54.822857 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-2bb4f991-80f7-4ebd-9586-a338b744d210 admin admin] The token cache is being invalidate because project fc2972985d314b6398c99c8497ecfad0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:38:54.823159 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-2bb4f991-80f7-4ebd-9586-a338b744d210 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:54.823804 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-2bb4f991-80f7-4ebd-9586-a338b744d210 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:54.825312 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1448/2877] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:38:54 2022] DELETE /identity/v3/projects/fc2972985d314b6398c99c8497ecfad0 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:38:54.829299 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e488dea-9cd9-495c-be05-50dd8170bf00 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:54.830715 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-6e488dea-9cd9-495c-be05-50dd8170bf00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:38:54.844181 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e488dea-9cd9-495c-be05-50dd8170bf00 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:54.900309 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b54227f-4208-4189-a593-36b3ea9d67c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:54.900947 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b54227f-4208-4189-a593-36b3ea9d67c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:54.901228 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b54227f-4208-4189-a593-36b3ea9d67c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:54.902027 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b54227f-4208-4189-a593-36b3ea9d67c8 admin admin] PATH_INFO: `/v3/users/34ed97dccdf04e679d54439c0d9dfd4f` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:54.903179 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b54227f-4208-4189-a593-36b3ea9d67c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34ed97dccdf04e679d54439c0d9dfd4f)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:54.905137 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b54227f-4208-4189-a593-36b3ea9d67c8 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:54.950701 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-0b54227f-4208-4189-a593-36b3ea9d67c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34ed97dccdf04e679d54439c0d9dfd4f'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:54.958212 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-0b54227f-4208-4189-a593-36b3ea9d67c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34ed97dccdf04e679d54439c0d9dfd4f'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:54.959084 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-0b54227f-4208-4189-a593-36b3ea9d67c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34ed97dccdf04e679d54439c0d9dfd4f'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:54.959715 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-0b54227f-4208-4189-a593-36b3ea9d67c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34ed97dccdf04e679d54439c0d9dfd4f'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:54.973245 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-0b54227f-4208-4189-a593-36b3ea9d67c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34ed97dccdf04e679d54439c0d9dfd4f'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:54.986461 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1430/2878] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:38:54 2022] DELETE /identity/v3/users/34ed97dccdf04e679d54439c0d9dfd4f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:38:55.473519 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb4f991-80f7-4ebd-9586-a338b744d210 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:55.475224 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-2bb4f991-80f7-4ebd-9586-a338b744d210 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:38:55.489485 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb4f991-80f7-4ebd-9586-a338b744d210 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:55.540532 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:38:55.556631 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff7933c-779f-490a-bb84-b39945200036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:55.557274 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff7933c-779f-490a-bb84-b39945200036 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:55.557556 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff7933c-779f-490a-bb84-b39945200036 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:55.557838 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff7933c-779f-490a-bb84-b39945200036 admin admin] PATH_INFO: `/v3/projects/98f3e3f0379745c395fc741e74897b5f` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:55.559016 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff7933c-779f-490a-bb84-b39945200036 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98f3e3f0379745c395fc741e74897b5f)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:55.560973 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff7933c-779f-490a-bb84-b39945200036 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:55.611321 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-eff7933c-779f-490a-bb84-b39945200036 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98f3e3f0379745c395fc741e74897b5f', 'request_id': 'req-eff7933c-779f-490a-bb84-b39945200036'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:55.617646 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-eff7933c-779f-490a-bb84-b39945200036 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98f3e3f0379745c395fc741e74897b5f', 'request_id': 'req-eff7933c-779f-490a-bb84-b39945200036'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:55.626265 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-eff7933c-779f-490a-bb84-b39945200036 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98f3e3f0379745c395fc741e74897b5f', 'request_id': 'req-eff7933c-779f-490a-bb84-b39945200036'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:55.638471 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-eff7933c-779f-490a-bb84-b39945200036 admin admin] The token cache is being invalidate because project 98f3e3f0379745c395fc741e74897b5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:38:55.638773 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-eff7933c-779f-490a-bb84-b39945200036 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:55.639445 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-eff7933c-779f-490a-bb84-b39945200036 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:38:55.640985 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1449/2879] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:38:55 2022] DELETE /identity/v3/projects/98f3e3f0379745c395fc741e74897b5f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:38:55.648365 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfba0c3-4992-489a-a1ab-074ce1991816 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:55.648643 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfba0c3-4992-489a-a1ab-074ce1991816 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:55.648944 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfba0c3-4992-489a-a1ab-074ce1991816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:55.668480 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-0bfba0c3-4992-489a-a1ab-074ce1991816 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:38:55.669714 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-0bfba0c3-4992-489a-a1ab-074ce1991816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:38:55.678382 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:38:55.731925 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1431/2880] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:38:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:38:55.740400 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948a7f4-5e4f-4436-b9cd-4b917c1cdf7d None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:55.740914 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948a7f4-5e4f-4436-b9cd-4b917c1cdf7d None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:55.741040 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948a7f4-5e4f-4436-b9cd-4b917c1cdf7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:55.762260 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-3948a7f4-5e4f-4436-b9cd-4b917c1cdf7d None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:38:55.763500 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-3948a7f4-5e4f-4436-b9cd-4b917c1cdf7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:38:55.771306 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1450/2881] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:38:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:38:55.775719 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfba0c3-4992-489a-a1ab-074ce1991816 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:55.785436 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfba0c3-4992-489a-a1ab-074ce1991816 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:55.790061 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c5da79-af2b-4335-ac5d-ec5e6a7afc92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:55.790663 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5da79-af2b-4335-ac5d-ec5e6a7afc92 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:55.790941 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5da79-af2b-4335-ac5d-ec5e6a7afc92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:55.791214 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5da79-af2b-4335-ac5d-ec5e6a7afc92 admin admin] PATH_INFO: `/v3/domains` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:55.791919 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c5da79-af2b-4335-ac5d-ec5e6a7afc92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81447) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:38:55.792225 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c5da79-af2b-4335-ac5d-ec5e6a7afc92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:55.793827 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c5da79-af2b-4335-ac5d-ec5e6a7afc92 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:55.806005 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1432/2882] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 30 01:38:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:38:55.811021 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3948a7f4-5e4f-4436-b9cd-4b917c1cdf7d None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:55.820529 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3948a7f4-5e4f-4436-b9cd-4b917c1cdf7d None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:55.825738 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae7b56-92c6-4c71-9641-2ac6bb911c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:55.826340 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae7b56-92c6-4c71-9641-2ac6bb911c12 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:55.826615 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae7b56-92c6-4c71-9641-2ac6bb911c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:55.826882 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae7b56-92c6-4c71-9641-2ac6bb911c12 admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:55.827541 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae7b56-92c6-4c71-9641-2ac6bb911c12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:55.829427 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae7b56-92c6-4c71-9641-2ac6bb911c12 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:55.858509 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1451/2883] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:38:55 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:38:55.862817 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c5da79-af2b-4335-ac5d-ec5e6a7afc92 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:55.873521 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c5da79-af2b-4335-ac5d-ec5e6a7afc92 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:55.935253 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cb71f9-a8c5-4306-b3e5-ca60fcb02081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:55.935880 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb71f9-a8c5-4306-b3e5-ca60fcb02081 admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:55.936161 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb71f9-a8c5-4306-b3e5-ca60fcb02081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:55.936434 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb71f9-a8c5-4306-b3e5-ca60fcb02081 admin admin] PATH_INFO: `/v3/users` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:55.937071 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cb71f9-a8c5-4306-b3e5-ca60fcb02081 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:55.939017 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cb71f9-a8c5-4306-b3e5-ca60fcb02081 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:55.961424 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1433/2884] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:38:55 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:38:55.965539 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae7b56-92c6-4c71-9641-2ac6bb911c12 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:55.976585 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae7b56-92c6-4c71-9641-2ac6bb911c12 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:55.981606 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a470fd72-8347-4bc1-8141-52f5ebc77e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:55.982240 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470fd72-8347-4bc1-8141-52f5ebc77e17 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:55.982464 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470fd72-8347-4bc1-8141-52f5ebc77e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:55.982731 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470fd72-8347-4bc1-8141-52f5ebc77e17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:55.983364 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a470fd72-8347-4bc1-8141-52f5ebc77e17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:55.984991 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a470fd72-8347-4bc1-8141-52f5ebc77e17 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:55.995937 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1452/2885] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:38:56.000033 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cb71f9-a8c5-4306-b3e5-ca60fcb02081 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:56.010121 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cb71f9-a8c5-4306-b3e5-ca60fcb02081 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:56.014809 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60fed41-b784-4fee-b903-67f45bf1f357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:56.015402 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60fed41-b784-4fee-b903-67f45bf1f357 admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:56.015716 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60fed41-b784-4fee-b903-67f45bf1f357 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:56.015990 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60fed41-b784-4fee-b903-67f45bf1f357 admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:56.016630 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60fed41-b784-4fee-b903-67f45bf1f357 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:56.018215 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60fed41-b784-4fee-b903-67f45bf1f357 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:56.029741 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1434/2886] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:38:56.033933 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a470fd72-8347-4bc1-8141-52f5ebc77e17 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:56.044304 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a470fd72-8347-4bc1-8141-52f5ebc77e17 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:56.048833 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4a6912-2c0c-42a2-9c49-a63fbcee7380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:56.049477 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a6912-2c0c-42a2-9c49-a63fbcee7380 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:56.049755 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a6912-2c0c-42a2-9c49-a63fbcee7380 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:56.050026 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a6912-2c0c-42a2-9c49-a63fbcee7380 admin admin] PATH_INFO: `/v3/projects/b55ebbd9daca4973a5cc93b2e0df0c99/users/1ddbf60d7602443f8ab02235e136c580/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:56.188005 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4a6912-2c0c-42a2-9c49-a63fbcee7380 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b55ebbd9daca4973a5cc93b2e0df0c99, user_id=1ddbf60d7602443f8ab02235e136c580, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:56.190669 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4a6912-2c0c-42a2-9c49-a63fbcee7380 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:56.203055 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1453/2887] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:38:56 2022] PUT /identity/v3/projects/b55ebbd9daca4973a5cc93b2e0df0c99/users/1ddbf60d7602443f8ab02235e136c580/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:38:56.215122 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c5ecf-7c60-4140-a4ee-21049ff6d870 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:56.215408 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c5ecf-7c60-4140-a4ee-21049ff6d870 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:56.215724 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c5ecf-7c60-4140-a4ee-21049ff6d870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:56.243506 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-3f7c5ecf-7c60-4140-a4ee-21049ff6d870 None None] MFA Rules not processed for user `1ddbf60d7602443f8ab02235e136c580`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:38:56.244645 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-3f7c5ecf-7c60-4140-a4ee-21049ff6d870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:38:56.307874 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1435/2888] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:38:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:38:56.318860 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4a6912-2c0c-42a2-9c49-a63fbcee7380 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:38:56.320560 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-4a4a6912-2c0c-42a2-9c49-a63fbcee7380 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:38:56.377384 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4a6912-2c0c-42a2-9c49-a63fbcee7380 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:38:56.381017 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa1f955-ba77-4224-a74b-778164f83d47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:38:56.381614 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa1f955-ba77-4224-a74b-778164f83d47 service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:56.381894 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa1f955-ba77-4224-a74b-778164f83d47 service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:56.382166 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa1f955-ba77-4224-a74b-778164f83d47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:56.390373 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa1f955-ba77-4224-a74b-778164f83d47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:38:56.391836 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa1f955-ba77-4224-a74b-778164f83d47 service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:38:56.401334 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1454/2889] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:38:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:38:57.756822 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481fe868-7833-41fc-a2b4-e1f4586183f5 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:38:57.757371 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481fe868-7833-41fc-a2b4-e1f4586183f5 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:38:57.757371 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481fe868-7833-41fc-a2b4-e1f4586183f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:38:57.776804 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-481fe868-7833-41fc-a2b4-e1f4586183f5 None None] MFA Rules not processed for user `1ddbf60d7602443f8ab02235e136c580`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:38:57.778005 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-481fe868-7833-41fc-a2b4-e1f4586183f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:38:57.784858 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1436/2890] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:38:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:39:06.396516 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=83,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:39:07.771979 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=96,keystone:INSERT=3 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:39:11.390913 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4604ff-9f51-42ae-8dad-c54eaa474f6c None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:39:11.391473 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4604ff-9f51-42ae-8dad-c54eaa474f6c None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:39:11.391473 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4604ff-9f51-42ae-8dad-c54eaa474f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:39:11.421210 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-6e4604ff-9f51-42ae-8dad-c54eaa474f6c None None] MFA Rules not processed for user `edc11f8a9c5843939ec230e63ca7fa3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:39:11.422432 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-6e4604ff-9f51-42ae-8dad-c54eaa474f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:39:11.483104 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1455/2891] 10.222.0.60 () {58 vars in 1009 bytes} [Tue Aug 30 01:39:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:39:11.537112 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481fe868-7833-41fc-a2b4-e1f4586183f5 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:39:11.538570 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-481fe868-7833-41fc-a2b4-e1f4586183f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:39:11.611848 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481fe868-7833-41fc-a2b4-e1f4586183f5 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:39:11.616908 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053f937-0fbd-43a0-acc6-d12ad68355ae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7de1f31ef84d529bf2c53ce0f7e38b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:39:11.617523 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053f937-0fbd-43a0-acc6-d12ad68355ae service swift] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:39:11.617804 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053f937-0fbd-43a0-acc6-d12ad68355ae service swift] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:39:11.618080 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053f937-0fbd-43a0-acc6-d12ad68355ae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:39:11.626783 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d053f937-0fbd-43a0-acc6-d12ad68355ae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:39:11.628383 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d053f937-0fbd-43a0-acc6-d12ad68355ae service swift] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:39:11.636226 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1437/2892] 10.222.0.60 () {60 vars in 1384 bytes} [Tue Aug 30 01:39:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 01:39:12.135726 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3c73c-c80f-4dc9-8a84-d53d9eda474f None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:39:12.136008 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3c73c-c80f-4dc9-8a84-d53d9eda474f None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:39:12.136277 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3c73c-c80f-4dc9-8a84-d53d9eda474f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:39:12.156455 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-29e3c73c-c80f-4dc9-8a84-d53d9eda474f None None] MFA Rules not processed for user `edc11f8a9c5843939ec230e63ca7fa3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:39:12.157647 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-29e3c73c-c80f-4dc9-8a84-d53d9eda474f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:39:12.164672 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1456/2893] 10.222.0.60 () {58 vars in 967 bytes} [Tue Aug 30 01:39:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:39:12.177206 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053f937-0fbd-43a0-acc6-d12ad68355ae service swift] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:39:12.187697 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053f937-0fbd-43a0-acc6-d12ad68355ae service swift] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:39:12.192665 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ca9a71-2c9d-4977-8027-00ffbb33873b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7de1f31ef84d529bf2c53ce0f7e38b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:39:12.193258 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca9a71-2c9d-4977-8027-00ffbb33873b service swift] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:39:12.193534 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca9a71-2c9d-4977-8027-00ffbb33873b service swift] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:39:12.193804 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca9a71-2c9d-4977-8027-00ffbb33873b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:39:12.201846 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ca9a71-2c9d-4977-8027-00ffbb33873b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:39:12.203410 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ca9a71-2c9d-4977-8027-00ffbb33873b service swift] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:39:12.211786 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1438/2894] 10.222.0.60 () {60 vars in 1384 bytes} [Tue Aug 30 01:39:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 01:39:12.428529 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d41636-3643-4313-8bff-4d1dc98692a4 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:39:12.429019 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d41636-3643-4313-8bff-4d1dc98692a4 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:39:12.429120 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d41636-3643-4313-8bff-4d1dc98692a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:39:12.447600 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-64d41636-3643-4313-8bff-4d1dc98692a4 None None] MFA Rules not processed for user `edc11f8a9c5843939ec230e63ca7fa3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:39:12.449337 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-64d41636-3643-4313-8bff-4d1dc98692a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:39:12.456399 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1457/2895] 10.222.0.60 () {58 vars in 1009 bytes} [Tue Aug 30 01:39:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:39:12.468797 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ca9a71-2c9d-4977-8027-00ffbb33873b service swift] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:39:12.479380 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ca9a71-2c9d-4977-8027-00ffbb33873b service swift] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:39:12.484291 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d5850a-ddff-437d-8734-a4ea6f6bb897 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7de1f31ef84d529bf2c53ce0f7e38b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:39:12.484882 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d5850a-ddff-437d-8734-a4ea6f6bb897 service swift] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:39:12.485174 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d5850a-ddff-437d-8734-a4ea6f6bb897 service swift] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:39:12.485439 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d5850a-ddff-437d-8734-a4ea6f6bb897 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:39:12.493390 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d5850a-ddff-437d-8734-a4ea6f6bb897 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:39:12.494949 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d5850a-ddff-437d-8734-a4ea6f6bb897 service swift] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:39:12.503654 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1439/2896] 10.222.0.60 () {60 vars in 1384 bytes} [Tue Aug 30 01:39:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 01:39:12.823740 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131cda05-6c60-42df-8dbd-d6302bb2299d None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:39:12.824032 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131cda05-6c60-42df-8dbd-d6302bb2299d None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:39:12.824301 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131cda05-6c60-42df-8dbd-d6302bb2299d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:39:12.842920 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-131cda05-6c60-42df-8dbd-d6302bb2299d None None] MFA Rules not processed for user `edc11f8a9c5843939ec230e63ca7fa3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:39:12.844057 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-131cda05-6c60-42df-8dbd-d6302bb2299d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:39:12.851827 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1458/2897] 10.222.0.60 () {58 vars in 967 bytes} [Tue Aug 30 01:39:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:39:12.863683 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d5850a-ddff-437d-8734-a4ea6f6bb897 service swift] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:39:12.874828 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d5850a-ddff-437d-8734-a4ea6f6bb897 service swift] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:39:12.879885 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b43e06f-2779-4e50-b57e-22c225cf53b9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e7de1f31ef84d529bf2c53ce0f7e38b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:39:12.880484 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43e06f-2779-4e50-b57e-22c225cf53b9 service swift] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:39:12.880769 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43e06f-2779-4e50-b57e-22c225cf53b9 service swift] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:39:12.881152 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43e06f-2779-4e50-b57e-22c225cf53b9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:39:12.889880 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b43e06f-2779-4e50-b57e-22c225cf53b9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:39:12.891503 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b43e06f-2779-4e50-b57e-22c225cf53b9 service swift] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:39:12.899380 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1440/2898] 10.222.0.60 () {60 vars in 1384 bytes} [Tue Aug 30 01:39:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 01:39:14.972755 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131cda05-6c60-42df-8dbd-d6302bb2299d None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:39:15.034080 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131cda05-6c60-42df-8dbd-d6302bb2299d None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:39:15.038512 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8befe5-0988-435b-b564-a94d93976278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:39:15.039131 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8befe5-0988-435b-b564-a94d93976278 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:39:15.039411 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8befe5-0988-435b-b564-a94d93976278 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:39:15.039722 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8befe5-0988-435b-b564-a94d93976278 admin admin] PATH_INFO: `/v3/users/1ddbf60d7602443f8ab02235e136c580` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:39:15.040843 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8befe5-0988-435b-b564-a94d93976278 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ddbf60d7602443f8ab02235e136c580)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:39:15.043387 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8befe5-0988-435b-b564-a94d93976278 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:39:15.089481 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-1e8befe5-0988-435b-b564-a94d93976278 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ddbf60d7602443f8ab02235e136c580'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:39:15.096682 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-1e8befe5-0988-435b-b564-a94d93976278 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ddbf60d7602443f8ab02235e136c580'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:39:15.097292 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-1e8befe5-0988-435b-b564-a94d93976278 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ddbf60d7602443f8ab02235e136c580'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:39:15.109813 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-1e8befe5-0988-435b-b564-a94d93976278 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ddbf60d7602443f8ab02235e136c580'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:39:15.110442 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-1e8befe5-0988-435b-b564-a94d93976278 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ddbf60d7602443f8ab02235e136c580'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:39:15.115732 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:39:15.123742 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1459/2899] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:39:14 2022] DELETE /identity/v3/users/1ddbf60d7602443f8ab02235e136c580 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:39:15.128406 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1204dc2-12e7-46f8-9a4d-94fb0936d734 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:39:15.128890 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1204dc2-12e7-46f8-9a4d-94fb0936d734 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:39:15.129012 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1204dc2-12e7-46f8-9a4d-94fb0936d734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:39:15.149034 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-a1204dc2-12e7-46f8-9a4d-94fb0936d734 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:39:15.150244 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-a1204dc2-12e7-46f8-9a4d-94fb0936d734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:39:15.208291 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1441/2900] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:39:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:39:15.218538 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8befe5-0988-435b-b564-a94d93976278 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:39:15.219958 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-1e8befe5-0988-435b-b564-a94d93976278 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:39:15.277634 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8befe5-0988-435b-b564-a94d93976278 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:39:15.281226 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a2b863-eeca-4a37-a2e0-9ba31ca82c14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:39:15.281824 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2b863-eeca-4a37-a2e0-9ba31ca82c14 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:39:15.282098 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2b863-eeca-4a37-a2e0-9ba31ca82c14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:39:15.282365 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2b863-eeca-4a37-a2e0-9ba31ca82c14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:39:15.291153 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a2b863-eeca-4a37-a2e0-9ba31ca82c14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:39:15.293217 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a2b863-eeca-4a37-a2e0-9ba31ca82c14 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:39:15.306945 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1460/2901] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:39:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:39:15.476336 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1204dc2-12e7-46f8-9a4d-94fb0936d734 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:39:15.477907 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-a1204dc2-12e7-46f8-9a4d-94fb0936d734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:39:15.489991 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1204dc2-12e7-46f8-9a4d-94fb0936d734 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:39:15.495505 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431155fb-23be-455a-8628-986407145f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:39:15.496153 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431155fb-23be-455a-8628-986407145f3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:39:15.496428 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431155fb-23be-455a-8628-986407145f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:39:15.496719 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431155fb-23be-455a-8628-986407145f3a admin admin] PATH_INFO: `/v3/projects/b55ebbd9daca4973a5cc93b2e0df0c99` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:39:15.498432 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431155fb-23be-455a-8628-986407145f3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b55ebbd9daca4973a5cc93b2e0df0c99)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:39:15.500600 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431155fb-23be-455a-8628-986407145f3a admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:39:15.546469 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:39:15.549675 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-431155fb-23be-455a-8628-986407145f3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b55ebbd9daca4973a5cc93b2e0df0c99', 'request_id': 'req-431155fb-23be-455a-8628-986407145f3a'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:39:15.556463 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-431155fb-23be-455a-8628-986407145f3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b55ebbd9daca4973a5cc93b2e0df0c99', 'request_id': 'req-431155fb-23be-455a-8628-986407145f3a'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:39:15.564639 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-431155fb-23be-455a-8628-986407145f3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b55ebbd9daca4973a5cc93b2e0df0c99', 'request_id': 'req-431155fb-23be-455a-8628-986407145f3a'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:39:15.575790 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-431155fb-23be-455a-8628-986407145f3a admin admin] The token cache is being invalidate because project b55ebbd9daca4973a5cc93b2e0df0c99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81447) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:39:15.576075 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-431155fb-23be-455a-8628-986407145f3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:39:15.576694 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-431155fb-23be-455a-8628-986407145f3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:39:15.578165 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1442/2902] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:39:15 2022] DELETE /identity/v3/projects/b55ebbd9daca4973a5cc93b2e0df0c99 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:39:15.584087 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831aba5-674f-4cf7-8caf-7c79d3ce5516 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:39:15.584374 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831aba5-674f-4cf7-8caf-7c79d3ce5516 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:39:15.584650 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831aba5-674f-4cf7-8caf-7c79d3ce5516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:39:15.606205 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-f831aba5-674f-4cf7-8caf-7c79d3ce5516 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:39:15.607407 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-f831aba5-674f-4cf7-8caf-7c79d3ce5516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:39:15.667010 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1461/2903] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:39:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:39:15.675114 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a787d6-ec12-4a4f-86c1-4ca82ca8d93c None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:39:15.675396 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a787d6-ec12-4a4f-86c1-4ca82ca8d93c None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:39:15.675700 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a787d6-ec12-4a4f-86c1-4ca82ca8d93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:39:15.695474 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-f0a787d6-ec12-4a4f-86c1-4ca82ca8d93c None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:39:15.696674 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-f0a787d6-ec12-4a4f-86c1-4ca82ca8d93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:39:15.705081 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1443/2904] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:39:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:39:15.709529 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f831aba5-674f-4cf7-8caf-7c79d3ce5516 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:39:15.719157 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f831aba5-674f-4cf7-8caf-7c79d3ce5516 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:39:15.723857 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6854f0-9fd4-4e1e-a3d8-d1efe9d49366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:39:15.724667 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6854f0-9fd4-4e1e-a3d8-d1efe9d49366 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:39:15.724804 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6854f0-9fd4-4e1e-a3d8-d1efe9d49366 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:39:15.725055 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6854f0-9fd4-4e1e-a3d8-d1efe9d49366 admin admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:39:15.725603 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6854f0-9fd4-4e1e-a3d8-d1efe9d49366 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 01:39:15.725900 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6854f0-9fd4-4e1e-a3d8-d1efe9d49366 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:39:15.727516 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6854f0-9fd4-4e1e-a3d8-d1efe9d49366 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:39:15.738784 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1462/2905] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 30 01:39:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 01:39:15.742984 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a787d6-ec12-4a4f-86c1-4ca82ca8d93c None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:39:15.752675 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a787d6-ec12-4a4f-86c1-4ca82ca8d93c None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:39:15.757246 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c9cbb-3945-4e67-bcb9-7bd871e0844c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:39:15.757841 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c9cbb-3945-4e67-bcb9-7bd871e0844c admin admin] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:39:15.758116 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c9cbb-3945-4e67-bcb9-7bd871e0844c admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:39:15.758384 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c9cbb-3945-4e67-bcb9-7bd871e0844c admin admin] PATH_INFO: `/v3/projects` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:39:15.759022 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92c9cbb-3945-4e67-bcb9-7bd871e0844c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:39:15.761506 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92c9cbb-3945-4e67-bcb9-7bd871e0844c admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:39:15.788872 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1444/2906] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 30 01:39:15 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 01:39:15.793019 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6854f0-9fd4-4e1e-a3d8-d1efe9d49366 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:39:15.802967 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6854f0-9fd4-4e1e-a3d8-d1efe9d49366 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:39:15.858722 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8c8f02-e510-4486-8680-0043f30e83f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:39:15.859316 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c8f02-e510-4486-8680-0043f30e83f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:39:15.859629 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c8f02-e510-4486-8680-0043f30e83f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:39:15.859900 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c8f02-e510-4486-8680-0043f30e83f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:39:15.860517 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8c8f02-e510-4486-8680-0043f30e83f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:39:15.862523 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8c8f02-e510-4486-8680-0043f30e83f5 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:39:15.883585 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1463/2907] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 30 01:39:15 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 01:39:15.888378 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c9cbb-3945-4e67-bcb9-7bd871e0844c admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:39:15.898828 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c9cbb-3945-4e67-bcb9-7bd871e0844c admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:39:15.903402 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920feadc-c95b-4fa6-9b1f-574d0b6a704c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:39:15.904015 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920feadc-c95b-4fa6-9b1f-574d0b6a704c admin admin] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:39:15.904311 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920feadc-c95b-4fa6-9b1f-574d0b6a704c admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:39:15.904564 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920feadc-c95b-4fa6-9b1f-574d0b6a704c admin admin] PATH_INFO: `/v3/roles` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:39:15.905206 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920feadc-c95b-4fa6-9b1f-574d0b6a704c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:39:15.906797 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920feadc-c95b-4fa6-9b1f-574d0b6a704c admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:39:15.916813 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1445/2908] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:39:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:39:15.920717 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8c8f02-e510-4486-8680-0043f30e83f5 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:39:15.930455 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8c8f02-e510-4486-8680-0043f30e83f5 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:39:15.935645 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90bb15e-a617-43c4-8c6f-f2522a40740d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:39:15.936226 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90bb15e-a617-43c4-8c6f-f2522a40740d admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:39:15.936504 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90bb15e-a617-43c4-8c6f-f2522a40740d admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:39:15.936775 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90bb15e-a617-43c4-8c6f-f2522a40740d admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:39:15.937407 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90bb15e-a617-43c4-8c6f-f2522a40740d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:39:15.939005 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90bb15e-a617-43c4-8c6f-f2522a40740d admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:39:15.949673 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1464/2909] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 30 01:39:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 01:39:15.953630 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920feadc-c95b-4fa6-9b1f-574d0b6a704c admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:39:15.963801 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920feadc-c95b-4fa6-9b1f-574d0b6a704c admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:39:15.968374 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd449c2-3f0d-4372-8049-bf7458fcea7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:39:15.969014 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd449c2-3f0d-4372-8049-bf7458fcea7a admin admin] REQUEST_METHOD: `PUT` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:39:15.969346 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd449c2-3f0d-4372-8049-bf7458fcea7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:39:15.969572 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd449c2-3f0d-4372-8049-bf7458fcea7a admin admin] PATH_INFO: `/v3/projects/e98c92e3e95242fe8eceba2a43803dc5/users/b789c44dc32147798ab88bbe0f7a5ce2/roles/5b38bd827c5847969c4ee48e27261f5b` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:39:15.984273 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd449c2-3f0d-4372-8049-bf7458fcea7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e98c92e3e95242fe8eceba2a43803dc5, user_id=b789c44dc32147798ab88bbe0f7a5ce2, role_id=5b38bd827c5847969c4ee48e27261f5b)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:39:15.986938 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd449c2-3f0d-4372-8049-bf7458fcea7a admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:39:16.001077 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1446/2910] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 30 01:39:15 2022] PUT /identity/v3/projects/e98c92e3e95242fe8eceba2a43803dc5/users/b789c44dc32147798ab88bbe0f7a5ce2/roles/5b38bd827c5847969c4ee48e27261f5b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:39:16.006117 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e88fb-78c5-4eeb-9789-afa36042601f None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:39:16.006549 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e88fb-78c5-4eeb-9789-afa36042601f None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:39:16.006702 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e88fb-78c5-4eeb-9789-afa36042601f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:39:16.015488 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:39:16.027417 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-921e88fb-78c5-4eeb-9789-afa36042601f None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:39:16.028629 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-921e88fb-78c5-4eeb-9789-afa36042601f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:39:16.086209 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1465/2911] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:39:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:39:16.095832 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd449c2-3f0d-4372-8049-bf7458fcea7a admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:39:16.097485 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-fdd449c2-3f0d-4372-8049-bf7458fcea7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:39:16.153526 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd449c2-3f0d-4372-8049-bf7458fcea7a admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:39:16.157207 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714009be-3476-45d0-ab09-43cdad434ab9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:39:16.157805 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714009be-3476-45d0-ab09-43cdad434ab9 service neutron] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:39:16.158080 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714009be-3476-45d0-ab09-43cdad434ab9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:39:16.158350 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714009be-3476-45d0-ab09-43cdad434ab9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:39:16.167822 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714009be-3476-45d0-ab09-43cdad434ab9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:39:16.169321 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714009be-3476-45d0-ab09-43cdad434ab9 service neutron] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:39:16.178812 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1447/2912] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:39:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:39:16.807283 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1404fd2-0f91-46f2-b801-bce02805ed5e None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:39:16.807608 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1404fd2-0f91-46f2-b801-bce02805ed5e None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:39:16.807912 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1404fd2-0f91-46f2-b801-bce02805ed5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:39:16.836892 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-f1404fd2-0f91-46f2-b801-bce02805ed5e None None] MFA Rules not processed for user `b789c44dc32147798ab88bbe0f7a5ce2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:39:16.838096 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-f1404fd2-0f91-46f2-b801-bce02805ed5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:39:16.904646 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1466/2913] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:39:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:39:16.915494 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714009be-3476-45d0-ab09-43cdad434ab9 service neutron] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:39:16.916931 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-714009be-3476-45d0-ab09-43cdad434ab9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:39:16.976752 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714009be-3476-45d0-ab09-43cdad434ab9 service neutron] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:39:16.980320 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e0cff-29ad-4ccc-92e6-039f520628cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3040f72d52249f1b0e19e3a200bd16e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:39:16.980932 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e0cff-29ad-4ccc-92e6-039f520628cb service cinder] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:39:16.981214 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e0cff-29ad-4ccc-92e6-039f520628cb service cinder] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:39:16.981484 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e0cff-29ad-4ccc-92e6-039f520628cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:39:16.990336 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7e0cff-29ad-4ccc-92e6-039f520628cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:39:16.991795 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7e0cff-29ad-4ccc-92e6-039f520628cb service cinder] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:39:17.000588 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1448/2914] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:39:16 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:39:18.354992 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ca88a-04a4-4a7b-95d5-62c6656d93a9 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:39:18.355556 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ca88a-04a4-4a7b-95d5-62c6656d93a9 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:39:18.355556 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ca88a-04a4-4a7b-95d5-62c6656d93a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:39:18.376046 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-e00ca88a-04a4-4a7b-95d5-62c6656d93a9 None None] MFA Rules not processed for user `b789c44dc32147798ab88bbe0f7a5ce2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:39:18.377243 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-e00ca88a-04a4-4a7b-95d5-62c6656d93a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:39:18.384034 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1467/2915] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:39:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:39:25.840141 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e0cff-29ad-4ccc-92e6-039f520628cb service cinder] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:39:25.841600 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-be7e0cff-29ad-4ccc-92e6-039f520628cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:39:25.853409 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e0cff-29ad-4ccc-92e6-039f520628cb service cinder] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:39:25.856876 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fb31f1-5543-4e33-9e6d-3c2da09b1586 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:39:25.857464 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb31f1-5543-4e33-9e6d-3c2da09b1586 service neutron] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:39:25.857741 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb31f1-5543-4e33-9e6d-3c2da09b1586 service neutron] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:39:25.858012 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb31f1-5543-4e33-9e6d-3c2da09b1586 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:39:25.859665 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-f4fb31f1-5543-4e33-9e6d-3c2da09b1586 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:39:25.873133 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:39:25.935346 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fb31f1-5543-4e33-9e6d-3c2da09b1586 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:39:25.936807 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fb31f1-5543-4e33-9e6d-3c2da09b1586 service neutron] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:39:25.947780 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1449/2916] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:39:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:39:28.356350 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ca88a-04a4-4a7b-95d5-62c6656d93a9 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:39:28.366032 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ca88a-04a4-4a7b-95d5-62c6656d93a9 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:39:28.369598 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b3fbd-7c5c-4075-af48-304b2d36691c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:39:28.370189 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b3fbd-7c5c-4075-af48-304b2d36691c service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:39:28.371186 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b3fbd-7c5c-4075-af48-304b2d36691c service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:39:28.371504 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b3fbd-7c5c-4075-af48-304b2d36691c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:39:28.373260 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-901b3fbd-7c5c-4075-af48-304b2d36691c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:39:28.386332 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901b3fbd-7c5c-4075-af48-304b2d36691c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:39:28.387803 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901b3fbd-7c5c-4075-af48-304b2d36691c service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:39:28.398495 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1468/2917] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:39:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:39:35.942820 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=27 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:39:38.393712 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=66 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:39:43.470029 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2fb9f2-8429-44c3-b8d4-f367675da5a6 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:39:43.470567 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2fb9f2-8429-44c3-b8d4-f367675da5a6 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:39:43.470567 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2fb9f2-8429-44c3-b8d4-f367675da5a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:39:43.491074 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-4d2fb9f2-8429-44c3-b8d4-f367675da5a6 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:39:43.492310 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-4d2fb9f2-8429-44c3-b8d4-f367675da5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:39:43.500259 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1450/2918] 10.222.0.49 () {58 vars in 1016 bytes} [Tue Aug 30 01:39:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:39:43.544236 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b3fbd-7c5c-4075-af48-304b2d36691c service neutron] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:39:43.545663 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-901b3fbd-7c5c-4075-af48-304b2d36691c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:39:43.559328 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b3fbd-7c5c-4075-af48-304b2d36691c service neutron] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:39:43.564728 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d26823-1111-4395-9174-12e8fa07d48b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8889145228a24fb6bd539a11925e62f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:39:43.565477 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d26823-1111-4395-9174-12e8fa07d48b service nova] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:39:43.566250 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d26823-1111-4395-9174-12e8fa07d48b service nova] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:39:43.566722 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d26823-1111-4395-9174-12e8fa07d48b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:39:43.576904 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d26823-1111-4395-9174-12e8fa07d48b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:39:43.578485 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d26823-1111-4395-9174-12e8fa07d48b service nova] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:39:43.589463 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1469/2919] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:39:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:39:46.560440 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dfe1b8-2b15-4437-b48c-c62b4dd71c7b None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:39:46.561254 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dfe1b8-2b15-4437-b48c-c62b4dd71c7b None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:39:46.561445 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dfe1b8-2b15-4437-b48c-c62b4dd71c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:39:46.583896 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-d4dfe1b8-2b15-4437-b48c-c62b4dd71c7b None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:39:46.585109 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-d4dfe1b8-2b15-4437-b48c-c62b4dd71c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:39:46.593045 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1451/2920] 10.222.0.49 () {58 vars in 1016 bytes} [Tue Aug 30 01:39:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:39:46.615484 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d26823-1111-4395-9174-12e8fa07d48b service nova] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:39:46.617250 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-d7d26823-1111-4395-9174-12e8fa07d48b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:39:46.633663 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d26823-1111-4395-9174-12e8fa07d48b service nova] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:39:46.639407 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8515b8b-012e-4277-ac87-5e9dea9a65b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8889145228a24fb6bd539a11925e62f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:39:46.640174 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8515b8b-012e-4277-ac87-5e9dea9a65b0 service nova] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:39:46.640459 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8515b8b-012e-4277-ac87-5e9dea9a65b0 service nova] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:39:46.640704 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8515b8b-012e-4277-ac87-5e9dea9a65b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:39:46.650995 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8515b8b-012e-4277-ac87-5e9dea9a65b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:39:46.652630 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8515b8b-012e-4277-ac87-5e9dea9a65b0 service nova] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:39:46.663356 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1470/2921] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:39:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:39:49.794922 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c040d3-279c-4289-b1c0-c121952e51e7 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:39:49.795484 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c040d3-279c-4289-b1c0-c121952e51e7 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:39:49.795484 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c040d3-279c-4289-b1c0-c121952e51e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:39:49.815058 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-71c040d3-279c-4289-b1c0-c121952e51e7 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:39:49.816277 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-71c040d3-279c-4289-b1c0-c121952e51e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:39:49.825817 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1452/2922] 10.222.0.49 () {58 vars in 1016 bytes} [Tue Aug 30 01:39:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 01:39:49.846658 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8515b8b-012e-4277-ac87-5e9dea9a65b0 service nova] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:39:49.858011 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8515b8b-012e-4277-ac87-5e9dea9a65b0 service nova] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:39:49.863897 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd94ce9b-3b86-41a4-b6df-a18b88910b28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8889145228a24fb6bd539a11925e62f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:39:49.864482 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94ce9b-3b86-41a4-b6df-a18b88910b28 service nova] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:39:49.864753 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94ce9b-3b86-41a4-b6df-a18b88910b28 service nova] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:39:49.865022 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94ce9b-3b86-41a4-b6df-a18b88910b28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:39:49.873180 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd94ce9b-3b86-41a4-b6df-a18b88910b28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:39:49.874729 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd94ce9b-3b86-41a4-b6df-a18b88910b28 service nova] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:39:49.885406 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1471/2923] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:39:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:39:52.883717 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99698a38-fb4d-4ae7-86e3-9608e6541827 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:39:52.884211 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99698a38-fb4d-4ae7-86e3-9608e6541827 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:39:52.884339 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99698a38-fb4d-4ae7-86e3-9608e6541827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:39:52.904805 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-99698a38-fb4d-4ae7-86e3-9608e6541827 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:39:52.905988 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-99698a38-fb4d-4ae7-86e3-9608e6541827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:39:52.914344 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1453/2924] 10.222.0.49 () {58 vars in 1016 bytes} [Tue Aug 30 01:39:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:39:52.937218 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd94ce9b-3b86-41a4-b6df-a18b88910b28 service nova] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:39:52.948777 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd94ce9b-3b86-41a4-b6df-a18b88910b28 service nova] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:39:52.954032 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1b8cc9-0092-4643-ad57-281f850f7029 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8889145228a24fb6bd539a11925e62f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:39:52.954612 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b8cc9-0092-4643-ad57-281f850f7029 service nova] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:39:52.954886 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b8cc9-0092-4643-ad57-281f850f7029 service nova] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:39:52.955154 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b8cc9-0092-4643-ad57-281f850f7029 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:39:52.963988 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1b8cc9-0092-4643-ad57-281f850f7029 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:39:52.965577 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1b8cc9-0092-4643-ad57-281f850f7029 service nova] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:39:52.974824 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1472/2925] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:39:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:39:56.044992 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16afba5-2b19-46de-b93b-83aa94acfa14 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:39:56.045491 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16afba5-2b19-46de-b93b-83aa94acfa14 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:39:56.045629 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16afba5-2b19-46de-b93b-83aa94acfa14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:39:56.065091 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-e16afba5-2b19-46de-b93b-83aa94acfa14 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:39:56.066325 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-e16afba5-2b19-46de-b93b-83aa94acfa14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:39:56.074080 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1454/2926] 10.222.0.49 () {58 vars in 1016 bytes} [Tue Aug 30 01:39:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:39:56.101038 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1b8cc9-0092-4643-ad57-281f850f7029 service nova] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:39:56.112514 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1b8cc9-0092-4643-ad57-281f850f7029 service nova] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:39:56.118504 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36894f52-6931-4ba8-8175-487c35979d30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8889145228a24fb6bd539a11925e62f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:39:56.119093 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36894f52-6931-4ba8-8175-487c35979d30 service nova] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:39:56.119369 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36894f52-6931-4ba8-8175-487c35979d30 service nova] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:39:56.119719 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36894f52-6931-4ba8-8175-487c35979d30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:39:56.127934 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36894f52-6931-4ba8-8175-487c35979d30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:39:56.129525 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36894f52-6931-4ba8-8175-487c35979d30 service nova] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:39:56.138741 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1473/2927] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:39:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:39:59.210337 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0648b98-7610-407e-be44-4eda2268a21d None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:39:59.210881 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0648b98-7610-407e-be44-4eda2268a21d None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:39:59.210881 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0648b98-7610-407e-be44-4eda2268a21d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:39:59.230861 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-a0648b98-7610-407e-be44-4eda2268a21d None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:39:59.232108 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-a0648b98-7610-407e-be44-4eda2268a21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:39:59.240537 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1455/2928] 10.222.0.49 () {58 vars in 1016 bytes} [Tue Aug 30 01:39:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:39:59.262194 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36894f52-6931-4ba8-8175-487c35979d30 service nova] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:39:59.273541 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36894f52-6931-4ba8-8175-487c35979d30 service nova] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:39:59.278958 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b20fdb-a5c9-4254-99e2-30b37bbf1138 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8889145228a24fb6bd539a11925e62f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:39:59.279571 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b20fdb-a5c9-4254-99e2-30b37bbf1138 service nova] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:39:59.279852 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b20fdb-a5c9-4254-99e2-30b37bbf1138 service nova] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:39:59.280121 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b20fdb-a5c9-4254-99e2-30b37bbf1138 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:39:59.288758 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b20fdb-a5c9-4254-99e2-30b37bbf1138 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:39:59.290323 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b20fdb-a5c9-4254-99e2-30b37bbf1138 service nova] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:39:59.299675 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1474/2929] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:39:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:40:09.225735 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=18 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:40:09.295452 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=36 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:40:13.227573 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae90e1c-b6e4-41a1-a013-a09e68a1fc08 None None] REQUEST_METHOD: `POST` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:40:13.228128 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae90e1c-b6e4-41a1-a013-a09e68a1fc08 None None] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:40:13.228128 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae90e1c-b6e4-41a1-a013-a09e68a1fc08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:40:13.247274 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.auth.core [None req-8ae90e1c-b6e4-41a1-a013-a09e68a1fc08 None None] MFA Rules not processed for user `b789c44dc32147798ab88bbe0f7a5ce2`. Rule list: `[]` (Enabled: `True`). {{(pid=81447) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:40:13.248480 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-8ae90e1c-b6e4-41a1-a013-a09e68a1fc08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:40:13.255087 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1456/2930] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 30 01:40:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:40:13.810463 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b20fdb-a5c9-4254-99e2-30b37bbf1138 service nova] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:40:13.812013 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-64b20fdb-a5c9-4254-99e2-30b37bbf1138 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:40:13.883561 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b20fdb-a5c9-4254-99e2-30b37bbf1138 service nova] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:40:13.888583 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a54ef-2d61-4d0a-8c86-5a597bf571d6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8dbb4742c3944b9ad389e9628b5a047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:40:13.889191 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a54ef-2d61-4d0a-8c86-5a597bf571d6 service placement] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:40:13.889472 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a54ef-2d61-4d0a-8c86-5a597bf571d6 service placement] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:40:13.889744 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a54ef-2d61-4d0a-8c86-5a597bf571d6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:40:13.891539 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-201a54ef-2d61-4d0a-8c86-5a597bf571d6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:40:13.903836 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201a54ef-2d61-4d0a-8c86-5a597bf571d6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:40:13.905406 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201a54ef-2d61-4d0a-8c86-5a597bf571d6 service placement] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:40:13.915262 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1475/2931] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:40:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:40:15.609407 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae90e1c-b6e4-41a1-a013-a09e68a1fc08 None None] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:40:15.619942 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae90e1c-b6e4-41a1-a013-a09e68a1fc08 None None] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:40:15.623471 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf39bb-5e20-4dcf-b063-e779d09b13ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61e48e00a0c34949a4fffae8c372304e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:40:15.624059 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf39bb-5e20-4dcf-b063-e779d09b13ee service neutron] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:40:15.624331 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf39bb-5e20-4dcf-b063-e779d09b13ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:40:15.624592 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf39bb-5e20-4dcf-b063-e779d09b13ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:40:15.626311 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-bbaf39bb-5e20-4dcf-b063-e779d09b13ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:40:15.635695 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaf39bb-5e20-4dcf-b063-e779d09b13ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:40:15.637092 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaf39bb-5e20-4dcf-b063-e779d09b13ee service neutron] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:40:15.645090 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1457/2932] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:40:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:40:23.673146 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9efe5b4-964d-4f15-bb85-3a893a27acbe None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:40:23.673704 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9efe5b4-964d-4f15-bb85-3a893a27acbe None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:40:23.673819 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9efe5b4-964d-4f15-bb85-3a893a27acbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:40:23.693980 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-c9efe5b4-964d-4f15-bb85-3a893a27acbe None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:40:23.695202 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-c9efe5b4-964d-4f15-bb85-3a893a27acbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:40:23.702921 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1476/2933] 10.222.0.49 () {58 vars in 1016 bytes} [Tue Aug 30 01:40:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:40:23.723465 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf39bb-5e20-4dcf-b063-e779d09b13ee service neutron] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:40:23.736778 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf39bb-5e20-4dcf-b063-e779d09b13ee service neutron] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:40:23.742697 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b445650-773d-430e-aa55-840e69032420 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8889145228a24fb6bd539a11925e62f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:40:23.743280 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b445650-773d-430e-aa55-840e69032420 service nova] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:40:23.743585 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b445650-773d-430e-aa55-840e69032420 service nova] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:40:23.743855 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b445650-773d-430e-aa55-840e69032420 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:40:23.751779 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b445650-773d-430e-aa55-840e69032420 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:40:23.753338 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b445650-773d-430e-aa55-840e69032420 service nova] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:40:23.762531 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1458/2934] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:40:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:40:26.936632 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66847bc-0741-46d1-98fe-28a91db76916 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:40:26.937170 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66847bc-0741-46d1-98fe-28a91db76916 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:40:26.937170 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66847bc-0741-46d1-98fe-28a91db76916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:40:26.956552 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-c66847bc-0741-46d1-98fe-28a91db76916 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:40:26.957760 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-c66847bc-0741-46d1-98fe-28a91db76916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:40:26.966537 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1477/2935] 10.222.0.49 () {58 vars in 1016 bytes} [Tue Aug 30 01:40:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:40:26.988384 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b445650-773d-430e-aa55-840e69032420 service nova] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:40:27.000156 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b445650-773d-430e-aa55-840e69032420 service nova] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:40:27.005667 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f464e-7456-4034-98e8-3491ef62f76b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8889145228a24fb6bd539a11925e62f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:40:27.006262 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f464e-7456-4034-98e8-3491ef62f76b service nova] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:40:27.006573 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f464e-7456-4034-98e8-3491ef62f76b service nova] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:40:27.006845 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f464e-7456-4034-98e8-3491ef62f76b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:40:27.016181 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115f464e-7456-4034-98e8-3491ef62f76b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:40:27.017750 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115f464e-7456-4034-98e8-3491ef62f76b service nova] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:40:27.026873 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1459/2936] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:40:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:40:30.024302 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd8760-c9b4-4e23-a153-d033cf902d70 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:40:30.027247 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd8760-c9b4-4e23-a153-d033cf902d70 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:40:30.027247 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd8760-c9b4-4e23-a153-d033cf902d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:40:30.051291 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-a3cd8760-c9b4-4e23-a153-d033cf902d70 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:40:30.052514 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-a3cd8760-c9b4-4e23-a153-d033cf902d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:40:30.060189 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1478/2937] 10.222.0.49 () {58 vars in 1016 bytes} [Tue Aug 30 01:40:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:40:30.080292 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f464e-7456-4034-98e8-3491ef62f76b service nova] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:40:30.092686 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f464e-7456-4034-98e8-3491ef62f76b service nova] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:40:30.098096 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8106c9e9-01d1-43b6-b512-99d2a90be31e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8889145228a24fb6bd539a11925e62f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:40:30.098689 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8106c9e9-01d1-43b6-b512-99d2a90be31e service nova] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:40:30.098970 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8106c9e9-01d1-43b6-b512-99d2a90be31e service nova] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:40:30.099243 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8106c9e9-01d1-43b6-b512-99d2a90be31e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:40:30.107847 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8106c9e9-01d1-43b6-b512-99d2a90be31e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:40:30.109413 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8106c9e9-01d1-43b6-b512-99d2a90be31e service nova] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:40:30.118775 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1460/2938] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:40:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:40:33.185745 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f7808-b931-4b7f-b17f-f4d3e543304f None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:40:33.186280 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f7808-b931-4b7f-b17f-f4d3e543304f None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:40:33.186393 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f7808-b931-4b7f-b17f-f4d3e543304f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:40:33.205752 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-8c7f7808-b931-4b7f-b17f-f4d3e543304f None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:40:33.206950 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-8c7f7808-b931-4b7f-b17f-f4d3e543304f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:40:33.215715 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1479/2939] 10.222.0.49 () {58 vars in 1016 bytes} [Tue Aug 30 01:40:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:40:33.237625 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8106c9e9-01d1-43b6-b512-99d2a90be31e service nova] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:40:33.248794 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8106c9e9-01d1-43b6-b512-99d2a90be31e service nova] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:40:33.254189 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e7f24-28e1-45c1-b01c-184b67531bbf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8889145228a24fb6bd539a11925e62f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:40:33.254777 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e7f24-28e1-45c1-b01c-184b67531bbf service nova] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:40:33.255055 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e7f24-28e1-45c1-b01c-184b67531bbf service nova] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:40:33.255328 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e7f24-28e1-45c1-b01c-184b67531bbf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:40:33.263283 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92e7f24-28e1-45c1-b01c-184b67531bbf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:40:33.264884 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92e7f24-28e1-45c1-b01c-184b67531bbf service nova] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:40:33.274085 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1461/2940] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:40:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:40:36.352116 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7ff28-76fd-45b0-81d8-d1732b245669 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:40:36.352688 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7ff28-76fd-45b0-81d8-d1732b245669 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:40:36.352801 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7ff28-76fd-45b0-81d8-d1732b245669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:40:36.372001 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-e3c7ff28-76fd-45b0-81d8-d1732b245669 None None] MFA Rules not processed for user `68ff671606954cb48c45e22d8978bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 01:40:36.373685 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-e3c7ff28-76fd-45b0-81d8-d1732b245669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:40:36.381466 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1480/2941] 10.222.0.49 () {58 vars in 1016 bytes} [Tue Aug 30 01:40:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 01:40:36.406936 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e7f24-28e1-45c1-b01c-184b67531bbf service nova] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:40:36.418039 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e7f24-28e1-45c1-b01c-184b67531bbf service nova] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:40:36.423528 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8694ca-8bb4-407c-b8f0-f38f8b3c4a2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8889145228a24fb6bd539a11925e62f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:40:36.424126 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8694ca-8bb4-407c-b8f0-f38f8b3c4a2d service nova] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:40:36.424406 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8694ca-8bb4-407c-b8f0-f38f8b3c4a2d service nova] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:40:36.424680 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8694ca-8bb4-407c-b8f0-f38f8b3c4a2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:40:36.433000 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8694ca-8bb4-407c-b8f0-f38f8b3c4a2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:40:36.434569 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8694ca-8bb4-407c-b8f0-f38f8b3c4a2d service nova] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:40:36.443897 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1462/2942] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:40:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:40:45.726829 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c7ff28-76fd-45b0-81d8-d1732b245669 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:40:45.733897 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=48 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:40:45.740858 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c7ff28-76fd-45b0-81d8-d1732b245669 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:40:45.746319 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750220bc-084f-4c51-833e-756f76a8cc1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8889145228a24fb6bd539a11925e62f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:40:45.746905 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750220bc-084f-4c51-833e-756f76a8cc1c service nova] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:40:45.747176 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750220bc-084f-4c51-833e-756f76a8cc1c service nova] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:40:45.747467 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750220bc-084f-4c51-833e-756f76a8cc1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:40:45.749163 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-750220bc-084f-4c51-833e-756f76a8cc1c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:40:45.761574 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750220bc-084f-4c51-833e-756f76a8cc1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:40:45.763150 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750220bc-084f-4c51-833e-756f76a8cc1c service nova] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:40:45.775382 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1481/2943] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:40:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:40:46.439727 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=39 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:40:55.770325 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=5 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:41:04.558357 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8694ca-8bb4-407c-b8f0-f38f8b3c4a2d service nova] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:41:04.569857 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8694ca-8bb4-407c-b8f0-f38f8b3c4a2d service nova] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:41:04.574587 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7467137d-ab94-487e-9852-3d3e082dadd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:41:04.575215 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467137d-ab94-487e-9852-3d3e082dadd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:41:04.575533 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467137d-ab94-487e-9852-3d3e082dadd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:41:04.575840 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467137d-ab94-487e-9852-3d3e082dadd1 admin admin] PATH_INFO: `/v3/users/b789c44dc32147798ab88bbe0f7a5ce2` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:41:04.576950 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7467137d-ab94-487e-9852-3d3e082dadd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b789c44dc32147798ab88bbe0f7a5ce2)` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:41:04.578933 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7467137d-ab94-487e-9852-3d3e082dadd1 admin admin] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:41:04.627054 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-7467137d-ab94-487e-9852-3d3e082dadd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b789c44dc32147798ab88bbe0f7a5ce2'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:41:04.633832 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-7467137d-ab94-487e-9852-3d3e082dadd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b789c44dc32147798ab88bbe0f7a5ce2'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:41:04.634509 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-7467137d-ab94-487e-9852-3d3e082dadd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b789c44dc32147798ab88bbe0f7a5ce2'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:41:04.635127 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-7467137d-ab94-487e-9852-3d3e082dadd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b789c44dc32147798ab88bbe0f7a5ce2'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:41:04.646971 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.notifications [None req-7467137d-ab94-487e-9852-3d3e082dadd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b789c44dc32147798ab88bbe0f7a5ce2'} {{(pid=81447) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:41:04.659214 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1463/2944] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 30 01:41:04 2022] DELETE /identity/v3/users/b789c44dc32147798ab88bbe0f7a5ce2 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 01:41:04.836027 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750220bc-084f-4c51-833e-756f76a8cc1c service nova] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:41:04.847354 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750220bc-084f-4c51-833e-756f76a8cc1c service nova] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:41:04.904661 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e238aa08-a8f5-4f50-88f1-cbcc5b95567f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ff671606954cb48c45e22d8978bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a06ede3df8449d487fb53c388e91ca5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:41:04.905282 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238aa08-a8f5-4f50-88f1-cbcc5b95567f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:41:04.905556 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238aa08-a8f5-4f50-88f1-cbcc5b95567f admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:41:04.905825 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238aa08-a8f5-4f50-88f1-cbcc5b95567f admin admin] PATH_INFO: `/v3/projects/e98c92e3e95242fe8eceba2a43803dc5` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:41:04.906921 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e238aa08-a8f5-4f50-88f1-cbcc5b95567f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e98c92e3e95242fe8eceba2a43803dc5)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:41:04.908935 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e238aa08-a8f5-4f50-88f1-cbcc5b95567f admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:41:04.953256 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e238aa08-a8f5-4f50-88f1-cbcc5b95567f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e98c92e3e95242fe8eceba2a43803dc5', 'request_id': 'req-e238aa08-a8f5-4f50-88f1-cbcc5b95567f'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:41:04.959193 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e238aa08-a8f5-4f50-88f1-cbcc5b95567f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e98c92e3e95242fe8eceba2a43803dc5', 'request_id': 'req-e238aa08-a8f5-4f50-88f1-cbcc5b95567f'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:41:04.967099 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e238aa08-a8f5-4f50-88f1-cbcc5b95567f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e98c92e3e95242fe8eceba2a43803dc5', 'request_id': 'req-e238aa08-a8f5-4f50-88f1-cbcc5b95567f'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:41:04.977407 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e238aa08-a8f5-4f50-88f1-cbcc5b95567f admin admin] The token cache is being invalidate because project e98c92e3e95242fe8eceba2a43803dc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 01:41:04.977684 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e238aa08-a8f5-4f50-88f1-cbcc5b95567f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:41:04.978291 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e238aa08-a8f5-4f50-88f1-cbcc5b95567f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 01:41:04.980412 dv-cinder-819668-6-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1482/2945] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 30 01:41:04 2022] DELETE /identity/v3/projects/e98c92e3e95242fe8eceba2a43803dc5 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 01:41:14.655660 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:41:14.974521 dv-cinder-819668-6-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:42:46.892593 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7467137d-ab94-487e-9852-3d3e082dadd1 admin admin] Authenticating user token {{(pid=81447) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 01:42:46.893978 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-7467137d-ab94-487e-9852-3d3e082dadd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:42:46.962142 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7467137d-ab94-487e-9852-3d3e082dadd1 admin admin] Validating token access rules against request {{(pid=81447) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 01:42:47.021214 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbd80c7-cbc3-4777-8d71-f112d4800797 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8dbb4742c3944b9ad389e9628b5a047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b050b2dad22a4a06875072e44c8c9824', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81447) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 01:42:47.021822 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd80c7-cbc3-4777-8d71-f112d4800797 service placement] REQUEST_METHOD: `GET` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 01:42:47.022099 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd80c7-cbc3-4777-8d71-f112d4800797 service placement] SCRIPT_NAME: `/identity` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 01:42:47.022371 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd80c7-cbc3-4777-8d71-f112d4800797 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81447) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 01:42:47.024116 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.fernet_utils [None req-5cbd80c7-cbc3-4777-8d71-f112d4800797 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81447) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 01:42:47.035095 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbd80c7-cbc3-4777-8d71-f112d4800797 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 01:42:47.036691 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbd80c7-cbc3-4777-8d71-f112d4800797 service placement] RBAC: Authorization granted {{(pid=81447) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 01:42:47.046440 dv-cinder-819668-6-smb devstack@keystone.service[81447]: [pid: 81447|app: 0|req: 1464/2946] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 30 01:42:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 01:42:57.042206 dv-cinder-819668-6-smb devstack@keystone.service[81447]: DEBUG dbcounter [-] [81447] Writing DB stats keystone:SELECT=58 {{(pid=81447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}